00000800:00000200:0.1F:1763334036.294257:0:3287:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [00000000c7f0020d] -> 12345-192.168.201.160@tcp (2) 00000800:00000200:2.1F:1763334036.302486:0:3278:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [00000000c7f0020d] -> 12345-192.168.201.160@tcp (2) 00000800:00000200:2.1:1763334036.302495:0:3278:0:(socklnd.c:175:ksocknal_destroy_peer()) peer_ni 12345-192.168.201.160@tcp 0000000035368b70 deleted 00000800:00000010:2.1:1763334036.302497:0:3278:0:(socklnd.c:184:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at 0000000035368b70. 00000800:00000200:2.1:1763334036.302502:0:3278:0:(socklnd.c:384:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:2.1:1763334036.302507:0:3278:0:(socklnd_cb.c:748:ksocknal_queue_tx_locked()) Sending to 12345-192.168.201.160@tcp ip 192.168.201.160:1023 00000800:00000200:2.1:1763334036.302511:0:3278:0:(socklnd_cb.c:767:ksocknal_queue_tx_locked()) Packet 00000000f453d4f8 type 2, nob 96 niov 1 nkiov 0 00000800:00000200:2.1:1763334036.302680:0:3277:0:(socklnd.c:384:ksocknal_incr_conn_count()) Add conn type 1, ksnr_connected 2 ksnr_max_conns 1 00000800:00000200:1.1F:1763334036.312909:0:3279:0:(socklnd.c:214:ksocknal_find_peer_locked()) got peer_ni [00000000c7f0020d] -> 12345-192.168.201.160@tcp (4) 00000800:00000200:1.1:1763334036.312923:0:3279:0:(socklnd.c:175:ksocknal_destroy_peer()) peer_ni 12345-192.168.201.160@tcp 00000000a4f58227 deleted 00000800:00000010:1.1:1763334036.312926:0:3279:0:(socklnd.c:184:ksocknal_destroy_peer()) kfreed 'peer_ni': 184 at 00000000a4f58227. 00000800:00000200:1.1:1763334036.312932:0:3279:0:(socklnd.c:384:ksocknal_incr_conn_count()) Add conn type 3, ksnr_connected a ksnr_max_conns 1 00000800:00000200:2.1:1763334036.320363:0:3277:0:(socklnd.c:384:ksocknal_incr_conn_count()) Add conn type 2, ksnr_connected e ksnr_max_conns 1 00010000:00000010:1.1:1763334036.581607:0:0:0:(ldlm_resource.c:1330:__ldlm_resource_free()) slab-freed '(res)': 248 at 000000001e4fa366. 00010000:00000010:1.1:1763334036.581623:0:0:0:(ldlm_lock.c:174:lock_handle_free()) slab-freed 'lock': 512 at 000000002e37a7e9. 00010000:00000010:3.1F:1763334037.192700:0:0:0:(ldlm_resource.c:1330:__ldlm_resource_free()) slab-freed '(res)': 248 at 000000005ad26d11. 00010000:00000010:3.1:1763334037.192719:0:0:0:(ldlm_lock.c:174:lock_handle_free()) slab-freed 'lock': 512 at 000000002e37a7e9. 00010000:00000010:2.1:1763334037.201186:0:5728:0:(ldlm_lock.c:174:lock_handle_free()) slab-freed 'lock': 512 at 0000000059914cf2. 00010000:00000010:2.1:1763334037.201203:0:5728:0:(ldlm_resource.c:1330:__ldlm_resource_free()) slab-freed '(res)': 248 at 00000000e162ba76. 00010000:00000010:2.1:1763334037.201206:0:5728:0:(ldlm_lock.c:174:lock_handle_free()) slab-freed 'lock': 512 at 000000009704e5f8. 00010000:00010000:3.0:1763334955.162730:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044600/0xcedf0054f8496fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334955.162806:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334955.162810:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334955.162835:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044600/0xcedf0054f8496fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.162867:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f8496fca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae770 expref: 156 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.162889:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044600/0xcedf0054f8496fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae770 expref: 155 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.162900:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334955.162903:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334955.162908:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5b02044600, rc 0) 00000100:00100000:3.0:1763334955.162996:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+155:52901:x1848989694189184:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 469us (2506us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.163004:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 3975 00000100:00100000:3.0:1763334955.168277:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694189312 00000100:00100000:3.0:1763334955.168292:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694189312 00000100:00100000:3.0:1763334955.168371:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 3976 00000100:00100000:3.0:1763334955.168383:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+154:52901:x1848989694189312:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334955.168411:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334955.168446:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f8496fd8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae777 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.168558:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02045200/0xcedf0054f8496fdf lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.168614:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02045200/0xcedf0054f8496fdf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.168627:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02045200/0xcedf0054f8496fdf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334955.197221:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694190080 00000100:00100000:3.0:1763334955.197233:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694190080 00010000:00010000:3.0:1763334955.197290:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497002 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae77e expref: 157 pid: 30972 timeout: 1119 lvb_type: 0 00000100:00100000:3.0:1763334955.197342:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2257 00000100:00100000:3.0:1763334955.197356:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+157:2360:x1848989694190080:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334955.197377:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334955.197386:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497002 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae77e expref: 157 pid: 30972 timeout: 1119 lvb_type: 0 00010000:00010000:3.0:1763334955.197403:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497002 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae77e expref: 157 pid: 30972 timeout: 1119 lvb_type: 0 00010000:00010000:3.0:1763334955.197446:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497002 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae77e expref: 157 pid: 30972 timeout: 1119 lvb_type: 0 00010000:00010000:3.0:1763334955.197469:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x163:0x0].0x0 (ffff9a5ac51bd700) 00010000:00010000:3.0:1763334955.197476:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497017 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.197489:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497017 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.197503:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497017 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.197540:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334955.205089:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694190208 00000100:00100000:3.0:1763334955.205102:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694190208 00000100:00100000:3.0:1763334955.215122:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+158:52901:x1848989694190464:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 816us (1394us total) trans 8589938263 rc 0/0 00000100:00100000:3.0:1763334955.215135:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1464 00000100:00100000:3.0:1763334955.218019:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.221286:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.246136:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.254927:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.254979:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694191872 00000100:00100000:3.0:1763334955.254993:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694191872 00000100:00100000:3.0:1763334955.255063:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4220 00000100:00100000:3.0:1763334955.255076:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694191872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334955.255103:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334955.255135:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5b02045c00/0xcedf0054f8497080 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae7a1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334955.255170:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334955.255200:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.255203:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.255217:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5b02045c00/0xcedf0054f8497080 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae7a1 expref: 23 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334955.255239:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5b02045c00/0xcedf0054f8497080 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae7a1 expref: 23 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334955.255255:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5b02045c00, rc 0) 00000100:00100000:3.0:1763334955.255330:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694191872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 256us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.255338:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4220 00000100:00100000:3.0:1763334955.260808:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.263316:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.267074:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.267175:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.320923:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701748224 00000100:00100000:3.0:1763334955.320928:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701748224 00000100:00100000:3.0:1763334955.320960:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4222 00000100:00100000:3.0:1763334955.320968:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701748096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334955.321215:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701748096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 247us (1362us total) trans 17179870821 rc 0/0 00000100:00100000:3.0:1763334955.321223:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4222 00000100:00100000:3.0:1763334955.321241:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4223 00000100:00100000:3.0:1763334955.321247:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701747456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334955.321256:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:492 count 1 00010000:00010000:3.0:1763334955.321270:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f84970aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.321286:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f8496f53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae74d expref: 22 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.321294:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334955.321297:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334955.321300:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f84970aa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.321332:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f8496f53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae74d expref: 22 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.321347:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f8496f53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae74d expref: 22 pid: 26216 timeout: 1119 lvb_type: 0 00000100:00100000:3.0:1763334955.321360:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701748352:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334955.321434:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98000 going to sleep for 11 seconds 00000100:00100000:3.0:1763334955.321454:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4224 00000100:00100000:3.0:1763334955.321461:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701747968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334955.321549:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334955.321552:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1ee:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763334955.321555:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334955.321557:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1ee:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763334955.321559:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334955.321615:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701747968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (1693us total) trans 17179870822 rc 0/0 00000100:00100000:3.0:1763334955.321621:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4224 00000100:00100000:3.0:1763334955.321634:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4225 00000100:00100000:3.0:1763334955.321639:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701747712:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334955.321648:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:488 count 1 00010000:00010000:3.0:1763334955.321658:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044600/0xcedf0054f84970b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.321675:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f8496c66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae658 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.321682:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334955.321683:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334955.321686:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044600/0xcedf0054f84970b1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.321702:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f8496c66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae658 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.321711:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f8496c66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae658 expref: 22 pid: 6517 timeout: 1119 lvb_type: 0 00000100:00100000:3.0:1763334955.321720:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701748480:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334955.321739:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b983c0 going to sleep for 11 seconds 00000004:00080000:3.0:1763334955.321888:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c9e84000/2, rc 0, transno 17179870822 00000100:00100000:3.0:1763334955.321895:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701747968:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334955.321905:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c9e87b80/2, rc 0, transno 17179870821 00000100:00100000:3.0:1763334955.321909:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701748096:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334955.324639:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701749376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334955.324673:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334955.324703:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334955.324709:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701749248:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334955.324730:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763334955.325865:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44c380/2, rc 0, transno 21474838109 00000100:00100000:3.0:1763334955.325874:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701749248:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334955.325884:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44f800/2, rc 0, transno 21474838108 00000100:00100000:3.0:1763334955.325890:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701749376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334955.330868:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.330917:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.330972:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.330994:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.331014:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.331062:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.331086:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694192896 00000100:00100000:3.0:1763334955.331092:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694192896 00010000:00010000:3.0:1763334955.331115:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8496ed5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae723 expref: 24 pid: 6517 timeout: 1119 lvb_type: 0 00000100:00100000:3.0:1763334955.331134:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694193024 00000100:00100000:3.0:1763334955.331138:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694193024 00010000:00010000:3.0:1763334955.331155:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5afa2bb800/0xcedf0054f8496f4c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae746 expref: 22 pid: 6517 timeout: 1119 lvb_type: 0 00000100:00100000:3.0:1763334955.331179:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2259 00000100:00100000:3.0:1763334955.331194:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2361:x1848989694192768:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334955.331215:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334955.331224:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f8496f53 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae74d expref: 25 pid: 26216 timeout: 1119 lvb_type: 0 00010000:00010000:3.0:1763334955.331243:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f8496f53 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae74d expref: 25 pid: 26216 timeout: 1119 lvb_type: 0 00010000:00010000:3.0:1763334955.331292:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.331296:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.331306:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f84970aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.331332:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f84970aa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.331367:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334955.331444:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2361:x1848989694192768:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 255us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.331452:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2259 00000100:00100000:3.0:1763334955.331473:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2261 00000100:00100000:3.0:1763334955.331479:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694193152:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334955.331490:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334955.331495:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8496ee3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae72a expref: 22 pid: 6517 timeout: 1119 lvb_type: 0 00010000:00010000:3.0:1763334955.331506:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8496ee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae72a expref: 22 pid: 6517 timeout: 1119 lvb_type: 0 00010000:00010000:3.0:1763334955.331520:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.331522:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.331526:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84970cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.331537:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84970cd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.336537:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334955.336602:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694193152:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5120us (5628us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.336612:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2261 00000100:00100000:3.0:1763334955.336666:0:6517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6517:1848989701749632:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334955.336688:0:6517:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793600/0xcedf0054f84970d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.336724:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8496ee3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae72a expref: 20 pid: 6517 timeout: 1119 lvb_type: 0 00000100:00100000:3.0:1763334955.336736:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701749504:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334955.336749:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84970cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.336758:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84970cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.336765:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84970cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.336774:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84970cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.336782:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84970cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.336802:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334955.338732:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3290:x1848989701749120:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14642us (14815us total) trans 21474838110 rc 0/0 00000100:00100000:3.0:1763334955.338743:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4229 00010000:00010000:3.0:1763334955.344316:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334955.344389:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44c000/2, rc 0, transno 21474838111 00000100:00100000:3.0:1763334955.344399:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701748992:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763334955.344414:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44df80/2, rc 0, transno 21474838110 00000100:00100000:3.0:1763334955.344545:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701749120:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334955.354301:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694194304 00000100:00100000:3.0:1763334955.354308:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694194304 00000100:00100000:3.0:1763334955.354347:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4234 00000100:00100000:3.0:1763334955.354355:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+18:52274:x1848989694194304:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334955.354369:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334955.354451:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f8497105 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae7c4 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334955.354480:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ea:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334955.354506:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.354510:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.354522:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f8497105 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae7c4 expref: 19 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.354549:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f8497105 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae7c4 expref: 19 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.354562:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0031000, rc 0) 00000100:00100000:3.0:1763334955.355412:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+19:52274:x1848989694194304:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1050us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.355434:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4234 00000100:00100000:3.0:1763334955.382035:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.397458:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.419254:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.428192:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.466568:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694196608 00000100:00100000:3.0:1763334955.467096:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694196608 00000100:00100000:3.0:1763334955.475477:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701750272:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334955.475520:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849716e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334955.485779:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 3992 00000100:00100000:3.0:1763334955.485816:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+162:52905:x1848989694196992:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334955.485845:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334955.485877:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849718a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae7ee expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.485973:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497191 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.485996:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497191 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486010:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497191 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486028:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497198 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486048:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497198 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486054:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497198 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486141:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497191 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486148:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497191 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486155:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497191 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486161:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0031800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334955.486166:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497191 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486174:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497191 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486188:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334955.486192:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334955.486198:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497191 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486205:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497191 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486218:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497198 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486223:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497198 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486229:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497198 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486233:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0030200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334955.486236:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497198 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486241:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497198 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486247:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac63d5100) 00010000:00010000:3.0:1763334955.486250:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334955.486253:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497198 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486258:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497198 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.486297:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849718a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae7ee expref: 163 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.486308:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334955.486311:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334955.486315:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849718a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae7ee expref: 163 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.486324:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030e00, rc 0) 00000100:00100000:3.0:1763334955.486436:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+162:52905:x1848989694196992:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 640us (2929us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334955.486446:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 3992 00010000:00010000:3.0:1763334955.489327:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849716e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.489339:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849716e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.489380:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849716e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.489389:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849716e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.489398:0:26216:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849716e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.489405:0:26216:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c6e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334955.489410:0:26216:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849716e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.489431:0:26216:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849716e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.489446:0:26216:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849716e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.489454:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849716e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334955.490061:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694196608:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 22064us (23784us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.490073:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4235 00000100:00100000:3.0:1763334955.497137:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694197248 00000100:00100000:3.0:1763334955.497153:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694197248 00000100:00100000:3.0:1763334955.497233:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694197504 00000100:00100000:3.0:1763334955.497237:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694197504 00000100:00100000:3.0:1763334955.497275:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 3993 00000100:00100000:3.0:1763334955.497288:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52905:x1848989694197248:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334955.497319:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334955.497351:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849719f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae7f5 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.497487:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044600/0xcedf0054f84971a6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.497507:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044600/0xcedf0054f84971a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.497522:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044600/0xcedf0054f84971a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334955.497654:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334955.497659:0:29629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334955.497691:0:29629:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044600/0xcedf0054f84971a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.497726:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849719f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae7f5 expref: 165 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.497748:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044600/0xcedf0054f84971a6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae7f5 expref: 164 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.497758:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334955.497762:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334955.497766:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5b02044600, rc 0) 00000100:00100000:3.0:1763334955.497855:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+164:52905:x1848989694197248:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 569us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.497865:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 3993 00000100:00100000:3.0:1763334955.497892:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 3994 00000100:00100000:3.0:1763334955.497902:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52903:x1848989694197504:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:3.0:1763334955.497940:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334955.497961:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8497152 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x163:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae7d9 expref: 163 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.497972:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x163:0x0].0x0 (ffff9a5ad29c0f00) 00010000:00010000:3.0:1763334955.497978:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334955.498003:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f84971ad lrc: 3/0,1 mode: --/EX res: [0x200000404:0x163:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.498016:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f84971ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.498023:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f84971ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000040:00080000:3.0:1763334955.498557:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].913, 88 off79824 00000004:00080000:3.0:1763334955.498609:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1020131997438ns, next at 1020792502454ns, rc = 0 00000040:00080000:3.0:1763334955.498755:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].902, 88 off78760 00000004:00080000:3.0:1763334955.498761:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1020132188710ns, next at 1020792469284ns, rc = 0 00000040:00080000:3.0:1763334955.498787:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].903, 88 off78848 00000004:00080000:3.0:1763334955.498792:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1020132219784ns, next at 1020792469284ns, rc = 0 00000040:00080000:3.0:1763334955.498808:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].914, 88 off79912 00000004:00080000:3.0:1763334955.498812:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1020132240088ns, next at 1020792502454ns, rc = 0 00000100:00100000:3.0:1763334955.511026:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.545189:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e85880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701750400:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334955.545230:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098000/0xcedf0054f84971f3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x165:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:3.0:1763334955.559770:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004503f527 reply state 00000000606f9a31 transno 8589938281 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f84971ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334955.559792:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334955.559959:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52903:x1848989694197504:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 62053us (62897us total) trans 8589938281 rc 0/0 00000100:00100000:3.0:1763334955.559970:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 3994 00010000:00010000:3.0:1763334955.563664:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f84971ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.563693:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f84971ad lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.563704:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f84971ad lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.563711:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5b02044c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334955.563716:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f84971ad lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.563726:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f84971ad lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.563749:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x163:0x0].0x0 (ffff9a5ad29c0f00) 00010000:00010000:3.0:1763334955.563753:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334955.563759:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f84971ad lrc: 2/0,0 mode: --/EX res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.563766:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f84971ad lrc: 0/0,0 mode: --/EX res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334955.574340:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.576007:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694198912 00000100:00100000:3.0:1763334955.576018:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694198912 00000100:00100000:3.0:1763334955.576082:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 3998 00000100:00100000:3.0:1763334955.576093:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+155:52903:x1848989694198912:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334955.576119:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334955.576152:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02045c00/0xcedf0054f8497201 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x163:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae811 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.576241:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02045c00/0xcedf0054f8497201 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae811 expref: 156 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.576262:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02045c00/0xcedf0054f8497201 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x163:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae811 expref: 156 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.576287:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x163:0x0].0x0 (ffff9a5ad29c0f00) 00010000:00010000:3.0:1763334955.576291:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334955.576297:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5b02045c00, rc 0) 00000100:00100000:3.0:1763334955.578783:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+156:52903:x1848989694198912:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2674us (2844us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.578799:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 3998 00000100:00100000:3.0:1763334955.587523:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.593426:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.611906:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.650260:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694200192 00000100:00100000:3.0:1763334955.650277:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694200192 00000100:00100000:3.0:1763334955.650384:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1626 00000100:00100000:3.0:1763334955.650396:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694200192:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:3.0:1763334955.650462:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f849725c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.650482:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.650485:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.650492:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f849725c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.650509:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f849725c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.650753:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f849725c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.650764:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f849725c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.650773:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f849725c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.650782:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5b02044c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334955.650787:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f849725c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.650798:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f849725c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.650821:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f849725c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.650829:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044c00/0xcedf0054f849725c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334955.650929:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694200192:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 534us (972us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763334955.650939:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1626 00000100:00100000:3.0:1763334955.659780:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694200320 00000100:00100000:3.0:1763334955.659801:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694200320 00000100:00100000:3.0:1763334955.659991:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4004 00000100:00100000:3.0:1763334955.660005:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52903:x1848989694200320:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334955.660030:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334955.660057:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f8497263 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x163:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae83b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.660101:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02045200/0xcedf0054f849726a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x163:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.660120:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02045200/0xcedf0054f849726a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x163:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.660133:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02045200/0xcedf0054f849726a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x163:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.660317:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02044c00/0xcedf0054f8497263 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x163:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae83b expref: 165 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.660340:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02045200/0xcedf0054f849726a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x163:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae83b expref: 164 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.660350:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x163:0x0].0x0 (ffff9a5ad29c0f00) 00010000:00010000:3.0:1763334955.660353:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763334955.660358:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5b02045200, rc 0) 00000100:00100000:3.0:1763334955.668613:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+164:52903:x1848989694200320:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 8567us (10096us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.668634:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4004 00000100:00100000:3.0:1763334955.692539:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694200576 00000100:00100000:3.0:1763334955.692561:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694200576 00000100:00100000:3.0:1763334955.692673:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4245 00000100:00100000:3.0:1763334955.692688:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:52274:x1848989694200576:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334955.692719:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334955.692754:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5b02044c00/0xcedf0054f8497278 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae842 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334955.692791:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ec:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334955.692823:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.692827:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.692840:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5b02044c00/0xcedf0054f8497278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae842 expref: 24 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.692862:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5b02044c00/0xcedf0054f8497278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae842 expref: 24 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.692879:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5b02044c00, rc 0) 00000100:00100000:3.0:1763334955.694462:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+24:52274:x1848989694200576:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1758us (3221us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.694476:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4245 00000100:00100000:3.0:1763334955.696984:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694200704 00000100:00100000:3.0:1763334955.696998:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694200704 00000100:00100000:3.0:1763334955.697081:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4246 00000100:00100000:3.0:1763334955.697096:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:52274:x1848989694200704:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334955.697123:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334955.697159:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044600/0xcedf0054f849727f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae849 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334955.697194:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334955.697227:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.697231:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.697246:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044600/0xcedf0054f849727f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae849 expref: 24 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.697522:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044600/0xcedf0054f849727f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae849 expref: 24 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.697539:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5b02044600, rc 0) 00000100:00100000:3.0:1763334955.699604:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+24:52274:x1848989694200704:12345-192.168.201.60@tcp:101:bash.0 Request processed in 2480us (2712us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.699620:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4246 00000100:00100000:3.0:1763334955.715445:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694200832 00000100:00100000:3.0:1763334955.715469:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694200832 00002000:00010000:3.0:1763334955.715530:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/492 (0->18446744073709551615) 00002000:00100000:3.0:1763334955.715537:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e15880 with x1848989694200832 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334955.715555:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac7e15880. 00000100:00100000:3.0:1763334955.715624:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694200960 00000100:00100000:3.0:1763334955.715629:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694200960 00002000:00010000:3.0:1763334955.715645:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/496 (0->18446744073709551615) 00002000:00100000:3.0:1763334955.715649:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e17b80 with x1848989694200960 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334955.715656:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac7e17b80. 00000100:00100000:3.0:1763334955.715689:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1628 00000100:00100000:3.0:1763334955.715705:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694200832:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334955.716175:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1ec:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334955.716180:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1ec:0x0] updating lvb mtime from disk: 0 -> 1763334956 00002000:00010000:3.0:1763334955.716186:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1ec:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334955.716191:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1ec:0x0] updating lvb ctime from disk: 0 -> 1763334956 00002000:00010000:3.0:1763334955.716199:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1ec:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334955.717444:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694200832:12345-192.168.201.60@tcp:10:bash.0 Request processed in 1738us (14740us total) trans 21474838119 rc 0/0 00000100:00100000:3.0:1763334955.717454:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1628 00002000:00010000:3.0:1763334955.717459:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/492 (0->18446744073709551615) 00002000:00100000:3.0:1763334955.717462:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e15880 with x1848989694200832 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334955.717470:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac7e15880. 00000001:00080000:3.0:1763334955.785660:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838109 is committed 00000001:00080000:3.0:1763334955.785687:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838092 is committed 00000100:00100000:3.0:1763334955.789923:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694201216 00000100:00100000:3.0:1763334955.789938:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694201216 00000100:00100000:3.0:1763334955.790508:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1474 00000100:00100000:3.0:1763334955.790523:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+155:52274:x1848989694201216:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:3.0:1763334955.798845:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+156:52274:x1848989694201216:12345-192.168.201.60@tcp:35:bash.0 Request processed in 8307us (9276us total) trans 8589938290 rc 0/0 00000100:00100000:3.0:1763334955.798863:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1474 00000100:00100000:3.0:1763334955.799730:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694201472 00000100:00100000:3.0:1763334955.799744:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694201472 00000100:00100000:3.0:1763334955.800424:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4005 00000100:00100000:3.0:1763334955.800443:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+156:52903:x1848989694201472:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:3.0:1763334955.800517:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334955.800554:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8497232 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x163:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae818 expref: 156 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.800621:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x163:0x0].0x0 (ffff9a5ad29c0f00) 00010000:00010000:3.0:1763334955.800629:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334955.800714:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497286 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x163:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.800731:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497286 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.800742:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497286 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00010000:3.0:1763334955.801135:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e820e4f3 reply state 000000002a5f2f57 transno 8589938291 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497286 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334955.801146:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334955.801282:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+157:52903:x1848989694201472:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 845us (2176us total) trans 8589938291 rc 0/0 00000100:00100000:3.0:1763334955.801291:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4005 00010000:00010000:3.0:1763334955.804740:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497286 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.804758:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497286 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.805341:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497286 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.805351:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0031600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334955.805358:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497286 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.805369:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497286 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.805394:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x163:0x0].0x0 (ffff9a5ad29c0f00) 00010000:00010000:3.0:1763334955.805399:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334955.805407:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497286 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.805426:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497286 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334955.815598:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694201728 00000100:00100000:3.0:1763334955.815612:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694201728 00000100:00100000:3.0:1763334955.815683:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4006 00000100:00100000:3.0:1763334955.815694:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+156:52907:x1848989694201728:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:3.0:1763334955.815729:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334955.815760:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497294 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae857 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.815859:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849729b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.815880:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849729b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.815896:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849729b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.815914:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84972a2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.815921:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84972a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.815927:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84972a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816087:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f84972a9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x165:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816099:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f84972a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x165:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816106:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f84972a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x165:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334955.816152:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x165:0x0]: returning size 5 00000004:00200000:3.0:1763334955.816157:0:29629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334955.816178:0:29629:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f84972a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x165:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816191:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f84972a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816200:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849729b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816207:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849729b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816214:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849729b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816220:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0030200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334955.816225:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849729b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816233:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849729b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816247:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334955.816251:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334955.816256:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849729b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816263:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849729b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816278:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84972a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816284:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84972a2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816290:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84972a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816295:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0031800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334955.816298:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84972a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816303:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84972a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816309:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32b00) 00010000:00010000:3.0:1763334955.816311:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334955.816313:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84972a2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816318:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84972a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.816350:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497294 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae857 expref: 158 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.816362:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f84972a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x165:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae857 expref: 157 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.816375:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x165:0x0].0x0 (ffff9a5ac51bd200) 00010000:00010000:3.0:1763334955.816377:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334955.816381:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c314b800, rc 0) 00000100:00100000:3.0:1763334955.816465:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+157:52907:x1848989694201728:12345-192.168.201.60@tcp:101:rm.0 Request processed in 772us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.816472:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4006 00000100:00100000:3.0:1763334955.826839:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4007 00010000:00010000:3.0:1763334955.859308:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f84972d3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.859319:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f84972d3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.859326:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f84972d3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.859332:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334955.859335:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f84972d3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.859342:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f84972d3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.859352:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x163:0x0].0x0 (ffff9a5ad29c0f00) 00010000:00010000:3.0:1763334955.859355:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334955.859358:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f84972d3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.862825:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f84972d3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x163:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334955.863963:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694203008 00000100:00100000:3.0:1763334955.863976:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694203008 00010000:00010000:3.0:1763334955.865076:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f8497240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae826 expref: 29 pid: 26216 timeout: 1120 lvb_type: 1 00000100:00100000:3.0:1763334955.865107:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2269 00000100:00100000:3.0:1763334955.865115:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694203008:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334955.865128:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334955.865152:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f8497240 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae826 expref: 28 pid: 26216 timeout: 1120 lvb_type: 1 00010000:00010000:3.0:1763334955.865165:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f8497240 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae826 expref: 28 pid: 26216 timeout: 1120 lvb_type: 1 00010000:00010000:3.0:1763334955.865192:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f8497240 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae826 expref: 28 pid: 26216 timeout: 1120 lvb_type: 1 00010000:00010000:3.0:1763334955.865207:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.865210:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.865218:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84972da lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae86c expref: 27 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.865228:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84972da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae86c expref: 27 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.865266:0:11727:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84972da lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae86c expref: 27 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334955.865287:0:11727:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11727:1848989701751680:192.168.201.60@tcp:105: 00000100:00100000:3.0:1763334955.884638:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.893307:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694204160 00000100:00100000:3.0:1763334955.893312:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694204160 00000100:00100000:3.0:1763334955.893388:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4013 00000100:00100000:3.0:1763334955.893400:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+159:52908:x1848989694204160:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334955.893438:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334955.893443:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334955.893477:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098c00/0xcedf0054f8497312 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae87a expref: 159 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.893500:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334955.893506:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334955.893522:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f8497335 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae888 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.893741:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849733c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.893758:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849733c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.893768:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849733c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.893785:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f8497343 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.893797:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f8497343 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.893803:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f8497343 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.894427:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849734a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x167:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.894438:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849734a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.894446:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849734a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334955.894458:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x167:0x0]: returning size 0 00010000:00010000:3.0:1763334955.894491:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849733c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.894499:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849733c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.894506:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849733c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.894513:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c314b400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334955.894517:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849733c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.894525:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849733c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.894535:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334955.894539:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334955.894542:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849733c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.894548:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849733c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:3.0:1763334955.894560:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d270b36e reply state 000000007c3f1423 transno 8589938294 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f8497343 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334955.894569:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763334955.894632:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f8497335 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae888 expref: 161 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.894648:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849734a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae888 expref: 160 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.894656:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x167:0x0].0x0 (ffff9a5ae1a32c00) 00010000:00010000:3.0:1763334955.894659:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334955.894662:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030e00, rc 0) 00000100:00100000:3.0:1763334955.894753:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+161:52908:x1848989694204160:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1354us (1531us total) trans 8589938294 rc 0/0 00000100:00100000:3.0:1763334955.894763:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4013 00000100:00100000:3.0:1763334955.913348:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334955.913390:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694204544 00000100:00100000:3.0:1763334955.913402:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694204544 00010000:00010000:3.0:1763334955.913464:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849734a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae888 expref: 162 pid: 30972 timeout: 1120 lvb_type: 0 00000100:00100000:3.0:1763334955.913508:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2271 00000100:00100000:3.0:1763334955.913518:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+162:2359:x1848989694204544:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334955.913537:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334955.913544:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849734a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae888 expref: 162 pid: 30972 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334955.913558:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849734a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae888 expref: 162 pid: 30972 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334955.913607:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x167:0x0].0x0 (ffff9a5ae1a32c00) 00010000:00010000:3.0:1763334955.913614:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f849735f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x167:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.913625:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f849735f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x167:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.913634:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f849735f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x167:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.913658:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334955.913727:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+162:2359:x1848989694204544:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 209us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.913736:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2271 00000100:00100000:3.0:1763334955.915822:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701752064 00000100:00100000:3.0:1763334955.915830:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701752064 00000100:00100000:3.0:1763334955.915876:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4251 00000100:00100000:3.0:1763334955.915885:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:29653:x1848989701752064:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1763334955.915937:0:32239:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 514 00000100:00100000:3.0:1763334955.930875:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:29653:x1848989701752064:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14983us (15077us total) trans 17179870836 rc 0/0 00000100:00100000:3.0:1763334955.930890:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4251 00000100:00100000:3.0:1763334955.949945:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4258 00000100:00100000:3.0:1763334955.949956:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701753088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334955.950047:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1eb:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763334955.950049:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1eb:0x0] updating lvb mtime from disk: 1763334956 -> 1763334956 00002000:00010000:3.0:1763334955.950051:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1eb:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334955.950053:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1eb:0x0] updating lvb ctime from disk: 1763334956 -> 1763334956 00002000:00010000:3.0:1763334955.950056:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1eb:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1763334955.950085:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701753088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (2233us total) trans 21474838122 rc 0/0 00000100:00100000:3.0:1763334955.950091:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4258 00000004:00080000:3.0:1763334955.955343:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 1 in flight, 30 done 00000100:00100000:3.0:1763334955.955367:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694205568 00000100:00100000:3.0:1763334955.955371:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694205568 00010000:00010000:3.0:1763334955.955398:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5b02044c00/0xcedf0054f8497278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae842 expref: 14 pid: 26564 timeout: 1120 lvb_type: 0 00000100:00100000:3.0:1763334955.955997:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2272 00000100:00100000:3.0:1763334955.956007:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2362:x1848989694205568:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334955.956022:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334955.956028:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5b02044c00/0xcedf0054f8497278 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae842 expref: 14 pid: 26564 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334955.956042:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5b02044c00/0xcedf0054f8497278 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae842 expref: 14 pid: 26564 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334955.956069:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5b02044c00/0xcedf0054f8497278 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae842 expref: 14 pid: 26564 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334955.956094:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.956097:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.956102:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f8497397 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.956112:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f8497397 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.957005:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334955.957074:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2362:x1848989694205568:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1064us (3208us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.957084:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2272 00000100:00100000:3.0:1763334955.958331:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694205824 00000100:00100000:3.0:1763334955.958344:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694205824 00000100:00100000:3.0:1763334955.958395:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4017 00000100:00100000:3.0:1763334955.958405:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+157:52274:x1848989694205824:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:3.0:1763334955.958681:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334955.958705:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098200/0xcedf0054f8497382 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae896 expref: 157 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.958723:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x167:0x0].0x0 (ffff9a5ad83ce300) 00010000:00010000:3.0:1763334955.958734:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334955.958873:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694205952 00000100:00100000:3.0:1763334955.958877:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694205952 00010000:00010000:3.0:1763334955.958900:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044600/0xcedf0054f849727f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae849 expref: 28 pid: 26564 timeout: 1120 lvb_type: 0 00000100:00100000:3.0:1763334955.959000:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2273 00000100:00100000:3.0:1763334955.959008:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694205952:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334955.959022:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334955.959026:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044600/0xcedf0054f849727f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae849 expref: 28 pid: 26564 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334955.959037:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5b02044600/0xcedf0054f849727f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae849 expref: 28 pid: 26564 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334955.959055:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.959057:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334955.959400:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849739e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.959422:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849739e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.959444:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334955.959497:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694205952:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 489us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.959504:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2273 00010000:00010000:3.0:1763334955.959847:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84973b3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x167:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.959863:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84973b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.959878:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84973b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000001:00080000:3.0:1763334955.959944:0:29629:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938300 00000004:00010000:3.0:1763334955.959975:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d120f2ad reply state 000000001642180b transno 8589938301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84973b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334955.959986:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334955.960072:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+159:52274:x1848989694205824:12345-192.168.201.60@tcp:36:bash.0 Request processed in 1667us (2761us total) trans 8589938301 rc 0/0 00000100:00100000:3.0:1763334955.960080:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4017 00000020:00080000:3.0:1763334955.960085:0:29629:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763334955.966166:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334955.966188:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84973ba lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334955.966202:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334955.966207:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84973ba lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334955.966219:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84973ba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x163:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334955.966243:0:5737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x163:0x0].0x0 (ffff9a5ad29c0f00) 00010000:00010000:3.0:1763334955.966247:0:5737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763334955.966253:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84973ba lrc: 1/0,0 mode: --/PW res: [0x200000404:0x163:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334955.966259:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84973ba lrc: 0/0,0 mode: --/PW res: [0x200000404:0x163:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334955.966275:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334955.966278:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334955.966280:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334955.966464:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84973b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.966473:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84973b3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.966485:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84973b3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.966492:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0031800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334955.966498:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84973b3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.966505:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84973b3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.966515:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x167:0x0].0x0 (ffff9a5ae1a32d00) 00010000:00010000:3.0:1763334955.966518:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334955.966522:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84973b3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.966529:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84973b3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x167:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334955.966787:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4019 00000100:00100000:3.0:1763334955.966796:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+161:52274:x1848989694206336:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334955.966804:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334955.966815:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f84973c8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x167:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae8a4 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.966863:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f84973c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x167:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8a4 expref: 162 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.966876:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f84973c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x167:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8a4 expref: 162 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.966895:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x167:0x0].0x0 (ffff9a5ae1a32100) 00010000:00010000:3.0:1763334955.966898:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334955.966900:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030200, rc 0) 00000100:00100000:3.0:1763334955.966979:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+162:52274:x1848989694206336:12345-192.168.201.60@tcp:101:bash.0 Request processed in 183us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.966987:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4019 00000100:00100000:3.0:1763334955.970349:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694206848 00000100:00100000:3.0:1763334955.970363:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694206848 00000100:00100000:3.0:1763334955.970441:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4020 00000100:00100000:3.0:1763334955.970455:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52274:x1848989694206848:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334955.970479:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334955.970482:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334955.970512:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f84973c8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x167:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8a4 expref: 163 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.970529:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x167:0x0].0x0 (ffff9a5ae1a32100) 00010000:00010000:3.0:1763334955.970532:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334955.970547:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f84973eb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x167:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae8b2 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334955.970618:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84973f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x167:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.970631:0:29629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099800/0xcedf0054f84973dd lrc: 2/1,0 mode: PR/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334955.970639:0:29629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84973f2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x167:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.971344:0:29629:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099800/0xcedf0054f84973dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ab expref: 162 pid: 30972 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334955.971354:0:29629:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099800/0xcedf0054f84973dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ab expref: 162 pid: 30972 timeout: 1120 lvb_type: 0 00000100:00100000:3.0:1763334955.971429:0:29629:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701753472:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334955.971507:0:29629:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98e40 going to sleep for 11 seconds 00000100:00100000:3.0:1763334955.981320:0:29629:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701753472:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334955.981361:0:29629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84973f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x167:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334955.981492:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694207104 00000100:00100000:3.0:1763334955.981497:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694207104 00010000:00010000:3.0:1763334955.981526:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099800/0xcedf0054f84973dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ab expref: 164 pid: 30972 timeout: 1120 lvb_type: 0 00000100:00100000:3.0:1763334955.982007:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2274 00000100:00100000:3.0:1763334955.982016:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+164:2362:x1848989694207104:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334955.982037:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334955.982045:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099800/0xcedf0054f84973dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ab expref: 164 pid: 30972 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334955.982060:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099800/0xcedf0054f84973dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ab expref: 164 pid: 30972 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334955.982091:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099800/0xcedf0054f84973dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x167:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ab expref: 164 pid: 30972 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334955.982108:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x167:0x0].0x0 (ffff9a5ae1a32100) 00010000:00010000:3.0:1763334955.982114:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84973f2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x167:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.982126:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84973f2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x167:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.982136:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84973f2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x167:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334955.982175:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334955.982255:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+163:2362:x1848989694207104:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 240us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334955.982264:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2274 00000100:00100000:3.0:1763334956.036750:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701753600:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.036843:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.036893:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334956.036900:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701753984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.037568:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.037628:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701754112:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.037655:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.037686:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701753728:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.037712:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.037732:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701754240:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.037753:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.037771:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763334956.037776:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701753856:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.037794:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.037808:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701754368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.037824:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.037856:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701753984 00000100:00100000:3.0:1763334956.037860:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701753984 00000100:00100000:3.0:1763334956.037915:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701754112 00000100:00100000:3.0:1763334956.037917:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701754112 00000100:00100000:3.0:1763334956.037935:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701753728 00000100:00100000:3.0:1763334956.037937:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701753728 00000100:00100000:3.0:1763334956.037951:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701754240 00000100:00100000:3.0:1763334956.037953:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701754240 00000100:00100000:3.0:1763334956.037960:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701753856 00000100:00100000:3.0:1763334956.037962:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701753856 00000100:00100000:3.0:1763334956.037970:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701754368 00000100:00100000:3.0:1763334956.037972:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701754368 00000100:00100000:3.0:1763334956.037985:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4260 00000100:00100000:3.0:1763334956.037993:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701753984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.039725:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3292:x1848989701753984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1728us (2153us total) trans 21474838125 rc 0/0 00000100:00100000:3.0:1763334956.039737:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4260 00000100:00100000:3.0:1763334956.039924:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701754496 00000100:00100000:3.0:1763334956.039933:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701754496 00000100:00100000:3.0:1763334956.039971:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4262 00000100:00100000:3.0:1763334956.039980:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701753728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334956.040009:0:6518:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:491 count 1 00010000:00010000:3.0:1763334956.040038:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849740e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.040061:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849728d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae850 expref: 12 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.040068:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334956.040070:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334956.040074:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849740e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.040110:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849728d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae850 expref: 12 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.040122:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849728d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae850 expref: 12 pid: 26564 timeout: 1120 lvb_type: 0 00000100:00100000:3.0:1763334956.040137:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6518:1848989701754752:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334956.041957:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334956.042008:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4263 00000100:00100000:3.0:1763334956.042027:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3289:x1848989701754240:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334956.042063:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:495 count 1 00010000:00010000:3.0:1763334956.042095:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031800/0xcedf0054f8497415 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.042118:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84972b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae85e expref: 26 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.042126:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334956.042130:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334956.042134:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031800/0xcedf0054f8497415 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.042176:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84972b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae85e expref: 26 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.042189:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84972b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae85e expref: 26 pid: 26564 timeout: 1120 lvb_type: 0 00000100:00100000:3.0:1763334956.042206:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701754880:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334956.042275:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98000 going to sleep for 11 seconds 00000100:00100000:3.0:1763334956.042296:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4264 00000100:00100000:3.0:1763334956.042305:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701753856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.046087:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701753856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3778us (8286us total) trans 21474838126 rc 0/0 00000100:00100000:3.0:1763334956.046102:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4264 00000100:00100000:3.0:1763334956.046137:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4267 00000100:00100000:3.0:1763334956.046147:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3291:x1848989701754496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.046312:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+31:3291:x1848989701754496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (7742us total) trans 17179870843 rc 0/0 00000100:00100000:3.0:1763334956.055425:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4267 00000004:00080000:3.0:1763334956.055611:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c4a80/2, rc 0, transno 21474838126 00000100:00100000:3.0:1763334956.055623:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701753856:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334956.055646:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a23100/2, rc 0, transno 17179870842 00000100:00100000:3.0:1763334956.055652:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701754368:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.055767:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694207616 00000100:00100000:3.0:1763334956.055777:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694207616 00010000:00010000:3.0:1763334956.055844:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849728d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae850 expref: 13 pid: 26564 timeout: 1120 lvb_type: 0 00000100:00100000:3.0:1763334956.055877:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694207744 00000100:00100000:3.0:1763334956.055881:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694207744 00010000:00010000:3.0:1763334956.055901:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84972b0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae85e expref: 29 pid: 26564 timeout: 1120 lvb_type: 0 00000100:00100000:3.0:1763334956.055928:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2276 00000100:00100000:3.0:1763334956.055942:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694207616:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334956.055965:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334956.055975:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849728d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae850 expref: 14 pid: 26564 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334956.055999:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849728d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae850 expref: 14 pid: 26564 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334956.056045:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.056050:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.056058:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849740e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.056085:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849740e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.056126:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334956.056474:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694207616:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 534us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.056484:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2276 00000100:00100000:3.0:1763334956.056509:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694208000 00000100:00100000:3.0:1763334956.056516:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694208000 00000100:00100000:3.0:1763334956.056547:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4270 00000100:00100000:3.0:1763334956.056558:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+14:52274:x1848989694208000:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334956.056601:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334956.056624:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497431 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae8ce expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334956.056656:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ee:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334956.056674:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.056676:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.056683:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ce expref: 15 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.056696:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ce expref: 15 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.056709:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0031600, rc 0) 00000100:00100000:3.0:1763334956.056737:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+15:52274:x1848989694208000:12345-192.168.201.60@tcp:101:bash.0 Request processed in 182us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.056744:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4270 00000004:00080000:3.0:1763334956.057374:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a23800/2, rc 0, transno 17179870844 00000100:00100000:3.0:1763334956.057382:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701754240:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763334956.059230:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763334956.059240:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849740e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.059250:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0030200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334956.059254:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849740e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.059264:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849740e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.059283:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849740e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.059291:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849740e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.059310:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334956.059314:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098000/0xcedf0054f849741c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.059320:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ad8098000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334956.059323:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098000/0xcedf0054f849741c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.059331:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098000/0xcedf0054f849741c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.059339:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098000/0xcedf0054f849741c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.059348:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334956.059350:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334956.059351:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334956.061375:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334956.064309:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694208256 00000100:00100000:3.0:1763334956.064331:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694208256 00002000:00010000:3.0:1763334956.064398:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/494 (0->18446744073709551615) 00002000:00100000:3.0:1763334956.064405:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec59180 with x1848989694208256 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334956.064434:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeec59180. 00000100:00100000:3.0:1763334956.064477:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694208128 00000100:00100000:3.0:1763334956.064481:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694208128 00002000:00010000:3.0:1763334956.064497:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/498 (0->18446744073709551615) 00002000:00100000:3.0:1763334956.064501:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec59500 with x1848989694208128 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334956.064509:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeec59500. 00000100:00100000:3.0:1763334956.064538:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1632 00000100:00100000:3.0:1763334956.064550:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694208256:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334956.064992:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1ee:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334956.064997:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1ee:0x0] updating lvb mtime from disk: 0 -> 1763334956 00002000:00010000:3.0:1763334956.065000:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1ee:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334956.065002:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1ee:0x0] updating lvb ctime from disk: 0 -> 1763334956 00002000:00010000:3.0:1763334956.065004:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1ee:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334956.065083:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694208256:12345-192.168.201.60@tcp:10:bash.0 Request processed in 534us (3017us total) trans 21474838129 rc 0/0 00000100:00100000:3.0:1763334956.065092:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1632 00002000:00010000:3.0:1763334956.065097:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/494 (0->18446744073709551615) 00002000:00100000:3.0:1763334956.065100:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec59180 with x1848989694208256 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334956.065105:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeec59180. 00000100:00100000:3.0:1763334956.065126:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1633 00000100:00100000:3.0:1763334956.065134:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694208128:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334956.065309:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334956.065312:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb mtime from disk: 1763334956 -> 1763334956 00002000:00010000:3.0:1763334956.065315:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb atime from disk: 1763334956 -> 0 00002000:00010000:3.0:1763334956.065317:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb ctime from disk: 1763334956 -> 1763334956 00002000:00010000:3.0:1763334956.065319:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1f2:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334956.065343:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694208128:12345-192.168.201.60@tcp:10:bash.0 Request processed in 209us (3229us total) trans 17179870845 rc 0/0 00000100:00100000:3.0:1763334956.065350:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1633 00002000:00010000:3.0:1763334956.065353:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/498 (0->18446744073709551615) 00002000:00100000:3.0:1763334956.065356:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec59500 with x1848989694208128 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334956.065360:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeec59500. 00000100:00100000:3.0:1763334956.085255:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694209152 00000100:00100000:3.0:1763334956.085270:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694209152 00000100:00100000:3.0:1763334956.085346:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1481 00000100:00100000:3.0:1763334956.085358:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+158:52903:x1848989694209152:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:3.0:1763334956.085636:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+158:52903:x1848989694209152:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 279us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.085649:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1481 00000100:00100000:3.0:1763334956.119081:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.120452:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334956.176296:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84974f5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334956.176320:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84974f5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334956.176330:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84974f5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334956.176337:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334956.176342:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84974f5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334956.176352:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84974f5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334956.176375:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd700) 00010000:00010000:3.0:1763334956.176379:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334956.176384:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84974f5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334956.176391:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84974f5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334956.181889:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4032 00000100:00100000:3.0:1763334956.181906:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52911:x1848989694211584:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334956.181929:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334956.181963:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849750a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae914 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.182114:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497518 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x169:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.182145:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497518 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.182160:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497518 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334956.182173:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x169:0x0]: returning size 0 00010000:00010000:3.0:1763334956.182472:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849750a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae914 expref: 167 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.182503:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497518 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae914 expref: 166 pid: 29627 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334956.182514:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497518 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae914 expref: 166 pid: 29627 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334956.182539:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x169:0x0].0x0 (ffff9a5ac51bd000) 00010000:00010000:3.0:1763334956.182544:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334956.182547:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f849751f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334956.182559:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030200, rc 0) 00000100:00100000:3.0:1763334956.182668:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52911:x1848989694211584:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 767us (1048us total) trans 8589938313 rc 0/0 00000100:00100000:3.0:1763334956.182679:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4032 00000100:00100000:3.0:1763334956.192700:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2279 00000100:00100000:3.0:1763334956.192724:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+166:2359:x1848989694211712:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334956.192751:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334956.192763:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84974fc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae906 expref: 166 pid: 29629 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334956.192785:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84974fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae906 expref: 166 pid: 29629 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334956.192818:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84974fc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae906 expref: 166 pid: 29629 timeout: 1120 lvb_type: 0 00010000:00010000:3.0:1763334956.192842:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x169:0x0].0x0 (ffff9a5ac51bd000) 00010000:00010000:3.0:1763334956.192850:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f849751f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334956.192863:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334956.192959:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+165:2359:x1848989694211712:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 246us (1387us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.192969:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2279 00000100:00100000:3.0:1763334956.209702:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.209765:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.230243:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.233334:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.252924:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.258600:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.271105:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694214400 00000100:00100000:3.0:1763334956.271121:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694214400 00000100:00100000:3.0:1763334956.271197:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4037 00000100:00100000:3.0:1763334956.271209:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52274:x1848989694214400:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334956.271235:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334956.271258:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f84975a4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x169:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae93e expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.271343:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f84975a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae93e expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.271359:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f84975a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x169:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae93e expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.271381:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x169:0x0].0x0 (ffff9a5ac29da400) 00010000:00010000:3.0:1763334956.271384:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334956.271386:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030200, rc 0) 00000100:00100000:3.0:1763334956.271494:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52274:x1848989694214400:12345-192.168.201.60@tcp:101:bash.0 Request processed in 286us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.271503:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4037 00000100:00100000:3.0:1763334956.291627:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694215040 00000100:00100000:3.0:1763334956.291641:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694215040 00000100:00100000:3.0:1763334956.291712:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1489 00000100:00100000:3.0:1763334956.291724:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52911:x1848989694215040:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:3.0:1763334956.291923:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52911:x1848989694215040:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 200us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.291932:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1489 00000100:00100000:3.0:1763334956.338261:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.377330:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701756800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.377385:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.377431:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763334956.377437:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701756672:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.377458:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.377493:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701756800 00000100:00100000:3.0:1763334956.377502:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701756800 00000100:00100000:3.0:1763334956.377548:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701756672 00000100:00100000:3.0:1763334956.377551:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701756672 00000100:00100000:3.0:1763334956.377602:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4277 00000100:00100000:3.0:1763334956.377612:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3290:x1848989701756800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.377842:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3290:x1848989701756800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 231us (457us total) trans 21474838130 rc 0/0 00000100:00100000:3.0:1763334956.377850:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4277 00000100:00100000:3.0:1763334956.377871:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4278 00000100:00100000:3.0:1763334956.377878:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3290:x1848989701756672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334956.377892:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:495 count 1 00002000:00010000:3.0:1763334956.377924:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1ef:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334956.377932:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f84975f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.377945:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.377948:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.377953:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f84975f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.377970:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f84975f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.377980:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f84975f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.377989:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f84975f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.378009:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334956.378223:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3290:x1848989701756672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 344us (762us total) trans 21474838131 rc 0/0 00000100:00100000:3.0:1763334956.378230:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4278 00010000:00010000:3.0:1763334956.378306:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334956.378313:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f84975f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.378322:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0031000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334956.378326:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f84975f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.378336:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f84975f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.378351:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f84975f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.378358:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f84975f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.378373:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334956.378375:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334956.378377:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334956.378391:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701756928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.378440:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.378466:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763334956.378473:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701756544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.378497:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.378518:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701756928 00000100:00100000:3.0:1763334956.378524:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701756928 00000100:00100000:3.0:1763334956.378545:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701756544 00000100:00100000:3.0:1763334956.378548:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701756544 00000100:00100000:3.0:1763334956.378564:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4279 00000100:00100000:3.0:1763334956.378605:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701756928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334956.378721:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1f1:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334956.378725:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1f1:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763334956.378728:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1f1:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334956.378730:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1f1:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763334956.378733:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1f1:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334956.378763:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701756928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 193us (323us total) trans 21474838132 rc 0/0 00000100:00100000:3.0:1763334956.378770:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4279 00000100:00100000:3.0:1763334956.378782:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4280 00000100:00100000:3.0:1763334956.378789:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701756544:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334956.378800:0:6517:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:494 count 1 00010000:00010000:3.0:1763334956.378812:0:6517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84975ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.378829:0:6517:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ce expref: 13 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.378837:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334956.378839:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334956.378842:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84975ff lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.378872:0:6517:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ce expref: 13 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.378888:0:6517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ce expref: 13 pid: 32241 timeout: 1121 lvb_type: 0 00000100:00100000:3.0:1763334956.378902:0:6517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5577b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6517:1848989701757056:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334956.378978:0:6517:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b983c0 going to sleep for 11 seconds 00000004:00080000:3.0:1763334956.379079:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44df80/2, rc 0, transno 21474838132 00000100:00100000:3.0:1763334956.379086:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701756928:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334956.379108:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44f800/2, rc 0, transno 21474838131 00000100:00100000:3.0:1763334956.379113:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701756672:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763334956.379123:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44c380/2, rc 0, transno 21474838130 00000100:00100000:3.0:1763334956.379127:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701756800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.390068:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.390102:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.390122:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.390148:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.390186:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694215808 00000100:00100000:3.0:1763334956.390198:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694215808 00010000:00010000:3.0:1763334956.390252:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497423 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8c0 expref: 28 pid: 6517 timeout: 1121 lvb_type: 0 00000100:00100000:3.0:1763334956.390294:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694215936 00000100:00100000:3.0:1763334956.390298:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694215936 00010000:00010000:3.0:1763334956.390313:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497431 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ce expref: 14 pid: 32241 timeout: 1121 lvb_type: 0 00000100:00100000:3.0:1763334956.390336:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2284 00000100:00100000:3.0:1763334956.390347:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2361:x1848989694215808:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334956.390369:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334956.390376:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497423 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8c0 expref: 28 pid: 6517 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.390393:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497423 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8c0 expref: 28 pid: 6517 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.390442:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.390444:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.390451:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099400/0xcedf0054f84975ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.390463:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099400/0xcedf0054f84975ea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.390488:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334956.390557:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2361:x1848989694215808:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 210us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.390566:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2284 00000100:00100000:3.0:1763334956.390619:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2285 00000100:00100000:3.0:1763334956.390625:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694215936:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334956.390637:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334956.390642:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497431 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ce expref: 14 pid: 32241 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.390653:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497431 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae8ce expref: 14 pid: 32241 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.390667:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.390669:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.390673:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84975ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.390680:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031800/0xcedf0054f84975ff lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.390691:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334956.390709:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694215936:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 84us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.390716:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2285 00000100:00100000:3.0:1763334956.390752:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694216064 00000100:00100000:3.0:1763334956.390756:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694216064 00000100:00100000:3.0:1763334956.390777:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694216192 00000100:00100000:3.0:1763334956.390780:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694216192 00000100:00100000:3.0:1763334956.390796:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4281 00000100:00100000:3.0:1763334956.390802:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+15:52274:x1848989694216064:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334956.390819:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334956.390844:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497606 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae95a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334956.390882:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1f0:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334956.390901:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.390903:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.390910:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497606 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae95a expref: 16 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.390925:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497606 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae95a expref: 16 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.390940:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030e00, rc 0) 00000100:00100000:3.0:1763334956.390965:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+16:52274:x1848989694216064:12345-192.168.201.60@tcp:101:bash.0 Request processed in 162us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.390972:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4281 00000100:00100000:3.0:1763334956.390986:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4282 00000100:00100000:3.0:1763334956.390992:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694216192:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334956.390999:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334956.391007:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030200/0xcedf0054f849760d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae961 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334956.391063:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701757184:192.168.201.60@tcp:106: 00000100:00100000:3.0:1763334956.391138:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98f00 going to sleep for 11 seconds 00010000:00010000:3.0:1763334956.393241:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334956.393290:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44e300/2, rc 0, transno 21474838133 00000100:00100000:3.0:1763334956.393297:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701756544:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.395655:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.409792:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694217216 00000100:00100000:3.0:1763334956.409807:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694217216 00000100:00100000:3.0:1763334956.427055:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694217600 00000100:00100000:3.0:1763334956.427069:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694217600 00010000:00010000:3.0:1763334956.427130:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8497630 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae96f expref: 162 pid: 29627 timeout: 1121 lvb_type: 0 00000100:00100000:3.0:1763334956.427180:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694217728 00000100:00100000:3.0:1763334956.427183:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694217728 00010000:00010000:3.0:1763334956.427199:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84975e3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae953 expref: 163 pid: 29627 timeout: 1121 lvb_type: 0 00000100:00100000:3.0:1763334956.427228:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2286 00000100:00100000:3.0:1763334956.427240:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+163:2362:x1848989694217600:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334956.427276:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334956.427286:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8497630 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae96f expref: 163 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.427303:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8497630 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae96f expref: 163 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.427339:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8497630 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae96f expref: 163 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.427363:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x169:0x0].0x0 (ffff9a5ac29da400) 00010000:00010000:3.0:1763334956.427370:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849763e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x169:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.427382:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849763e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x169:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.427396:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334956.427485:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+162:2362:x1848989694217600:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 246us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.427494:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2286 00000100:00100000:3.0:1763334956.427518:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2287 00000100:00100000:3.0:1763334956.427526:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+161:2360:x1848989694217728:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334956.427534:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334956.427538:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84975e3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae953 expref: 161 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.427547:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84975e3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae953 expref: 161 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.427559:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x169:0x0].0x0 (ffff9a5ac29da400) 00010000:00010000:3.0:1763334956.427563:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849763e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x169:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.427608:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849763e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x169:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.427616:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849763e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x169:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.427640:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334956.427662:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+161:2360:x1848989694217728:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 138us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.427669:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2287 00000100:00100000:3.0:1763334956.438656:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.443386:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334956.445032:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497653 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.445041:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497653 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334956.445063:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x169:0x0]: returning size 5 00000004:00200000:3.0:1763334956.445067:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334956.445081:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497653 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.445095:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497653 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.445120:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f849764c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae97d expref: 162 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.445135:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497653 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x169:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae97d expref: 161 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.445142:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x169:0x0].0x0 (ffff9a5ac29da400) 00010000:00010000:3.0:1763334956.445145:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334956.445148:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8800, rc 0) 00000100:00100000:3.0:1763334956.445190:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+161:52913:x1848989694217856:12345-192.168.201.60@tcp:101:rm.0 Request processed in 6241us (11039us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.445197:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4043 00000100:00100000:3.0:1763334956.447830:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694218368 00000100:00100000:3.0:1763334956.447844:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694218368 00000100:00100000:3.0:1763334956.447912:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4045 00000100:00100000:3.0:1763334956.447923:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+161:52912:x1848989694218368:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334956.447952:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334956.447979:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f8497668 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x169:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833ae98b expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.448104:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849766f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x169:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.448121:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849766f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x169:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.448134:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849766f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x169:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334956.448150:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x169:0x0]: returning size 5 00010000:00010000:3.0:1763334956.448309:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f8497668 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x169:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae98b expref: 164 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.448329:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849766f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x169:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae98b expref: 163 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.448339:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x169:0x0].0x0 (ffff9a5ac29da400) 00010000:00010000:3.0:1763334956.448342:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763334956.448346:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c314b600, rc 0) 00000100:00100000:3.0:1763334956.448418:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52912:x1848989694218368:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 496us (755us total) trans 8589938331 rc 0/0 00000100:00100000:3.0:1763334956.448425:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4045 00000100:00100000:3.0:1763334956.455831:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.479841:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334956.486762:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849767d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.486781:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849767d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.486827:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849767d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.486836:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849767d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.486844:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849767d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.486852:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334956.486856:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849767d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.486865:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849767d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.486882:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849767d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.486889:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849767d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334956.486956:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694218624:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 30844us (31130us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.486965:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4284 00000100:00100000:3.0:1763334956.487501:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.492381:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334956.502784:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334956.502793:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f84976ed lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x169:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334956.502801:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ad8098800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334956.502805:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f84976ed lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x169:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334956.502814:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f84976ed lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x169:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334956.502828:0:8205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x169:0x0].0x0 (ffff9a5ad83ced00) 00010000:00010000:3.0:1763334956.502831:0:8205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763334956.502836:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f84976ed lrc: 1/0,0 mode: --/PW res: [0x200000404:0x169:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334956.502842:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f84976ed lrc: 0/0,0 mode: --/PW res: [0x200000404:0x169:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334956.502859:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334956.502862:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334956.502863:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334956.521904:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694220800 00000100:00100000:3.0:1763334956.521921:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694220800 00000100:00100000:3.0:1763334956.537961:0:29651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee93ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:29651:1848989701757952:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1763334956.538029:0:29651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.538070:0:29651:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98c00 going to sleep for 11 seconds 00000100:00100000:3.0:1763334956.544170:0:29651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee93ce00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:29651:1848989701757952:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1763334956.544193:0:29651:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1f3:0x0]-[0x240000400:0x221:0x0] 00000100:00100000:3.0:1763334956.560359:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.571612:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.579049:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694222592 00000100:00100000:3.0:1763334956.579064:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694222592 00000100:00100000:3.0:1763334956.590967:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694223104 00000100:00100000:3.0:1763334956.590984:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694223104 00010000:00010000:3.0:1763334956.591042:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8497779 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x16a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae9d8 expref: 172 pid: 29627 timeout: 1121 lvb_type: 0 00000100:00100000:3.0:1763334956.591098:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2291 00000100:00100000:3.0:1763334956.591109:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:2359:x1848989694223104:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334956.591130:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334956.591139:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8497779 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x16a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae9d8 expref: 172 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.591156:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8497779 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x16a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae9d8 expref: 172 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.591185:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8497779 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x16a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae9d8 expref: 172 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.591205:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16a:0x0].0x0 (ffff9a5acb935800) 00010000:00010000:3.0:1763334956.591212:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8497787 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x16a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.591223:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8497787 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.591237:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8497787 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x16a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.591275:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334956.591343:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+171:2359:x1848989694223104:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 234us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.591352:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2291 00000001:00080000:3.0:1763334956.644197:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938341 is committed 00000001:00080000:3.0:1763334956.644248:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938342 is committed 00000004:00080000:3.0:1763334956.644253:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 617 committed 00000004:00080000:3.0:1763334956.644266:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 605 committed 00000004:00080000:3.0:1763334956.644275:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 604 committed 00000004:00080000:3.0:1763334956.644278:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 616 committed 00000100:00100000:3.0:1763334956.644488:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701758592:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.644609:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.644647:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701759104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.644670:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.644696:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1763334956.644701:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701758208:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.644720:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.644734:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701758720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.644753:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.644784:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701758336:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.644809:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.644828:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701758848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.644850:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.644868:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763334956.644874:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701758464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.644892:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.644906:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701758976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.644924:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.644961:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701758592 00000100:00100000:3.0:1763334956.644970:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701758592 00000100:00100000:3.0:1763334956.645022:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701759104 00000100:00100000:3.0:1763334956.645025:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701759104 00000100:00100000:3.0:1763334956.645042:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701758208 00000100:00100000:3.0:1763334956.645044:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701758208 00000100:00100000:3.0:1763334956.645054:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701758720 00000100:00100000:3.0:1763334956.645057:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701758720 00000100:00100000:3.0:1763334956.645065:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701758336 00000100:00100000:3.0:1763334956.645068:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701758336 00000100:00100000:3.0:1763334956.645077:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701758848 00000100:00100000:3.0:1763334956.645079:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701758848 00000100:00100000:3.0:1763334956.645088:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701758464 00000100:00100000:3.0:1763334956.645091:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701758464 00000100:00100000:3.0:1763334956.645102:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701758976 00000100:00100000:3.0:1763334956.645104:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701758976 00000100:00100000:3.0:1763334956.645160:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4287 00000100:00100000:3.0:1763334956.645170:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3291:x1848989701758592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.645511:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3291:x1848989701758592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 341us (901us total) trans 17179870851 rc 0/0 00000100:00100000:3.0:1763334956.645521:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4287 00000100:00100000:3.0:1763334956.645542:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4288 00000100:00100000:3.0:1763334956.645549:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3291:x1848989701759104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.645724:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3291:x1848989701759104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 175us (1052us total) trans 21474838137 rc 0/0 00000100:00100000:3.0:1763334956.645734:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4288 00000100:00100000:3.0:1763334956.645748:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4289 00000100:00100000:3.0:1763334956.645755:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3291:x1848989701758208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334956.645771:0:6517:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:500 count 1 00010000:00010000:3.0:1763334956.645794:0:6517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b800/0xcedf0054f84977aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.645823:0:6517:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497614 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae968 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.645832:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334956.645834:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334956.645839:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b800/0xcedf0054f84977aa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.645876:0:6517:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497614 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae968 expref: 29 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.645894:0:6517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae968 expref: 29 pid: 6517 timeout: 1121 lvb_type: 0 00000100:00100000:3.0:1763334956.645909:0:6517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6517:1848989701759232:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334956.645991:0:6517:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac57b5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1763334956.646018:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4290 00000100:00100000:3.0:1763334956.646027:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3291:x1848989701758720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334956.646041:0:32239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:496 count 1 00002000:00010000:3.0:1763334956.646072:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1f0:0x0] initial LVB size: 5, mtime: 0x691a5b2d, atime: 0x691a5b2c, ctime: 0x691a5b2d, blocks: 0x1 00010000:00010000:3.0:1763334956.646079:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b400/0xcedf0054f84977b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.646088:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.646090:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.646096:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b400/0xcedf0054f84977b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.646110:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b400/0xcedf0054f84977b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.646120:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b400/0xcedf0054f84977b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.646129:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b400/0xcedf0054f84977b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.646150:0:32239:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334956.646371:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3291:x1848989701758720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 344us (1615us total) trans 21474838138 rc 0/0 00000100:00100000:3.0:1763334956.646379:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4290 00000100:00100000:3.0:1763334956.646395:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4291 00000100:00100000:3.0:1763334956.646415:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb225050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3289:x1848989701758336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334956.646428:0:32239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:501 count 1 00010000:00010000:3.0:1763334956.646440:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b600/0xcedf0054f84977b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.646453:0:32239:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8497565 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae922 expref: 29 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334956.646461:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.646462:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.646465:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b600/0xcedf0054f84977b8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.646486:0:32239:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8497565 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae922 expref: 29 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334956.646497:0:32239:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8497565 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae922 expref: 29 pid: 6519 timeout: 1121 lvb_type: 1 00000100:00100000:3.0:1763334956.646507:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:32239:1848989701759360:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334956.646537:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac57b5780 going to sleep for 11 seconds 00000100:00100000:3.0:1763334956.646560:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4292 00000100:00100000:3.0:1763334956.646616:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3289:x1848989701758848:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334956.646631:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:497 count 1 00010000:00010000:3.0:1763334956.646645:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84977bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.646658:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849756c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae929 expref: 15 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334956.646665:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.646666:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.646669:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84977bf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.646697:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849756c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae929 expref: 15 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334956.646707:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849756c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae929 expref: 15 pid: 6519 timeout: 1121 lvb_type: 1 00000100:00100000:3.0:1763334956.646718:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701759488:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334956.646751:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac9456480 going to sleep for 11 seconds 00000100:00100000:3.0:1763334956.646769:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4293 00000100:00100000:3.0:1763334956.646777:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3289:x1848989701758464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334956.646926:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x1f6:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334956.646930:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x1f6:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763334956.646932:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x1f6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334956.646934:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x1f6:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763334956.646936:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x1f6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334956.646979:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3289:x1848989701758464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (2085us total) trans 17179870852 rc 0/0 00000100:00100000:3.0:1763334956.646985:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4293 00000100:00100000:3.0:1763334956.647000:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4294 00000100:00100000:3.0:1763334956.647007:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3289:x1848989701758976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.647121:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3289:x1848989701758976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 114us (2195us total) trans 21474838139 rc 0/0 00000100:00100000:3.0:1763334956.647127:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4294 00010000:00010000:3.0:1763334956.647185:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334956.647194:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b400/0xcedf0054f84977b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.647203:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c314b400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334956.647207:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b400/0xcedf0054f84977b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.647218:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b400/0xcedf0054f84977b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.647238:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b400/0xcedf0054f84977b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.647247:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b400/0xcedf0054f84977b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.647265:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334956.647267:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334956.647269:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334956.647326:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841a680/2, rc 0, transno 17179870852 00000100:00100000:3.0:1763334956.647333:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701758464:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334956.647349:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841a300/2, rc 0, transno 21474838139 00000100:00100000:3.0:1763334956.647354:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701758976:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334956.647381:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841b100/2, rc 0, transno 21474838138 00000100:00100000:3.0:1763334956.647386:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701758720:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763334956.647407:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac8419180/2, rc 0, transno 17179870851 00000100:00100000:3.0:1763334956.647411:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701758592:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334956.647423:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac8418380/2, rc 0, transno 21474838137 00000100:00100000:3.0:1763334956.647426:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701759104:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334956.647483:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 615 committed 00000004:00080000:3.0:1763334956.647494:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 603 committed 00000100:00100000:3.0:1763334956.664636:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701759488:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334956.664668:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84977bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334956.664706:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:32239:1848989701759360:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334956.664718:0:32239:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b600/0xcedf0054f84977b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334956.664736:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694223360 00000100:00100000:3.0:1763334956.664740:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694223360 00010000:00010000:3.0:1763334956.664764:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae968 expref: 31 pid: 6517 timeout: 1121 lvb_type: 0 00000100:00100000:3.0:1763334956.664794:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694223616 00000100:00100000:3.0:1763334956.664797:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694223616 00010000:00010000:3.0:1763334956.664813:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849756c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae929 expref: 16 pid: 6519 timeout: 1121 lvb_type: 1 00000100:00100000:3.0:1763334956.664837:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2292 00000100:00100000:3.0:1763334956.664848:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694223360:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334956.664867:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334956.664874:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497614 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae968 expref: 31 pid: 6517 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.664887:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497614 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae968 expref: 31 pid: 6517 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.664918:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497614 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae968 expref: 31 pid: 6517 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.664936:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.664939:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.664944:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b800/0xcedf0054f84977aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.664955:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b800/0xcedf0054f84977aa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.664990:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334956.665061:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694223360:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 211us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.665071:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2292 00000100:00100000:3.0:1763334956.665093:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2293 00000100:00100000:3.0:1763334956.665100:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694223616:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334956.665111:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334956.665116:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849756c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae929 expref: 16 pid: 6519 timeout: 1121 lvb_type: 1 00010000:00010000:3.0:1763334956.665126:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849756c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae929 expref: 16 pid: 6519 timeout: 1121 lvb_type: 1 00010000:00010000:3.0:1763334956.665148:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849756c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae929 expref: 16 pid: 6519 timeout: 1121 lvb_type: 1 00010000:00010000:3.0:1763334956.665158:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.665160:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.665163:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84977bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.665171:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84977bf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.665187:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334956.665206:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694223616:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 107us (1038us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.665213:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2293 00010000:00010000:3.0:1763334956.665238:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84977bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.665246:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84977bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.665254:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84977bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.665261:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f84977bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.665280:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763334956.665809:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3289:x1848989701758848:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19238us (20954us total) trans 21474838140 rc 0/0 00000100:00100000:3.0:1763334956.665820:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4292 00010000:00010000:3.0:1763334956.665844:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763334956.665852:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b800/0xcedf0054f84977aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.665861:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c314b800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334956.665866:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b800/0xcedf0054f84977aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.665876:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b800/0xcedf0054f84977aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.665891:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b800/0xcedf0054f84977aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.665902:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b800/0xcedf0054f84977aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.665921:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334956.665924:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334956.665928:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334956.665966:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841b800/2, rc 0, transno 21474838140 00000100:00100000:3.0:1763334956.665977:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701758848:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.685997:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694224256 00000100:00100000:3.0:1763334956.686014:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694224256 00000100:00100000:3.0:1763334956.686087:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1496 00000100:00100000:3.0:1763334956.686098:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+157:52915:x1848989694224256:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:3.0:1763334956.686283:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+157:52915:x1848989694224256:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 187us (2513us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.686292:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1496 00000100:00100000:3.0:1763334956.705940:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694224768 00000100:00100000:3.0:1763334956.705962:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694224768 00000100:00100000:3.0:1763334956.706045:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1497 00000100:00100000:3.0:1763334956.706056:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+157:52274:x1848989694224768:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:3.0:1763334956.706666:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+158:52274:x1848989694224768:12345-192.168.201.60@tcp:35:bash.0 Request processed in 605us (3197us total) trans 8589938344 rc 0/0 00000100:00100000:3.0:1763334956.706678:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1497 00000100:00100000:3.0:1763334956.720754:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694225280 00000100:00100000:3.0:1763334956.720768:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694225280 00000100:00100000:3.0:1763334956.739675:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694226048 00000100:00100000:3.0:1763334956.739690:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694226048 00010000:00010000:3.0:1763334956.739743:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497805 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x16a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea09 expref: 159 pid: 29627 timeout: 1121 lvb_type: 0 00000100:00100000:3.0:1763334956.739792:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2297 00000100:00100000:3.0:1763334956.739803:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+159:2359:x1848989694226048:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334956.739823:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334956.739830:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497805 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x16a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea09 expref: 159 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.739851:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497805 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x16a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea09 expref: 159 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.739881:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497805 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x16a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea09 expref: 159 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334956.739902:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16a:0x0].0x0 (ffff9a5acb935800) 00010000:00010000:3.0:1763334956.739908:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849781a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334956.739919:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849781a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334956.739926:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849781a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x16a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334956.740711:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334956.759415:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694226688 00000100:00100000:3.0:1763334956.759430:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694226688 00000100:00100000:3.0:1763334956.759505:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4297 00000100:00100000:3.0:1763334956.759517:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694226688:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:3.0:1763334956.759593:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031800/0xcedf0054f8497852 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.759616:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8800/0xcedf0054f84977c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae9ed expref: 29 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.759625:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334956.759627:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334956.759632:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031800/0xcedf0054f8497852 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.759675:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8800/0xcedf0054f84977c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae9ed expref: 29 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.759689:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8800/0xcedf0054f84977c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae9ed expref: 29 pid: 6517 timeout: 1121 lvb_type: 0 00000100:00100000:3.0:1763334956.759706:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701760128:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334956.759806:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac94560c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334956.798643:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.806082:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab30a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701760256:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334956.806120:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f84978c2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x16b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334956.823130:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694228608 00000100:00100000:3.0:1763334956.823146:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694228608 00000100:00100000:3.0:1763334956.823268:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1500 00000100:00100000:3.0:1763334956.823282:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac821b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52918:x1848989694228608:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334956.823674:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac821b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52918:x1848989694228608:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 394us (1537us total) trans 8589938353 rc 0/0 00000100:00100000:3.0:1763334956.823683:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1500 00000100:00100000:3.0:1763334956.862767:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694229248 00000100:00100000:3.0:1763334956.862782:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694229248 00000100:00100000:3.0:1763334956.862844:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4076 00000100:00100000:3.0:1763334956.862856:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+161:52916:x1848989694229248:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334956.862890:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334956.862918:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f84978fa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aea4f expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.862996:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f84978fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x16a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea4f expref: 162 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.863014:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f84978fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x16a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea4f expref: 162 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.863037:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16a:0x0].0x0 (ffff9a5acb935800) 00010000:00010000:3.0:1763334956.863040:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334956.863045:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030200, rc 0) 00000100:00100000:3.0:1763334956.863132:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+162:52916:x1848989694229248:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 277us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.863140:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4076 00000100:00100000:3.0:1763334956.867797:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694229760 00000100:00100000:3.0:1763334956.867803:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694229760 00000100:00100000:3.0:1763334956.867904:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4078 00000100:00100000:3.0:1763334956.868064:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52916:x1848989694229760:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334956.868091:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334956.868294:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497908 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aea64 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.868358:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849791d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.868367:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849791d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x16a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.868376:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849791d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x16a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334956.868419:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x16a:0x0]: returning size 5 00000004:00200000:3.0:1763334956.868424:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334956.868446:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849791d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x16a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334956.868472:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497908 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea64 expref: 165 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.868485:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849791d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x16a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea64 expref: 164 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.868505:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16a:0x0].0x0 (ffff9a5acb935800) 00010000:00010000:3.0:1763334956.868508:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763334956.868512:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0031000, rc 0) 00000100:00100000:3.0:1763334956.868612:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+164:52916:x1848989694229760:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 551us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.868620:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4078 00000100:00100000:3.0:1763334956.874773:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334956.929523:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694230016 00000100:00100000:3.0:1763334956.929538:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694230016 00000100:00100000:3.0:1763334956.929643:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1638 00000100:00100000:3.0:1763334956.929655:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694230016:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:3.0:1763334956.929707:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f849792b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.929733:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.929736:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.929743:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f849792b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.929759:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f849792b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.929904:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f849792b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.929914:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f849792b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.929923:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f849792b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.929930:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0031600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334956.929935:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f849792b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.929945:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f849792b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.929964:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f849792b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.929971:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f849792b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334956.930055:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694230016:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 401us (1231us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763334956.930063:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1638 00000100:00100000:3.0:1763334956.932350:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701760896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.932439:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.932523:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701761024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.932548:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334956.932606:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701760896 00000100:00100000:3.0:1763334956.932617:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701760896 00000100:00100000:3.0:1763334956.932668:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701761024 00000100:00100000:3.0:1763334956.932671:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701761024 00000100:00100000:3.0:1763334956.932695:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4303 00000100:00100000:3.0:1763334956.932705:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3292:x1848989701760896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.933033:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3292:x1848989701760896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 328us (593us total) trans 17179870859 rc 0/0 00000100:00100000:3.0:1763334956.933042:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4303 00000100:00100000:3.0:1763334956.933062:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4304 00000100:00100000:3.0:1763334956.933068:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3289:x1848989701761024:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.937458:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3289:x1848989701761024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4382us (4901us total) trans 17179870860 rc 0/0 00000100:00100000:3.0:1763334956.937471:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4304 00000004:00080000:3.0:1763334956.937547:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f3800/2, rc 0, transno 17179870859 00000100:00100000:3.0:1763334956.937556:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701760896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.937606:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334956.937622:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af59f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701761280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.937670:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763334956.937725:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f3480/2, rc 0, transno 17179870860 00000100:00100000:3.0:1763334956.937730:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701761024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334956.937751:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701761280 00000100:00100000:3.0:1763334956.937759:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701761280 00000100:00100000:3.0:1763334956.937805:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4306 00000100:00100000:3.0:1763334956.937815:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3292:x1848989701761280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.938061:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+26:3292:x1848989701761280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 247us (389us total) trans 21474838145 rc 0/0 00000100:00100000:3.0:1763334956.938067:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4306 00000004:00080000:3.0:1763334956.938096:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af59f9180/2, rc 0, transno 21474838145 00000100:00100000:3.0:1763334956.938101:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af59f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701761280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334956.939400:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694230144 00000100:00100000:3.0:1763334956.939412:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694230144 00000100:00100000:3.0:1763334956.945349:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694230272 00000100:00100000:3.0:1763334956.945365:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694230272 00000100:00100000:3.0:1763334956.945488:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1639 00000100:00100000:3.0:1763334956.945501:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2362:x1848989694230272:12345-192.168.201.60@tcp:4:lfs.0 00002000:00010000:3.0:1763334956.945605:0:6522:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1f3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334956.945617:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497940 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.945635:0:6522:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.945637:0:6522:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.945646:0:6522:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.945669:0:6522:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334956.949848:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694230528 00000100:00100000:3.0:1763334956.949863:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694230528 00000100:00100000:3.0:1763334956.949924:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4308 00000100:00100000:3.0:1763334956.949934:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+31:52274:x1848989694230528:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334956.949956:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334956.949983:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f849794e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aea80 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334956.950009:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1f8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334956.950033:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.950035:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334956.950045:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f849794e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea80 expref: 32 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.950060:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0031600/0xcedf0054f849794e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea80 expref: 32 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334956.950074:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0031600, rc 0) 00000100:00100000:3.0:1763334956.950135:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+32:52274:x1848989694230528:12345-192.168.201.60@tcp:101:bash.0 Request processed in 203us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334956.950142:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4308 00000100:00100000:3.0:1763334956.969062:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694231040 00000100:00100000:3.0:1763334956.969076:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694231040 00000100:00100000:3.0:1763334956.969150:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1501 00000100:00100000:3.0:1763334956.969162:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+158:52274:x1848989694231040:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:3.0:1763334956.969737:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+159:52274:x1848989694231040:12345-192.168.201.60@tcp:35:bash.0 Request processed in 574us (769us total) trans 8589938358 rc 0/0 00000100:00100000:3.0:1763334956.969746:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1501 00000100:00100000:3.0:1763334957.019311:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.049175:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694231936 00000100:00100000:3.0:1763334957.049191:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694231936 00000100:00100000:3.0:1763334957.049272:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4086 00000100:00100000:3.0:1763334957.071101:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694232704 00000100:00100000:3.0:1763334957.071115:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694232704 00000100:00100000:3.0:1763334957.071183:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4089 00000100:00100000:3.0:1763334957.071193:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52916:x1848989694232704:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:3.0:1763334957.071270:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334957.071302:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849791d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x16a:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea64 expref: 163 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.071324:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16a:0x0].0x0 (ffff9a5acb935800) 00010000:00010000:3.0:1763334957.071329:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334957.071410:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497a0b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x16a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.071424:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497a0b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.071435:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497a0b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00010000:3.0:1763334957.071908:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e10fca5c reply state 0000000065c3575e transno 8589938361 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497a0b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334957.071923:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334957.077915:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+164:52916:x1848989694232704:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 6700us (6883us total) trans 8589938361 rc 0/0 00000100:00100000:3.0:1763334957.077936:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4089 00000100:00100000:3.0:1763334957.079255:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694232832 00000100:00100000:3.0:1763334957.079265:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694232832 00010000:00010000:3.0:1763334957.079319:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84979ef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x16d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeaaa expref: 164 pid: 29627 timeout: 1121 lvb_type: 0 00000100:00100000:3.0:1763334957.079364:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2300 00000100:00100000:3.0:1763334957.079376:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+164:2359:x1848989694232832:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334957.079409:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334957.079417:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84979ef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x16d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeaaa expref: 164 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334957.079433:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84979ef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x16d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeaaa expref: 164 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334957.079467:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84979ef lrc: 0/0,0 mode: --/PR res: [0x200000404:0x16d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeaaa expref: 164 pid: 29627 timeout: 1121 lvb_type: 0 00010000:00010000:3.0:1763334957.079487:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16d:0x0].0x0 (ffff9a5ac29dad00) 00010000:00010000:3.0:1763334957.079493:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8497a04 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x16d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334957.079504:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8497a04 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334957.079518:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8497a04 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x16d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334957.079558:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334957.079655:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+163:2359:x1848989694232832:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 280us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.079664:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2300 00000100:00100000:3.0:1763334957.086374:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694233088 00000100:00100000:3.0:1763334957.086381:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694233088 00000100:00100000:3.0:1763334957.086441:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1502 00000100:00100000:3.0:1763334957.086450:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+161:52920:x1848989694233088:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334957.086944:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+162:52920:x1848989694233088:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 491us (1413us total) trans 8589938363 rc 0/0 00000100:00100000:3.0:1763334957.086953:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1502 00000100:00100000:3.0:1763334957.091237:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694233472 00000100:00100000:3.0:1763334957.091968:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694233472 00000100:00100000:3.0:1763334957.092009:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1503 00000100:00100000:3.0:1763334957.092017:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+162:52920:x1848989694233472:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334957.096867:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52920:x1848989694233472:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 4845us (6534us total) trans 8589938364 rc 0/0 00000100:00100000:3.0:1763334957.096880:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1503 00000100:00100000:3.0:1763334957.101630:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.101682:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.106984:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.114297:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694234368 00000100:00100000:3.0:1763334957.114308:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694234368 00000100:00100000:3.0:1763334957.118319:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334957.118358:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497a2e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.118372:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497a2e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.118380:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497a2e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.118387:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334957.118404:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497a2e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.118413:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497a2e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.118432:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16a:0x0].0x0 (ffff9a5acb935800) 00010000:00010000:3.0:1763334957.118435:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334957.118442:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497a2e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.118448:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497a2e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x16a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334957.132123:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.135635:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.135765:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.143115:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.143155:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694235264 00000100:00100000:3.0:1763334957.143167:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694235264 00000100:00100000:3.0:1763334957.143245:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4093 00000100:00100000:3.0:1763334957.182359:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701762048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.182489:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334957.182555:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763334957.182561:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701761664:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.182618:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334957.182644:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701761792:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.182665:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334957.182682:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763334957.182686:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701761920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.182704:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334957.182736:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701762048 00000100:00100000:3.0:1763334957.182746:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701762048 00000100:00100000:3.0:1763334957.182796:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701761664 00000100:00100000:3.0:1763334957.182799:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701761664 00000100:00100000:3.0:1763334957.182816:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701761792 00000100:00100000:3.0:1763334957.182819:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701761792 00000100:00100000:3.0:1763334957.182833:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701761920 00000100:00100000:3.0:1763334957.182835:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701761920 00000100:00100000:3.0:1763334957.182855:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4312 00000100:00100000:3.0:1763334957.182864:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701762048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334957.183132:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1f3:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763334957.183138:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1f3:0x0] updating lvb mtime from disk: 1763334957 -> 1763334957 00002000:00010000:3.0:1763334957.183141:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1f3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334957.183143:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1f3:0x0] updating lvb ctime from disk: 1763334957 -> 1763334957 00002000:00010000:3.0:1763334957.183146:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1f3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1763334957.183200:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701762048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 334us (710us total) trans 21474838149 rc 0/0 00000100:00100000:3.0:1763334957.183208:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4312 00000100:00100000:3.0:1763334957.183231:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4313 00000100:00100000:3.0:1763334957.183239:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701761664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334957.183256:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:500 count 1 00010000:00010000:3.0:1763334957.183280:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f8497a74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.183305:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8099600/0xcedf0054f8497947 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea79 expref: 13 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.183314:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334957.183316:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334957.183320:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f8497a74 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.183357:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8099600/0xcedf0054f8497947 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea79 expref: 13 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.183374:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8099600/0xcedf0054f8497947 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea79 expref: 13 pid: 26216 timeout: 1121 lvb_type: 0 00000100:00100000:3.0:1763334957.183401:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701762176:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334957.183485:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeddcd80 going to sleep for 11 seconds 00000004:00080000:3.0:1763334957.199229:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77dc00/2, rc 0, transno 21474838149 00000100:00100000:3.0:1763334957.199263:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701762048:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.253795:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4325 00000100:00100000:3.0:1763334957.253807:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2360:x1848989694236800:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334957.253814:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334957.253824:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0030200/0xcedf0054f8497ad6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeaf7 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334957.253883:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:32239:1848989701763456:192.168.201.60@tcp:106: 00000100:00100000:3.0:1763334957.253958:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac57b5c00 going to sleep for 11 seconds 00002000:00010000:3.0:1763334957.257471:0:32239:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x1fa:0x0] updating lvb mtime: 0 -> 1763334957 00002000:00010000:3.0:1763334957.257478:0:32239:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x1fa:0x0] updating lvb atime: 0 -> 1763334957 00002000:00010000:3.0:1763334957.257481:0:32239:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x1fa:0x0] updating lvb ctime: 0 -> 1763334957 00000100:00100000:3.0:1763334957.257508:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:32239:1848989701763456:192.168.201.60@tcp:106: 00010000:00010000:3.0:1763334957.257555:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0030200/0xcedf0054f8497ad6 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeaf7 expref: 37 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334957.257599:0:32239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac0030200/0xcedf0054f8497ad6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeaf7 expref: 37 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334957.257615:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030200, rc 0) 00000100:00100000:3.0:1763334957.258049:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2360:x1848989694236800:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4244us (4646us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334957.258058:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4325 00000100:00100000:3.0:1763334957.269964:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.308133:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694238976 00000100:00100000:3.0:1763334957.308146:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694238976 00000100:00100000:3.0:1763334957.308208:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4101 00000100:00100000:3.0:1763334957.308220:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52916:x1848989694238976:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334957.308261:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334957.308291:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497b38 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x16d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeb13 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.308375:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497b38 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x16d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb13 expref: 164 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.308424:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030200/0xcedf0054f8497b38 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x16d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb13 expref: 164 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.308448:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16d:0x0].0x0 (ffff9a5ae1a32d00) 00010000:00010000:3.0:1763334957.308451:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334957.308455:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030200, rc 0) 00000100:00100000:3.0:1763334957.308535:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+164:52916:x1848989694238976:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 316us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.308542:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4101 00000100:00100000:3.0:1763334957.331092:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.344566:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694239872 00000100:00100000:3.0:1763334957.344606:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694239872 00000100:00100000:3.0:1763334957.344662:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4105 00000100:00100000:3.0:1763334957.344672:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52922:x1848989694239872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334957.344693:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334957.344716:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497b85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeb2f expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.344790:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497b8c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.344805:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497b8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.344816:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497b8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334957.344885:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334957.344889:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334957.344911:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497b8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.344939:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497b85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb2f expref: 167 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.344960:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497b8c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb2f expref: 166 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.344970:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334957.344973:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334957.344976:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0031800, rc 0) 00000100:00100000:3.0:1763334957.345029:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52922:x1848989694239872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 359us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.345037:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4105 00000100:00100000:3.0:1763334957.373919:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694240384 00000100:00100000:3.0:1763334957.373943:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694240384 00000100:00100000:3.0:1763334957.385833:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4109 00000100:00100000:3.0:1763334957.385848:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52922:x1848989694240640:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334957.385880:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334957.385907:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497be7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeb4b expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.386035:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497bee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.386294:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8497bd2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb44 expref: 171 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.386303:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f8497bf5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334957.386310:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497bee lrc: 5/0,1 mode: --/EX res: [0x200000404:0x16f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.386369:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f8497bf5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb52 expref: 171 pid: 29627 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.386378:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f8497bf5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb52 expref: 171 pid: 29627 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334957.386401:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77f800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701763584:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334957.393977:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694241152 00000100:00100000:3.0:1763334957.393983:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694241152 00000100:00100000:3.0:1763334957.394015:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1511 00000100:00100000:3.0:1763334957.394022:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52924:x1848989694241152:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334957.394355:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52924:x1848989694241152:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 333us (986us total) trans 8589938382 rc 0/0 00000100:00100000:3.0:1763334957.394363:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1511 00000100:00100000:3.0:1763334957.397525:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694241408 00000100:00100000:3.0:1763334957.397538:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694241408 00010000:00010000:3.0:1763334957.397607:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8497bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb44 expref: 171 pid: 29629 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334957.397657:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2305 00000100:00100000:3.0:1763334957.397669:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+171:2359:x1848989694241408:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334957.397688:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334957.397695:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8497bd2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb44 expref: 171 pid: 29629 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.397709:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8497bd2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb44 expref: 171 pid: 29629 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.397736:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8497bd2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb44 expref: 171 pid: 29629 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.397756:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16f:0x0].0x0 (ffff9a5ac29da600) 00010000:00010000:3.0:1763334957.397762:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497bee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x16f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.397772:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497bee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.397780:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497bee lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x16f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.397810:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334957.399192:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+171:2359:x1848989694241408:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1516us (2270us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.399205:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2305 00010000:00010000:3.0:1763334957.399875:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497be7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb4b expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.399890:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334957.399893:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763334957.399897:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497be7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb4b expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.399908:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030e00, rc 0) 00000100:00100000:3.0:1763334957.399960:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52922:x1848989694240640:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 14115us (14986us total) trans 8589938383 rc 301/301 00000100:00100000:3.0:1763334957.399967:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4109 00000100:00100000:3.0:1763334957.419915:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4112 00000100:00100000:3.0:1763334957.419929:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52274:x1848989694242944:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334957.419961:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334957.419987:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497c3b lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeb6e expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.420114:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497c50 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.420879:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497c50 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x16f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.420893:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497c50 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x16f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334957.430133:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694243328 00000100:00100000:3.0:1763334957.430143:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694243328 00010000:00010000:3.0:1763334957.430238:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8497c1f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb59 expref: 178 pid: 30972 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334957.430290:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2306 00000100:00100000:3.0:1763334957.430301:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2359:x1848989694243328:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334957.430323:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334957.430330:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8497c1f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb59 expref: 178 pid: 30972 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.430345:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8497c1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb59 expref: 178 pid: 30972 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.430377:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8497c1f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb59 expref: 178 pid: 30972 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.430409:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16f:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:3.0:1763334957.430415:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f8497c49 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x16f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.430427:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f8497c49 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x16f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.430435:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f8497c49 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x16f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.430443:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497c50 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x16f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.430450:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497c50 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x16f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.430455:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f8497c50 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x16f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.430505:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334957.430591:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+177:2359:x1848989694243328:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 269us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.430600:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2306 00000100:00100000:3.0:1763334957.450253:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.461078:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.470677:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.487502:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694245376 00000100:00100000:3.0:1763334957.487516:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694245376 00000100:00100000:3.0:1763334957.487611:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4118 00000100:00100000:3.0:1763334957.487624:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52925:x1848989694245376:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334957.487655:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334957.487684:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497ca4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeb91 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.487793:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497cab lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.487811:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497cab lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.487825:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497cab lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.487845:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f8497cb2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.487852:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f8497cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.487863:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f8497cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488023:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8497cb9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488033:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8497cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488040:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8497cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334957.488051:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x16f:0x0]: returning size 2 00010000:00010000:3.0:1763334957.488235:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8497cb9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488244:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8497cb9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488252:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8497cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488259:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5b02164000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334957.488265:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8497cb9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488274:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8497cb9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488287:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16f:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:3.0:1763334957.488290:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1763334957.488297:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8497cb9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488307:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8497cb9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488326:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497cab lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488331:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497cab lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488338:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497cab lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488343:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0031800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334957.488345:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497cab lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488350:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497cab lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488357:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334957.488360:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334957.488363:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497cab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488368:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f8497cab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488376:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f8497cb2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488392:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f8497cb2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488398:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f8497cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488404:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5b02164800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334957.488407:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f8497cb2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488412:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f8497cb2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488420:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32a00) 00010000:00010000:3.0:1763334957.488423:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334957.488426:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f8497cb2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488431:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f8497cb2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.488485:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497ca4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb91 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.488497:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334957.488499:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763334957.488503:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f8497ca4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb91 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.488514:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030e00, rc 0) 00000100:00100000:3.0:1763334957.488627:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52925:x1848989694245376:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1005us (1300us total) trans 8589938396 rc 301/301 00000100:00100000:3.0:1763334957.488636:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4118 00000100:00100000:3.0:1763334957.514022:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694245632 00000100:00100000:3.0:1763334957.514035:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694245632 00010000:00010000:3.0:1763334957.514087:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f8497c49 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x16f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb75 expref: 187 pid: 30972 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334957.514141:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2308 00000100:00100000:3.0:1763334957.514152:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+187:2359:x1848989694245632:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334957.514170:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334957.514176:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f8497c49 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x16f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb75 expref: 187 pid: 30972 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.514190:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f8497c49 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x16f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb75 expref: 187 pid: 30972 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.514219:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f8497c49 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x16f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb75 expref: 187 pid: 30972 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.514239:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16f:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:3.0:1763334957.514245:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8497cce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.514254:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8497cce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.514259:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8497cce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.514265:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334957.514343:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2359:x1848989694245632:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 192us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.514351:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2308 00000100:00100000:3.0:1763334957.546567:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca872d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701766016:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334957.546604:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a59c441e400/0xcedf0054f8497cea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334957.549912:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694246016 00000100:00100000:3.0:1763334957.549935:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694246016 00010000:00010000:3.0:1763334957.550020:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5b02165c00/0xcedf0054f8497acf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeaf0 expref: 38 pid: 32241 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334957.550069:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694246144 00000100:00100000:3.0:1763334957.550073:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694246144 00010000:00010000:3.0:1763334957.550088:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8497a20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeabf expref: 39 pid: 26216 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334957.550114:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2309 00000100:00100000:3.0:1763334957.550125:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+39:2362:x1848989694246016:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334957.550143:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334957.550149:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5b02165c00/0xcedf0054f8497acf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeaf0 expref: 39 pid: 32241 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.550162:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5b02165c00/0xcedf0054f8497acf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeaf0 expref: 39 pid: 32241 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.550193:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5b02165c00/0xcedf0054f8497acf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeaf0 expref: 39 pid: 32241 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.550214:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.550216:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.550223:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497cdc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.550234:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497cdc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.550266:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334957.550348:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+38:2362:x1848989694246016:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 223us (4665us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.550358:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2309 00000100:00100000:3.0:1763334957.550394:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2310 00000100:00100000:3.0:1763334957.550403:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2362:x1848989694246144:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334957.550412:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334957.550417:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8497a20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeabf expref: 37 pid: 26216 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.550428:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8497a20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeabf expref: 37 pid: 26216 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.550441:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8497a20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeabf expref: 37 pid: 26216 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.550451:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.550453:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.550456:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59c441e400/0xcedf0054f8497cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.550464:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c441e400/0xcedf0054f8497cea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.550483:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334957.550502:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2362:x1848989694246144:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 100us (4413us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.550509:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2310 00000100:00100000:3.0:1763334957.550709:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.550763:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.550788:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.550817:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.550846:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.550898:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.550918:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694246656 00000100:00100000:3.0:1763334957.550925:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694246656 00010000:00010000:3.0:1763334957.550946:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84977e2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae9fb expref: 18 pid: 6517 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334957.550975:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2312 00000100:00100000:3.0:1763334957.550990:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2362:x1848989694246528:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334957.551002:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334957.551010:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099800/0xcedf0054f8497924 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea6b expref: 36 pid: 32241 timeout: 1122 lvb_type: 1 00010000:00010000:3.0:1763334957.551030:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099800/0xcedf0054f8497924 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aea6b expref: 36 pid: 32241 timeout: 1122 lvb_type: 1 00010000:00010000:3.0:1763334957.551049:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.551053:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.551058:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59ca226200/0xcedf0054f8497d06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.551071:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59ca226200/0xcedf0054f8497d06 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.551089:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334957.551123:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2362:x1848989694246528:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 132us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.551133:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2312 00000100:00100000:3.0:1763334957.551157:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2314 00000100:00100000:3.0:1763334957.551173:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694246656:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334957.551185:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334957.551194:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84977e2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae9fb expref: 16 pid: 6517 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.551212:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84977e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833ae9fb expref: 16 pid: 6517 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.551228:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.551232:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.551237:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f8497cd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.551248:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f8497cd5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.551266:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334957.551294:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694246656:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 125us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.551302:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2314 00010000:00010000:3.0:1763334957.551360:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a59c441e400/0xcedf0054f8497cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.551370:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59c441e400/0xcedf0054f8497cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.551403:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59c441e400/0xcedf0054f8497cea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.551415:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c441e400/0xcedf0054f8497cea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.551438:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334957.551839:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3292:x1848989701765120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14058us (16957us total) trans 17179870874 rc 0/0 00000100:00100000:3.0:1763334957.551851:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4333 00000004:00080000:3.0:1763334957.554715:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af59f9880/2, rc 0, transno 21474838159 00000100:00100000:3.0:1763334957.554735:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af59f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701764352:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763334957.557945:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af59fa300/2, rc 0, transno 21474838161 00000100:00100000:3.0:1763334957.557965:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af59fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701764480:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763334957.557983:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81fc700/2, rc 0, transno 17179870876 00000100:00100000:3.0:1763334957.557988:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701764992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334957.562227:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.569132:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.572311:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.600366:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694248192 00000100:00100000:3.0:1763334957.600392:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694248192 00000100:00100000:3.0:1763334957.601803:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4121 00000100:00100000:3.0:1763334957.601825:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52926:x1848989694248192:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:3.0:1763334957.601908:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763334957.601944:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca227e00/0xcedf0054f8497d37 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aebb4 expref: 163 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.601972:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8497cce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x16f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb98 expref: 162 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.601987:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497c9d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x16f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb8a expref: 161 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.601999:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x16f:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:3.0:1763334957.602013:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334957.602047:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f8497d45 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.602063:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f8497d45 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.602075:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f8497d45 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.602093:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8497d4c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.602101:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8497d4c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.602109:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8497d4c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.602271:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497d53 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x16f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.602279:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497d53 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334957.602287:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8497d53 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x16f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00080000:3.0:1763334957.602872:0:32232:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x16f:0x0] is inserted into orphan list, open count = 1 00000100:00100000:3.0:1763334957.612077:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.643762:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.665511:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.676896:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.682392:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.686703:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.701038:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.710971:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.713876:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.728075:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.734332:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4134 00000100:00100000:3.0:1763334957.734343:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52928:x1848989694251904:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334957.734353:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334957.734364:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497e4f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x170:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aec0f expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.735214:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8497e48 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x170:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.735227:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497e4f lrc: 4/0,0 mode: --/CR res: [0x200000404:0x170:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec0f expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.735248:0:30972:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8497e48 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x170:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.735276:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497e4f lrc: 3/0,0 mode: --/CR res: [0x200000404:0x170:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec0f expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.735290:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x170:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:3.0:1763334957.735293:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334957.735297:0:30972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8497e4f lrc: 3/0,0 mode: --/CR res: [0x200000404:0x170:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec0f expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.735304:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8800, rc 0) 00000100:00100000:3.0:1763334957.735397:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52928:x1848989694251904:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1055us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.735405:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4134 00000100:00100000:3.0:1763334957.802706:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701767808:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.802745:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334957.802771:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763334957.802780:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701767936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.802802:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334957.802829:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701767808 00000100:00100000:3.0:1763334957.802833:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701767808 00000100:00100000:3.0:1763334957.802862:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701767936 00000100:00100000:3.0:1763334957.802865:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701767936 00000100:00100000:3.0:1763334957.802886:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4349 00000100:00100000:3.0:1763334957.802893:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701767808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334957.802909:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:505 count 1 00010000:00010000:3.0:1763334957.802930:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8497e64 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.802945:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5aec6d5a00/0xcedf0054f8497c34 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb67 expref: 14 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334957.802952:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.802954:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.802957:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8497e64 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.802982:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5aec6d5a00/0xcedf0054f8497c34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb67 expref: 14 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334957.802991:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5aec6d5a00/0xcedf0054f8497c34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb67 expref: 14 pid: 26216 timeout: 1122 lvb_type: 1 00000100:00100000:3.0:1763334957.803003:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701768192:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334957.803055:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3f77900 going to sleep for 11 seconds 00000100:00100000:3.0:1763334957.803074:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4350 00000100:00100000:3.0:1763334957.803083:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701767936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.803399:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3289:x1848989701767936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 316us (594us total) trans 21474838163 rc 0/0 00000100:00100000:3.0:1763334957.803407:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4350 00000004:00080000:3.0:1763334957.803625:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44df80/2, rc 0, transno 21474838163 00000100:00100000:3.0:1763334957.803631:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701767936:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.803648:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701768064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.803674:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334957.803697:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763334957.803703:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701767680:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.803724:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334957.803753:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701768064 00000100:00100000:3.0:1763334957.803758:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701768064 00000100:00100000:3.0:1763334957.803784:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701767680 00000100:00100000:3.0:1763334957.803788:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701767680 00000100:00100000:3.0:1763334957.803802:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4351 00000100:00100000:3.0:1763334957.803808:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3291:x1848989701768064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.803966:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3291:x1848989701768064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 157us (291us total) trans 21474838164 rc 0/0 00000100:00100000:3.0:1763334957.803973:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4351 00000100:00100000:3.0:1763334957.803987:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4352 00000100:00100000:3.0:1763334957.803993:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3291:x1848989701767680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334957.804004:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:504 count 1 00010000:00010000:3.0:1763334957.804022:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8497e6b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.804038:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f8497d0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb9f expref: 14 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.804052:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334957.804054:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334957.804057:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8497e6b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.804083:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f8497d0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb9f expref: 14 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.804094:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f8497d0d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb9f expref: 14 pid: 25383 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334957.804105:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21625:1848989701768320:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334957.804149:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeddcd80 going to sleep for 11 seconds 00000004:00080000:3.0:1763334957.804176:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77c000/2, rc 0, transno 21474838164 00000100:00100000:3.0:1763334957.804181:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701768064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.806786:0:29629:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701767424:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334957.806833:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8497e41 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x170:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec08 expref: 160 pid: 29629 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763334957.806859:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8497e48 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x170:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec08 expref: 159 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.806905:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ad8098800, rc 0) 00000100:00100000:3.0:1763334957.807313:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+159:52274:x1848989694251776:12345-192.168.201.60@tcp:101:bash.0 Request processed in 73265us (74885us total) trans 8589938411 rc 0/0 00000100:00100000:3.0:1763334957.807327:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4133 00000100:00100000:3.0:1763334957.809705:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694252032 00000100:00100000:3.0:1763334957.809718:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694252032 00010000:00010000:3.0:1763334957.809771:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098e00/0xcedf0054f8497c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb60 expref: 38 pid: 26216 timeout: 1122 lvb_type: 1 00000100:00100000:3.0:1763334957.809808:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694252288 00000100:00100000:3.0:1763334957.809811:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694252288 00010000:00010000:3.0:1763334957.809825:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099400/0xcedf0054f8497d1b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aebad expref: 39 pid: 25383 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334957.809847:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2316 00000100:00100000:3.0:1763334957.809858:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+39:2360:x1848989694252032:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334957.809877:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334957.809883:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098e00/0xcedf0054f8497c2d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb60 expref: 39 pid: 26216 timeout: 1122 lvb_type: 1 00010000:00010000:3.0:1763334957.809897:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098e00/0xcedf0054f8497c2d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb60 expref: 39 pid: 26216 timeout: 1122 lvb_type: 1 00010000:00010000:3.0:1763334957.809927:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098e00/0xcedf0054f8497c2d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb60 expref: 39 pid: 26216 timeout: 1122 lvb_type: 1 00010000:00010000:3.0:1763334957.809946:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.809949:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.809955:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8497e56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.809972:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8497e56 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.810000:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334957.810062:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+38:2360:x1848989694252032:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 205us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.810071:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2316 00000100:00100000:3.0:1763334957.810092:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694252416 00000100:00100000:3.0:1763334957.810095:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694252416 00010000:00010000:3.0:1763334957.810106:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5aec6d5a00/0xcedf0054f8497c34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb67 expref: 15 pid: 26216 timeout: 1122 lvb_type: 1 00000100:00100000:3.0:1763334957.810118:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694252544 00000100:00100000:3.0:1763334957.810121:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694252544 00010000:00010000:3.0:1763334957.810132:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f8497d0d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb9f expref: 16 pid: 25383 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334957.810144:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2317 00000100:00100000:3.0:1763334957.810150:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2359:x1848989694252288:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334957.810158:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334957.810162:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099400/0xcedf0054f8497d1b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aebad expref: 37 pid: 25383 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.810171:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099400/0xcedf0054f8497d1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aebad expref: 37 pid: 25383 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.810188:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.810190:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.810193:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f8497e5d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.810200:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f8497e5d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.810212:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334957.810231:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2359:x1848989694252288:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 81us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.810237:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2317 00000100:00100000:3.0:1763334957.810250:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2318 00000100:00100000:3.0:1763334957.810256:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694252416:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334957.810266:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334957.810271:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5aec6d5a00/0xcedf0054f8497c34 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb67 expref: 16 pid: 26216 timeout: 1122 lvb_type: 1 00010000:00010000:3.0:1763334957.810281:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5aec6d5a00/0xcedf0054f8497c34 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb67 expref: 16 pid: 26216 timeout: 1122 lvb_type: 1 00010000:00010000:3.0:1763334957.811705:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5aec6d5a00/0xcedf0054f8497c34 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb67 expref: 15 pid: 26216 timeout: 1122 lvb_type: 1 00010000:00010000:3.0:1763334957.811724:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.811727:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334957.811732:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8497e64 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.811742:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8497e64 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.811769:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334957.811812:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694252416:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1555us (1946us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.811820:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2318 00010000:00010000:3.0:1763334957.811883:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f8497d0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeb9f expref: 13 pid: 25383 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334957.811894:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21625:1848989701768320:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334957.811912:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8497e6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.811921:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8497e6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.811928:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8497e6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.811937:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8497e6b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.811944:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8497e6b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.811966:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763334957.812293:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3291:x1848989701767680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8300us (8567us total) trans 21474838165 rc 0/0 00000100:00100000:3.0:1763334957.812303:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4352 00000004:00080000:3.0:1763334957.812354:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44dc00/2, rc 0, transno 21474838165 00000100:00100000:3.0:1763334957.812360:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701767680:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763334957.812401:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8497e56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.812409:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8497e56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.812417:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8497e56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.812425:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8497e56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.812455:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334957.812631:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+58:3290:x1848989701766912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10951us (11515us total) trans 17179870881 rc 0/0 00000100:00100000:3.0:1763334957.812638:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4347 00010000:00010000:3.0:1763334957.812657:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334957.812663:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8497e56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.812675:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334957.812678:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8497e56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.812685:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8497e56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.812697:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8497e56 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.812704:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8497e56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.812717:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334957.812719:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334957.812721:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334957.812743:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac37cf480/2, rc 0, transno 17179870881 00000100:00100000:3.0:1763334957.812749:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac37cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701766912:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763334957.814225:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44ed80/2, rc 0, transno 21474838166 00000100:00100000:3.0:1763334957.814233:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701767808:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334957.819022:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.827804:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694253824 00000100:00100000:3.0:1763334957.827810:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694253824 00000100:00100000:3.0:1763334957.828009:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4136 00000100:00100000:3.0:1763334957.828018:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+160:52928:x1848989694253824:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334957.828037:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334957.828058:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497ea3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aec32 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.828162:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8497eaa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x170:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.828178:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8497eaa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x170:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.828214:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8497eaa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x170:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334957.828229:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x170:0x0]: returning size 2 00010000:00010000:3.0:1763334957.829047:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497ea3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec32 expref: 163 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.829069:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8497eaa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x170:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec32 expref: 162 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.829080:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x170:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:3.0:1763334957.829083:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1763334957.829088:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8c00, rc 0) 00000100:00100000:3.0:1763334957.829140:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+162:52928:x1848989694253824:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1122us (2345us total) trans 8589938412 rc 0/0 00000100:00100000:3.0:1763334957.829147:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4136 00000100:00100000:3.0:1763334957.833029:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.841740:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694254720 00000100:00100000:3.0:1763334957.841747:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694254720 00000100:00100000:3.0:1763334957.841785:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1528 00000100:00100000:3.0:1763334957.841798:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52928:x1848989694254720:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:3.0:1763334957.842042:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52928:x1848989694254720:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 246us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.842050:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1528 00000100:00100000:3.0:1763334957.843983:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694254976 00000100:00100000:3.0:1763334957.844092:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694254976 00000100:00100000:3.0:1763334957.844199:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1529 00000100:00100000:3.0:1763334957.844212:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52928:x1848989694254976:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334957.844539:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52928:x1848989694254976:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 329us (637us total) trans 8589938415 rc 0/0 00000100:00100000:3.0:1763334957.844547:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1529 00000100:00100000:3.0:1763334957.850493:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694255744 00000100:00100000:3.0:1763334957.850503:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694255744 00000100:00100000:3.0:1763334957.850558:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1530 00000100:00100000:3.0:1763334957.850595:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52928:x1848989694255744:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:3.0:1763334957.850668:0:29631:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x170:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8497ef0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x170:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec47 expref: 165 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334957.850706:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497f13 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x170:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334957.850718:0:29631:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497f13 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x170:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334957.850727:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497f13 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x170:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000004:00020000:3.0:1763334957.850973:0:29631:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000404:0x170:0x0]: rc = -1 00010000:00010000:3.0:1763334957.851010:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497f13 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x170:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334957.851017:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497f13 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x170:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334957.851024:0:29631:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497f13 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x170:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334957.851028:0:29631:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334957.851032:0:29631:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497f13 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x170:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334957.851037:0:29631:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497f13 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x170:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334957.851045:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x170:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:3.0:1763334957.851048:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1763334957.851051:0:29631:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497f13 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x170:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334957.851057:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8497f13 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x170:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334957.851065:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x170:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:3.0:1763334957.851067:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763334957.851071:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8497ef0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x170:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec47 expref: 165 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334957.851197:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52928:x1848989694255744:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 630us (893us total) trans 8589938418 rc -1/-1 00000100:00100000:3.0:1763334957.851205:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1530 00000100:00100000:3.0:1763334957.853828:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4141 00000100:00100000:3.0:1763334957.900488:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.901808:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.908229:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694257792 00000100:00100000:3.0:1763334957.908243:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694257792 00010000:00010000:3.0:1763334957.908307:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8497f9f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec78 expref: 172 pid: 30972 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334957.908355:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2322 00000100:00100000:3.0:1763334957.908367:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:2359:x1848989694257792:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334957.908396:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334957.908404:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8497f9f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec78 expref: 172 pid: 30972 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.908419:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8497f9f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec78 expref: 172 pid: 30972 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334957.908451:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x171:0x0].0x0 (ffff9a5adaf40a00) 00010000:00010000:3.0:1763334957.908458:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8497fbb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.908470:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8497fbb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.908478:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8497fbb lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334957.908503:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334957.908600:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:2359:x1848989694257792:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 207us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334957.908609:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2322 00010000:00010000:1.0:1763334957.909697:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8497fbb lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.909705:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8497fbb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.909712:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334957.909717:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8497fbb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.909726:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8497fbb lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.909740:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x171:0x0].0x0 (ffff9a5adaf40a00) 00010000:00010000:1.0:1763334957.909743:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334957.909747:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8497fbb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.909753:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8497fbb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.909827:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8497fad lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec7f expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334957.909838:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334957.909841:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334957.909845:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8497fad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec7f expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334957.909855:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:1.0:1763334957.909925:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52930:x1848989694257408:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7825us (9454us total) trans 8589938422 rc 301/301 00000100:00100000:1.0:1763334957.909936:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4148 00000100:00100000:3.0:1763334957.914616:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334957.914921:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694258304 00000100:00100000:1.0:1763334957.914938:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694258304 00000100:00100000:1.0:1763334957.915016:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4150 00000100:00100000:1.0:1763334957.915027:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52932:x1848989694258304:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334957.915057:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334957.915089:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8497fd7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aec8d expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334957.915197:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8497fde lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915217:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8497fde lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915231:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8497fde lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915248:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8497fe5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915256:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8497fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915263:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8497fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915470:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8497fec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x171:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915480:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8497fec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915489:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8497fec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334957.915504:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x171:0x0]: returning size 0 00010000:00010000:1.0:1763334957.915662:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8497fde lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915671:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8497fde lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915678:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8497fde lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915684:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334957.915689:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8497fde lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915697:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8497fde lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915711:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334957.915715:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334957.915720:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8497fde lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915726:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8497fde lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915740:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8497fe5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915745:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8497fe5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915750:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8497fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915758:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334957.915761:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8497fe5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915767:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8497fe5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915774:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5adaf40000) 00010000:00010000:1.0:1763334957.915776:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334957.915779:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8497fe5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915784:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8497fe5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.915843:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8497fd7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec8d expref: 173 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334957.915857:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8497fec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec8d expref: 172 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334957.915865:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x171:0x0].0x0 (ffff9a5ac63d5900) 00010000:00010000:1.0:1763334957.915867:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334957.915869:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f800, rc 0) 00000100:00100000:1.0:1763334957.915951:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52932:x1848989694258304:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 925us (1392us total) trans 8589938424 rc 0/0 00000100:00100000:1.0:1763334957.915961:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4150 00000100:00100000:1.0:1763334957.922292:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334957.926182:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334957.946667:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694258944 00000100:00100000:3.0:1763334957.946683:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694258944 00000100:00100000:3.0:1763334957.946745:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694259200 00000100:00100000:3.0:1763334957.946748:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694259200 00000100:00100000:3.0:1763334957.946765:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1534 00000100:00100000:3.0:1763334957.946777:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52930:x1848989694258944:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334957.947291:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52930:x1848989694258944:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 514us (751us total) trans 8589938426 rc 0/0 00000100:00100000:1.0:1763334957.947300:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1534 00000100:00100000:1.0:1763334957.950794:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694259456 00000100:00100000:1.0:1763334957.950809:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694259456 00000100:00100000:1.0:1763334957.950885:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4151 00000100:00100000:1.0:1763334957.950896:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52932:x1848989694259456:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334957.950932:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334957.950962:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8498001 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aec9b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334957.951097:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498008 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x171:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.951115:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8497fec lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec8d expref: 176 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334957.951126:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498008 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x171:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.951170:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8497fec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec8d expref: 176 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334957.951190:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8497fec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec8d expref: 176 pid: 30972 timeout: 1122 lvb_type: 0 00000100:00100000:1.0:1763334957.951208:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af68cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701769216:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334957.951539:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334957.952351:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad952a000 going to sleep for 11 seconds 00000100:00100000:3.0:1763334957.958394:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334957.958455:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af68cd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701769216:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334957.958500:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498008 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x171:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.959090:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498008 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x171:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334957.959097:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498008 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x171:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334957.959123:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x171:0x0]: returning size 0 00010000:00010000:1.0:1763334957.959347:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8498001 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec9b expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334957.959364:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498008 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x171:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec9b expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334957.959371:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x171:0x0].0x0 (ffff9a5ac63d5900) 00010000:00010000:1.0:1763334957.959383:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334957.959386:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fe00, rc 0) 00000100:00100000:1.0:1763334957.959426:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52932:x1848989694259456:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 8532us (8897us total) trans 8589938428 rc 0/0 00000100:00100000:1.0:1763334957.959435:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4151 00000100:00100000:3.0:1763334957.963304:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.963361:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334957.965991:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334957.974436:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334957.974520:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334957.975308:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849802b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.975320:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849802b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.975328:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849802b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.975334:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334957.975338:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849802b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.975346:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849802b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.975358:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x171:0x0].0x0 (ffff9a5ac63d5900) 00010000:00010000:3.0:1763334957.975361:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334957.975365:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849802b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334957.975372:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849802b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:1.0:1763334957.981779:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.016717:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694261248 00000100:00100000:1.0:1763334958.016740:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694261248 00000100:00100000:1.0:1763334958.016833:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4156 00000100:00100000:1.0:1763334958.016845:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52933:x1848989694261248:12345-192.168.201.60@tcp:101:lfs.0 00000100:00080000:3.0:1763334958.016865:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1763334958.016877:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334958.016906:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8498047 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aecb7 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.017014:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849804e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017032:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849804e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017044:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849804e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017062:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498055 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017070:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498055 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017078:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498055 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017241:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849805c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x171:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017253:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849805c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017262:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849805c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334958.017276:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x171:0x0]: returning size 2 00010000:00010000:1.0:1763334958.017517:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849805c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017533:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849805c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017541:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849805c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017548:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.017554:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849805c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017564:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849805c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017612:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x171:0x0].0x0 (ffff9a5ac63d5900) 00010000:00010000:1.0:1763334958.017616:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1763334958.017624:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849805c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x171:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017632:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849805c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x171:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017655:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849804e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017662:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849804e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017668:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849804e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017674:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168ee00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.017678:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849804e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017689:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849804e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017698:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334958.017700:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334958.017704:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849804e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017710:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849804e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017717:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498055 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017725:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498055 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017731:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498055 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017736:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.017740:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498055 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017746:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498055 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017755:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac63d5100) 00010000:00010000:1.0:1763334958.017758:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334958.017761:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498055 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017767:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498055 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.017821:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8498047 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecb7 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.017833:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334958.017836:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334958.017841:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8498047 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecb7 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.017853:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fc00, rc 0) 00000100:00100000:1.0:1763334958.017960:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52933:x1848989694261248:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1117us (2562us total) trans 8589938434 rc 301/301 00000100:00100000:1.0:1763334958.017970:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4156 00000100:00100000:1.0:1763334958.023952:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334958.038879:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498016 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x171:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeca2 expref: 185 pid: 29629 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334958.038902:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca872d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701769344:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334958.038934:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498071 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x171:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334958.052344:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498040 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x171:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecb0 expref: 163 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.052361:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x171:0x0].0x0 (ffff9a5ac63d5900) 00010000:00010000:1.0:1763334958.052366:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334958.052370:0:29629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498071 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x171:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334958.052391:0:29629:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498071 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334958.052398:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498071 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334958.052457:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498039 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x171:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecb0 expref: 163 pid: 29629 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763334958.052486:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498040 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x171:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecb0 expref: 162 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.052532:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:1.0:1763334958.052662:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+162:52274:x1848989694260992:12345-192.168.201.60@tcp:101:bash.0 Request processed in 68025us (70900us total) trans 8589938433 rc 0/0 00000100:00100000:1.0:1763334958.052674:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4155 00000100:00100000:3.0:1763334958.053601:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701769856:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334958.053664:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.053709:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701770368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334958.053736:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.053764:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1763334958.053771:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701769472:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334958.053798:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.053814:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701769984:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334958.053832:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.053860:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701769600:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334958.053885:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.053905:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701770112:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334958.053929:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.053950:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763334958.053955:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701769728:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334958.053978:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.053994:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701770240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334958.054014:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.054051:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701769856 00000100:00100000:3.0:1763334958.054060:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701769856 00000100:00100000:3.0:1763334958.054116:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701770368 00000100:00100000:3.0:1763334958.054120:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701770368 00000100:00100000:3.0:1763334958.054140:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701769472 00000100:00100000:3.0:1763334958.054143:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701769472 00000100:00100000:3.0:1763334958.054156:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701769984 00000100:00100000:3.0:1763334958.054159:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701769984 00000100:00100000:3.0:1763334958.054172:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701769600 00000100:00100000:3.0:1763334958.054175:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701769600 00000100:00100000:3.0:1763334958.054184:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701770112 00000100:00100000:3.0:1763334958.054186:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701770112 00000100:00100000:3.0:1763334958.054194:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701769728 00000100:00100000:3.0:1763334958.054196:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701769728 00000100:00100000:3.0:1763334958.054209:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4357 00000100:00100000:3.0:1763334958.054218:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3291:x1848989701769856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334958.054567:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3291:x1848989701769856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 348us (901us total) trans 17179870883 rc 0/0 00000100:00100000:3.0:1763334958.054604:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4357 00000100:00100000:3.0:1763334958.054624:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701770240 00000100:00100000:3.0:1763334958.054628:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701770240 00000100:00100000:3.0:1763334958.054644:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4358 00000100:00100000:3.0:1763334958.054650:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3291:x1848989701770368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334958.054800:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3291:x1848989701770368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (1063us total) trans 21474838168 rc 0/0 00000100:00100000:3.0:1763334958.054807:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4358 00000100:00100000:3.0:1763334958.054820:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4359 00000100:00100000:3.0:1763334958.054826:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3291:x1848989701769472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334958.054842:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:510 count 1 00010000:00010000:3.0:1763334958.054868:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498078 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.054893:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8497e72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec16 expref: 36 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.054903:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334958.054905:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334958.054909:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498078 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.054947:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8497e72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec16 expref: 36 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.054964:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8497e72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec16 expref: 36 pid: 32241 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334958.054978:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701770496:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334958.055043:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afaf3ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334958.055071:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4360 00000100:00100000:3.0:1763334958.055079:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3291:x1848989701769984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334958.055092:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:506 count 1 00010000:00010000:3.0:1763334958.055107:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849807f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055125:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59ca226200/0xcedf0054f8497e9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec2b expref: 15 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055132:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334958.055134:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334958.055136:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849807f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055157:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a59ca226200/0xcedf0054f8497e9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec2b expref: 15 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055166:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a59ca226200/0xcedf0054f8497e9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec2b expref: 15 pid: 32241 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334958.055178:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21625:1848989701770624:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334958.055205:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afaf3e240 going to sleep for 11 seconds 00000100:00100000:3.0:1763334958.055228:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4361 00000100:00100000:3.0:1763334958.055237:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3289:x1848989701769600:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334958.055250:0:6518:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:511 count 1 00002000:00010000:3.0:1763334958.055278:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x1ff:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334958.055283:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498086 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055292:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334958.055294:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334958.055299:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055312:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055322:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055330:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055353:0:6518:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334958.055633:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3289:x1848989701769600:12345-0@lo:6:osp-syn-1-0.0 Request processed in 395us (1745us total) trans 17179870884 rc 0/0 00000100:00100000:3.0:1763334958.055639:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4361 00000100:00100000:3.0:1763334958.055661:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4362 00000100:00100000:3.0:1763334958.055669:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3289:x1848989701770112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334958.055684:0:6518:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:507 count 1 00002000:00010000:3.0:1763334958.055702:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x1fb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334958.055707:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849808d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055716:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334958.055717:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334958.055720:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849808d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055730:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849808d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055739:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849808d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055747:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849808d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.055762:0:6518:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763334958.055948:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb227450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3289:x1848989701770112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 279us (2016us total) trans 21474838169 rc 0/0 00000100:00100000:3.0:1763334958.055955:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4362 00000100:00100000:3.0:1763334958.055973:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4363 00000100:00100000:3.0:1763334958.055980:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+61:3289:x1848989701769728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334958.056119:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+62:3289:x1848989701769728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 139us (2139us total) trans 17179870885 rc 0/0 00000100:00100000:3.0:1763334958.056125:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4363 00000100:00100000:3.0:1763334958.056138:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4364 00000100:00100000:3.0:1763334958.056144:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3289:x1848989701770240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334958.056234:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1fc:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334958.056238:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1fc:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763334958.056240:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1fc:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334958.056242:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1fc:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763334958.056244:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1fc:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334958.056271:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3289:x1848989701770240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (2255us total) trans 21474838170 rc 0/0 00000100:00100000:3.0:1763334958.056277:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4364 00000100:00080000:3.0:1763334958.056333:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1763334958.056339:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1763334958.056361:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763334958.056369:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.056387:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334958.056392:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.056402:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498086 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.056422:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498086 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.056428:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498086 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.056446:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334958.056449:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849808d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.056455:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334958.056458:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849808d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.056465:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849808d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.056478:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849808d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.056484:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849808d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.056494:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334958.056496:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334958.056497:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334958.056544:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1fd880/2, rc 0, transno 17179870885 00000100:00100000:3.0:1763334958.056555:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701769728:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334958.056608:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b7800/2, rc 0, transno 21474838170 00000100:00100000:3.0:1763334958.056614:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701770240:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334958.056625:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5b01f2c000/2, rc 0, transno 17179870884 00000100:00100000:3.0:1763334958.056628:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701769600:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763334958.056637:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b4700/2, rc 0, transno 21474838169 00000100:00100000:3.0:1763334958.056640:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701770112:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763334958.056671:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1fc700/2, rc 0, transno 17179870883 00000100:00100000:3.0:1763334958.056675:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701769856:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334958.056685:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b6680/2, rc 0, transno 21474838168 00000100:00100000:3.0:1763334958.056687:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701770368:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334958.064073:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.065841:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.065867:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.065922:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00080000:1.0:1763334958.066352:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763334958.066600:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694261632 00000100:00100000:3.0:1763334958.066605:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694261632 00010000:00010000:3.0:1763334958.066636:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8497e72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec16 expref: 37 pid: 32241 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334958.066666:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2325 00000100:00100000:3.0:1763334958.066673:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2362:x1848989694261632:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334958.066685:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334958.066691:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8497e72 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec16 expref: 37 pid: 32241 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334958.066704:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8497e72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec16 expref: 37 pid: 32241 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334958.066727:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8497e72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec16 expref: 37 pid: 32241 timeout: 1122 lvb_type: 0 00010000:00010000:3.0:1763334958.066742:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334958.066744:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334958.066749:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.066760:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498078 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.066781:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1763334958.066828:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763334958.067224:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2362:x1848989694261632:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 550us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334958.067232:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2325 00010000:00010000:3.0:1763334958.067262:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.067278:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.067292:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498078 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.067301:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.067328:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763334958.067676:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+62:3291:x1848989701769472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12849us (13877us total) trans 17179870886 rc 0/0 00000100:00100000:3.0:1763334958.067685:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4359 00000004:00080000:3.0:1763334958.067744:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca872d80/2, rc 0, transno 17179870886 00000100:00100000:3.0:1763334958.067751:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca872d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701769472:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763334958.067984:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763334958.067995:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.068006:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334958.068011:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.068022:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498078 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.068042:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498078 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.068056:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498078 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.068079:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334958.068084:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849807f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.068090:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334958.068094:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849807f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.068101:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849807f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.068111:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849807f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.068124:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849807f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.068139:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334958.068140:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334958.068143:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334958.068326:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b7100/2, rc 0, transno 21474838171 00000100:00100000:3.0:1763334958.068333:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701769984:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334958.071231:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.072028:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.072198:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694262400 00000100:00100000:3.0:1763334958.072203:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694262400 00010000:00010000:3.0:1763334958.072232:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8497ffa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec94 expref: 16 pid: 32241 timeout: 1122 lvb_type: 1 00000100:00100000:3.0:1763334958.072961:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2327 00000100:00100000:3.0:1763334958.072971:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694262400:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334958.072986:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334958.072994:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8497ffa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec94 expref: 16 pid: 32241 timeout: 1122 lvb_type: 1 00010000:00010000:3.0:1763334958.073007:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8497ffa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec94 expref: 16 pid: 32241 timeout: 1122 lvb_type: 1 00010000:00010000:3.0:1763334958.073034:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8497ffa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aec94 expref: 16 pid: 32241 timeout: 1122 lvb_type: 1 00010000:00010000:3.0:1763334958.073050:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334958.073053:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334958.073061:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498094 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecc5 expref: 15 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.073072:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498094 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecc5 expref: 15 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.073119:0:11727:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498094 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecc5 expref: 15 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334958.073137:0:11727:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e14380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11727:1848989701770880:192.168.201.60@tcp:105: 00000100:00100000:3.0:1763334958.073244:0:11727:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeddc000 going to sleep for 11 seconds 00000100:00100000:1.0:1763334958.076758:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.076894:0:11727:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e14380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11727:1848989701770880:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334958.076925:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334958.076987:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694262400:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4016us (4961us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334958.077001:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2327 00000100:00100000:3.0:1763334958.080243:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.080390:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.082039:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1651 00000100:00100000:3.0:1763334958.082051:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2359:x1848989694262784:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334958.082348:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x200:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334958.082353:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x200:0x0] updating lvb mtime from disk: 0 -> 1763334958 00002000:00010000:3.0:1763334958.082356:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x200:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334958.082359:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x200:0x0] updating lvb ctime from disk: 0 -> 1763334958 00002000:00010000:3.0:1763334958.082361:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x200:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334958.082457:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+38:2359:x1848989694262784:12345-192.168.201.60@tcp:10:bash.0 Request processed in 409us (2065us total) trans 17179870887 rc 0/0 00000100:00100000:3.0:1763334958.082467:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1651 00002000:00010000:3.0:1763334958.082472:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/512 (0->18446744073709551615) 00002000:00100000:3.0:1763334958.082475:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e17100 with x1848989694262784 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334958.082481:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac7e17100. 00000100:00100000:1.0:1763334958.086466:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.096992:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.097040:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.097651:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4160 00000100:00100000:3.0:1763334958.097662:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52935:x1848989694263552:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:3.0:1763334958.097696:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763334958.097717:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f84980b0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeccc expref: 166 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.097740:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498071 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x171:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecbe expref: 166 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.097758:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498040 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x171:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecb0 expref: 165 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.097768:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x171:0x0].0x0 (ffff9a5ac63d5900) 00010000:00010000:3.0:1763334958.097774:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334958.097789:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84980d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.097798:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84980d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.097806:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84980d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.097820:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84980da lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.097827:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84980da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.097833:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84980da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.097968:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84980e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x171:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.097978:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84980c5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x171:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecda expref: 163 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.097986:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84980e1 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x171:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.098843:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84980c5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x171:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecda expref: 163 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.098863:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84980c5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x171:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecda expref: 163 pid: 32232 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334958.098878:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701771008:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334958.098962:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeddcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334958.101046:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.103282:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334958.109169:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067000/0xcedf0054f84980ef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.109193:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067000/0xcedf0054f84980ef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334958.109269:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x171:0x0]: returning size 5 00000004:00200000:1.0:1763334958.109275:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334958.109317:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067000/0xcedf0054f84980ef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.109390:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84980e8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x171:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aece1 expref: 166 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.109421:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067000/0xcedf0054f84980ef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x171:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aece1 expref: 165 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.109432:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x171:0x0].0x0 (ffff9a5ac63d5900) 00010000:00010000:1.0:1763334958.109436:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334958.109440:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067000, rc 0) 00000100:00100000:1.0:1763334958.109556:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52934:x1848989694263680:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 8233us (8519us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334958.109567:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4161 00000100:00100000:3.0:1763334958.118631:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.118695:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694264064 00000100:00100000:1.0:1763334958.118709:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694264064 00000100:00100000:1.0:1763334958.118783:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1540 00000100:00100000:1.0:1763334958.118794:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+164:52934:x1848989694264064:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:1.0:1763334958.119307:0:30956:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x171:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763334958.119524:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].947, 64 off82224 00000040:00080000:1.0:1763334958.119635:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].958, 64 off83288 00000040:00080000:1.0:1763334958.119653:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].959, 64 off83352 00000040:00080000:1.0:1763334958.119667:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].948, 64 off82288 00010000:00010000:1.0:1763334958.119765:0:30956:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84980f6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x171:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334958.119788:0:30956:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84980f6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334958.119802:0:30956:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84980f6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334958.119818:0:30956:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84980f6 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334958.119826:0:30956:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84980f6 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334958.119832:0:30956:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84980f6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334958.119860:0:30956:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334958.120051:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52934:x1848989694264064:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1255us (1431us total) trans 8589938439 rc 0/0 00000100:00100000:1.0:1763334958.120063:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1540 00010000:00010000:3.0:1763334958.120409:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334958.120419:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84980f6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30956 initiator: MDT0 00010000:00010000:3.0:1763334958.120428:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334958.120433:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84980f6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30956 initiator: MDT0 00010000:00010000:3.0:1763334958.120442:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84980f6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 30956 initiator: MDT0 00010000:00010000:3.0:1763334958.120460:0:8205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x171:0x0].0x0 (ffff9a5ac63d5900) 00010000:00010000:3.0:1763334958.120463:0:8205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763334958.120468:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84980f6 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 30956 initiator: MDT0 00010000:00010000:3.0:1763334958.120473:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84980f6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x171:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 30956 initiator: MDT0 00010000:00010000:3.0:1763334958.120487:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334958.120489:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334958.120492:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334958.122816:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.131416:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.134681:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.141744:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.141862:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694264832 00000100:00100000:1.0:1763334958.141877:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694264832 00000100:00100000:1.0:1763334958.141941:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4166 00000100:00100000:1.0:1763334958.141954:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52936:x1848989694264832:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334958.141986:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334958.141990:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334958.142028:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498143 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aecfd expref: 166 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.142051:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334958.142058:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334958.142074:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849814a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aed04 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.142234:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498151 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.142249:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498151 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.142272:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498151 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.142289:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498158 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.142296:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498158 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.142303:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498158 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.142971:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849815f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.142985:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849815f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.142995:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849815f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:1.0:1763334958.143007:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x172:0x0]: returning size 0 00010000:00010000:1.0:1763334958.143044:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498151 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.143051:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498151 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.143058:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498151 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.143065:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168ee00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.143071:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498151 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.143080:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498151 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.143089:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334958.143092:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334958.143095:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498151 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.143101:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498151 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000004:00010000:1.0:1763334958.143116:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d404f13c reply state 000000009dcf2f3b transno 8589938440 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498158 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:1.0:1763334958.143125:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763334958.143163:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849814a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed04 expref: 168 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.143178:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849815f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed04 expref: 167 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.143186:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40a00) 00010000:00010000:1.0:1763334958.143189:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334958.143191:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fc00, rc 0) 00000100:00100000:1.0:1763334958.143288:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52936:x1848989694264832:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1337us (1559us total) trans 8589938440 rc 0/0 00000100:00100000:1.0:1763334958.143299:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4166 00010000:00010000:1.0:1763334958.148924:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498158 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.148948:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498158 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.148956:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498158 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.148962:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.148968:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498158 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.148978:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498158 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.149001:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5adaf40000) 00010000:00010000:1.0:1763334958.149005:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334958.149010:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498158 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.149023:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498158 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334958.149664:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.153515:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6ecae40 going to sleep for 11 seconds 00000100:00100000:3.0:1763334958.159784:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.159964:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5574a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701771136:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334958.160000:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498174 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.161035:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498174 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.161043:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498174 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334958.161070:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x172:0x0]: returning size 0 00000004:00080000:1.0:1763334958.161620:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x202:0x0], index 1: 0 00000004:00080000:1.0:1763334958.161635:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1fe:0x0], index 0: 0 00000004:00080000:1.0:1763334958.161644:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1ff:0x0], index 0: 0 00000004:00080000:1.0:1763334958.161651:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x203:0x0], index 1: 0 00010000:00010000:1.0:1763334958.161848:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498174 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.161859:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498174 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.161866:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498174 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.161873:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.161878:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498174 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.161887:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498174 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.161900:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40a00) 00010000:00010000:1.0:1763334958.161904:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334958.161909:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498174 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.161915:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498174 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.161985:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f849816d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed0b expref: 168 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.161997:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334958.161999:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334958.162003:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f849816d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed0b expref: 168 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.162013:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793600, rc 0) 00000100:00100000:1.0:1763334958.162070:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52936:x1848989694265088:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 11567us (12413us total) trans 8589938441 rc 301/301 00000100:00100000:1.0:1763334958.162080:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4167 00000100:00100000:3.0:1763334958.165015:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.168145:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.168411:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694265728 00000100:00100000:1.0:1763334958.168425:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694265728 00000100:00100000:1.0:1763334958.168501:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1542 00000100:00100000:1.0:1763334958.168514:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52936:x1848989694265728:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334958.168855:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52936:x1848989694265728:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 343us (723us total) trans 8589938443 rc 0/0 00000100:00100000:1.0:1763334958.168865:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1542 00000100:00100000:1.0:1763334958.173340:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694265984 00000100:00100000:1.0:1763334958.173355:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694265984 00000100:00100000:1.0:1763334958.173445:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4168 00000100:00100000:1.0:1763334958.173458:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52937:x1848989694265984:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334958.173489:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334958.173519:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498182 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aed12 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.173650:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8498189 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.173667:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8498189 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.173680:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8498189 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.173696:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498190 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.173703:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498190 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.173709:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498190 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.173885:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8498197 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.173893:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8498197 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.173901:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8498197 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334958.173913:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x172:0x0]: returning size 0 00010000:00010000:1.0:1763334958.174042:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8498189 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174051:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8498189 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174058:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8498189 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174064:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.174070:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8498189 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174078:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8498189 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174091:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334958.174095:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334958.174101:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8498189 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174108:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8498189 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174124:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498190 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174130:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498190 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174141:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498190 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174146:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168ee00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.174149:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498190 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174155:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498190 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174162:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5adaf40a00) 00010000:00010000:1.0:1763334958.174165:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334958.174168:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498190 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174174:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8498190 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.174225:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498182 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed12 expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.174241:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8498197 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed12 expref: 171 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.174250:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:1.0:1763334958.174252:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334958.174255:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fc00, rc 0) 00000100:00100000:1.0:1763334958.174348:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52937:x1848989694265984:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 891us (1196us total) trans 8589938444 rc 0/0 00000100:00100000:1.0:1763334958.174358:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4168 00000100:00100000:3.0:1763334958.186234:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.195016:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694267136 00000100:00100000:3.0:1763334958.195023:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694267136 00000100:00100000:3.0:1763334958.195085:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4170 00000100:00100000:3.0:1763334958.195095:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52937:x1848989694267136:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334958.195122:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.195149:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f84981c1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aed2e expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.195427:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84981c8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.195444:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84981c8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.195457:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84981c8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.195474:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84981cf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.195482:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84981cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.195489:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84981cf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.195696:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84981d6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.196548:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84981d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.196559:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84981d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334958.196653:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x172:0x0]: returning size 0 00010000:00010000:1.0:1763334958.200678:0:29629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84981ba lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x172:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.200702:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84981ba lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x172:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:1.0:1763334958.200734:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x172:0x0]: returning size 0 00010000:00010000:1.0:1763334958.200984:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84981b3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed19 expref: 176 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.201011:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84981ba lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x172:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed19 expref: 175 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.201021:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:1.0:1763334958.201025:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334958.201029:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:1.0:1763334958.201130:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52274:x1848989694266240:12345-192.168.201.60@tcp:101:bash.0 Request processed in 18713us (20012us total) trans 8589938447 rc 0/0 00000100:00100000:1.0:1763334958.201140:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4169 00000100:00100000:1.0:1763334958.211801:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694267648 00000100:00100000:1.0:1763334958.211823:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694267648 00000100:00100000:1.0:1763334958.211906:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4171 00000100:00100000:1.0:1763334958.211920:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52937:x1848989694267648:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334958.211956:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334958.211984:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84981eb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aed35 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.212093:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84981f2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.212116:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84981f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.212129:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84981f2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.212145:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84981f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.212152:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84981f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.212159:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84981f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334958.212391:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.220307:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694268032 00000100:00100000:1.0:1763334958.220329:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694268032 00000100:00100000:1.0:1763334958.220434:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4173 00000100:00100000:1.0:1763334958.220447:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52274:x1848989694268032:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334958.220482:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334958.220511:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498215 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aed3c expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.220628:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498215 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed3c expref: 180 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.220644:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498215 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed3c expref: 180 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.220664:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:1.0:1763334958.220669:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334958.220671:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f800, rc 0) 00000100:00100000:1.0:1763334958.220753:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52274:x1848989694268032:12345-192.168.201.60@tcp:101:bash.0 Request processed in 308us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334958.220760:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4173 00000100:00100000:1.0:1763334958.223821:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.225895:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694268544 00000100:00100000:3.0:1763334958.225908:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694268544 00000100:00100000:3.0:1763334958.226606:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4174 00000100:00100000:3.0:1763334958.226626:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52274:x1848989694268544:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334958.226654:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.226658:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334958.226694:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498215 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed3c expref: 181 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.226720:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:3.0:1763334958.226726:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334958.226746:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f849821c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aed43 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.226817:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498223 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.226835:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498207 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed35 expref: 181 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.226851:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498223 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.226896:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498207 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed35 expref: 181 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.226912:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498207 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed35 expref: 181 pid: 29629 timeout: 1122 lvb_type: 0 00000100:00100000:3.0:1763334958.226931:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701771392:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334958.227054:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeddcd80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334958.232396:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701771392:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334958.232442:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498223 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334958.232868:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694268672 00000100:00100000:1.0:1763334958.232880:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694268672 00000100:00100000:1.0:1763334958.232944:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1546 00000100:00100000:1.0:1763334958.232956:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52937:x1848989694268672:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:1.0:1763334958.233172:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52937:x1848989694268672:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 216us (2963us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334958.233181:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1546 00000100:00100000:3.0:1763334958.233427:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.234050:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694268800 00000100:00100000:1.0:1763334958.234060:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694268800 00010000:00010000:1.0:1763334958.234095:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498207 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed35 expref: 182 pid: 29629 timeout: 1122 lvb_type: 0 00000100:00100000:1.0:1763334958.234748:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2331 00000100:00100000:1.0:1763334958.234765:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2360:x1848989694268800:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334958.234783:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334958.234793:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498207 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed35 expref: 182 pid: 29629 timeout: 1122 lvb_type: 0 00010000:00010000:1.0:1763334958.234809:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498207 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed35 expref: 182 pid: 29629 timeout: 1122 lvb_type: 0 00010000:00010000:1.0:1763334958.234842:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498207 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed35 expref: 182 pid: 29629 timeout: 1122 lvb_type: 0 00010000:00010000:1.0:1763334958.234862:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:1.0:1763334958.234868:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498223 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.234880:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498223 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.234888:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498223 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.235462:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334958.236730:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:2360:x1848989694268800:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1961us (3295us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334958.236745:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2331 00000100:00100000:1.0:1763334958.266990:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694269056 00000100:00100000:1.0:1763334958.267004:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694269056 00000100:00100000:1.0:1763334958.267073:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4175 00000100:00100000:1.0:1763334958.267084:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52938:x1848989694269056:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334958.267110:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334958.267137:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849822a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aed4a expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.267235:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498231 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.268453:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498231 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.268481:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498231 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.268507:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498238 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.268516:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498238 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.268522:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498238 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.268737:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849823f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.268748:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849823f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.268756:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849823f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:1.0:1763334958.268769:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x172:0x0]: returning size 2 00010000:00010000:1.0:1763334958.268960:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849823f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.268969:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849823f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.268976:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849823f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.268982:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.268987:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849823f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.268996:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849823f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269010:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:1.0:1763334958.269013:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1763334958.269019:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849823f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269025:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849823f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269045:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498231 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269051:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498231 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269057:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498231 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269062:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.269064:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498231 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269071:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498231 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269077:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334958.269080:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334958.269083:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498231 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269089:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8498231 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269097:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498238 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269103:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498238 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269108:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498238 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269112:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.269115:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498238 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269120:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498238 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269126:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5adaf40800) 00010000:00010000:1.0:1763334958.269129:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334958.269131:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498238 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269136:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8498238 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.269195:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849822a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed4a expref: 184 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.269207:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334958.269209:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334958.269212:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849822a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed4a expref: 184 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.269229:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f600, rc 0) 00000100:00100000:1.0:1763334958.269360:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52938:x1848989694269056:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2275us (2627us total) trans 8589938454 rc 301/301 00000100:00100000:1.0:1763334958.269383:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4175 00000100:00100000:3.0:1763334958.290593:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.293645:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694269312 00000100:00100000:1.0:1763334958.293654:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694269312 00010000:00010000:1.0:1763334958.293686:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84981ba lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x172:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed19 expref: 164 pid: 29629 timeout: 1122 lvb_type: 0 00000100:00100000:1.0:1763334958.293716:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2332 00000100:00100000:1.0:1763334958.293724:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+164:2360:x1848989694269312:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334958.293738:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334958.293745:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84981ba lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x172:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed19 expref: 164 pid: 29629 timeout: 1122 lvb_type: 0 00010000:00010000:1.0:1763334958.293756:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84981ba lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x172:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed19 expref: 164 pid: 29629 timeout: 1122 lvb_type: 0 00010000:00010000:1.0:1763334958.293771:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84981ba lrc: 0/0,0 mode: --/CW res: [0x200000404:0x172:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed19 expref: 164 pid: 29629 timeout: 1122 lvb_type: 0 00010000:00010000:1.0:1763334958.293783:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:1.0:1763334958.293787:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498254 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.293796:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498254 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.293806:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498254 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.293837:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334958.293863:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+163:2360:x1848989694269312:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 140us (3305us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334958.293869:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2332 00010000:00010000:3.0:1763334958.294743:0:29629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498254 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.294757:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498254 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334958.294807:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x172:0x0]: returning size 2 00000004:00200000:3.0:1763334958.294813:0:29629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334958.294835:0:29629:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498254 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.294873:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f849824d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x172:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed51 expref: 163 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.294893:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498254 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed51 expref: 162 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.294902:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:3.0:1763334958.294905:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334958.294908:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:3.0:1763334958.294969:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+162:52938:x1848989694269184:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 14506us (15339us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334958.294978:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4176 00000100:00100000:1.0:1763334958.296636:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701772416:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334958.296686:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701772288:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334958.302766:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701772544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334958.303287:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701772672 00000100:00100000:3.0:1763334958.303302:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701772672 00000100:00100000:3.0:1763334958.303395:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4373 00000100:00100000:3.0:1763334958.303409:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+62:3291:x1848989701772672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334958.303738:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334958.303743:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763334958.303746:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334958.303748:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763334958.303751:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334958.303815:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+63:3291:x1848989701772672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 409us (7640us total) trans 17179870888 rc 0/0 00000100:00100000:3.0:1763334958.303823:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4373 00000100:00100000:1.0:1763334958.304173:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.304208:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.306909:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.308673:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694269440 00000100:00100000:3.0:1763334958.308691:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694269440 00000100:00100000:3.0:1763334958.308775:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4177 00000100:00100000:3.0:1763334958.308785:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+162:52938:x1848989694269440:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334958.308817:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.308848:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498277 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aed58 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.308939:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498277 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed58 expref: 163 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.308957:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498277 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed58 expref: 163 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.308980:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:3.0:1763334958.308984:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334958.308989:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9a00, rc 0) 00000100:00100000:3.0:1763334958.309083:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52938:x1848989694269440:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 299us (4914us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334958.309091:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4177 00000004:00080000:1.0:1763334958.310359:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afc8c0000/2, rc 0, transno 17179870890 00000100:00100000:1.0:1763334958.310378:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701772544:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334958.314508:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334958.315324:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f8498270 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.315334:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f8498270 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.315346:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f8498270 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.315361:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f8498270 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.315397:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334958.315849:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3292:x1848989701772288:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9946us (10010us total) trans 17179870891 rc 0/0 00000100:00100000:1.0:1763334958.315861:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4375 00000100:00100000:3.0:1763334958.317023:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.318696:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.318841:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.321747:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.323083:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1653 00000100:00100000:1.0:1763334958.323094:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694270592:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334958.323307:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1fe:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334958.323310:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1fe:0x0] updating lvb mtime from disk: 0 -> 1763334958 00002000:00010000:1.0:1763334958.323312:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1fe:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334958.323313:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1fe:0x0] updating lvb ctime from disk: 0 -> 1763334958 00002000:00010000:1.0:1763334958.323315:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1fe:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334958.323338:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694270592:12345-192.168.201.60@tcp:10:bash.0 Request processed in 247us (1254us total) trans 21474838177 rc 0/0 00000100:00100000:1.0:1763334958.323345:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1653 00002000:00010000:1.0:1763334958.323347:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/510 (0->18446744073709551615) 00002000:00100000:1.0:1763334958.323350:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa747800 with x1848989694270592 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334958.323354:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa747800. 00000100:00100000:1.0:1763334958.325956:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.327994:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.328048:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694270976 00000100:00100000:1.0:1763334958.328059:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694270976 00000100:00100000:1.0:1763334958.328117:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1548 00000100:00100000:1.0:1763334958.328133:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+164:52274:x1848989694270976:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:1.0:1763334958.328635:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52274:x1848989694270976:12345-192.168.201.60@tcp:35:bash.0 Request processed in 501us (641us total) trans 8589938456 rc 0/0 00000100:00100000:1.0:1763334958.328646:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1548 00000100:00100000:3.0:1763334958.334429:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.343727:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334958.344638:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84982d9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.344659:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84982c4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.344669:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84982d9 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.344695:0:30972:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84982c4 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.344709:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84982d9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.346066:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84982c4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.346076:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84982c4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.349331:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84982d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.349345:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84982d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334958.349410:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x172:0x0]: returning size 5 00000004:00200000:1.0:1763334958.349416:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334958.349439:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84982d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.349488:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84982d2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x172:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed7b expref: 167 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.349507:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84982d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed7b expref: 166 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.349514:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:1.0:1763334958.349517:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334958.349520:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168ee00, rc 0) 00000100:00100000:1.0:1763334958.350827:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52938:x1848989694271616:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6597us (7109us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334958.350842:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4181 00010000:00010000:3.0:1763334958.353384:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84982bd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.353408:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84982bd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.353419:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84982bd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.353426:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.353431:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84982bd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.353439:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84982bd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.353460:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cabf00) 00010000:00010000:3.0:1763334958.353464:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.353470:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84982bd lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.353477:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84982bd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334958.354946:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694272000 00000100:00100000:1.0:1763334958.354963:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694272000 00000100:00100000:1.0:1763334958.355397:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4182 00000100:00100000:1.0:1763334958.355410:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52938:x1848989694272000:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334958.355441:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334958.355469:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84982e0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aed82 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.355755:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84982e7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.355772:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84982e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x172:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.355785:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84982e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x172:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334958.355804:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x172:0x0]: returning size 5 00010000:00010000:1.0:1763334958.355959:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84982e0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x172:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed82 expref: 168 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.355977:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84982e7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x172:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed82 expref: 167 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.355986:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:1.0:1763334958.355988:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334958.355991:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168e200, rc 0) 00000100:00100000:1.0:1763334958.356682:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52938:x1848989694272000:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1271us (2380us total) trans 8589938459 rc 0/0 00000100:00100000:1.0:1763334958.356693:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4182 00000100:00100000:1.0:1763334958.358765:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.363427:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.367497:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.370279:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.373496:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.374666:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.392745:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.392828:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694273152 00000100:00100000:3.0:1763334958.392844:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694273152 00000100:00100000:3.0:1763334958.392928:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4187 00000100:00100000:3.0:1763334958.392943:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52940:x1848989694273152:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334958.392969:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.392998:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849833b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aed9e expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.393086:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498342 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393103:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498342 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393116:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498342 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393133:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498349 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393140:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498349 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393146:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498349 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393238:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498342 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393247:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498342 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393267:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498342 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393273:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.393278:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498342 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393286:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498342 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393301:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.393305:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.393311:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498342 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393317:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498342 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393332:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498349 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393339:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498349 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393344:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498349 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393349:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.393352:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498349 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393357:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498349 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393364:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32c00) 00010000:00010000:3.0:1763334958.393377:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.393381:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498349 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393386:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498349 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.393425:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849833b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed9e expref: 170 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.393437:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.393439:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.393443:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849833b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed9e expref: 170 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.393458:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8800, rc 0) 00000100:00100000:3.0:1763334958.393548:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52940:x1848989694273152:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 608us (818us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334958.393557:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4187 00000100:00100000:3.0:1763334958.402030:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.410823:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.416703:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334958.419339:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498365 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeda5 expref: 171 pid: 29627 timeout: 1123 lvb_type: 0 00000100:00100000:1.0:1763334958.419382:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701773312:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334958.419416:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f849837a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.419447:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f849837a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.419453:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f849837a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334958.419483:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x173:0x0]: returning size 0 00000004:00080000:1.0:1763334958.419915:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x200:0x0], index 0: 0 00000004:00080000:1.0:1763334958.419928:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x204:0x0], index 1: 0 00000004:00080000:1.0:1763334958.419935:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x205:0x0], index 1: 0 00000004:00080000:1.0:1763334958.419941:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x201:0x0], index 0: 0 00010000:00010000:1.0:1763334958.420135:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f849837a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.420145:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f849837a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.420154:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f849837a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.420160:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.420165:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f849837a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.420174:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f849837a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.420192:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x173:0x0].0x0 (ffff9a5ac51bd000) 00010000:00010000:1.0:1763334958.420196:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334958.420200:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f849837a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.420211:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f849837a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.420279:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498373 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedac expref: 171 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.420292:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334958.420294:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334958.420299:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498373 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedac expref: 171 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.420309:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:1.0:1763334958.420416:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52940:x1848989694273664:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 9222us (9607us total) trans 8589938462 rc 301/301 00000100:00100000:1.0:1763334958.420428:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4189 00000100:00100000:1.0:1763334958.430780:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000004:00010000:1.0:1763334958.444699:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003fd4e670 reply state 00000000d12a691c transno 8589938460 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498311 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334958.444716:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1763334958.444849:0:30972:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763334958.444867:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52938:x1848989694272768:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 71115us (71382us total) trans 8589938460 rc 0/0 00000100:00100000:1.0:1763334958.444876:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4184 00010000:00010000:3.0:1763334958.446395:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498311 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.446414:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498311 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.446422:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498311 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.446429:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.446434:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498311 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.446444:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498311 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.446464:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:3.0:1763334958.446467:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334958.446473:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498311 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.446480:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498311 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334958.447036:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.449089:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.449967:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4191 00000100:00100000:1.0:1763334958.449985:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52938:x1848989694274688:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334958.450019:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334958.450048:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84983ab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aedba expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.450124:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84983ab lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedba expref: 167 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.450335:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84983ab lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedba expref: 167 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.450360:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:1.0:1763334958.450364:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334958.450379:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fc00, rc 0) 00000100:00100000:1.0:1763334958.450672:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52938:x1848989694274688:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 691us (1587us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334958.450680:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4191 00000100:00100000:1.0:1763334958.452619:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694274944 00000100:00100000:1.0:1763334958.452633:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694274944 00000100:00100000:1.0:1763334958.452701:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4192 00000100:00100000:1.0:1763334958.452710:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52274:x1848989694274944:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1763334958.452791:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334958.452830:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849839d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedb3 expref: 167 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.452855:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x173:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334958.452865:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334958.453209:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84983b2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x173:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.453227:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84983b2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x173:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.453238:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84983b2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x173:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:1.0:1763334958.453306:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938466 00000004:00010000:1.0:1763334958.453332:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000da02e79d reply state 0000000026d2d0ae transno 8589938467 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84983b2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x173:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334958.453342:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334958.453478:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52274:x1848989694274944:12345-192.168.201.60@tcp:36:bash.0 Request processed in 766us (1006us total) trans 8589938467 rc 0/0 00000100:00100000:1.0:1763334958.453488:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4192 00000020:00080000:1.0:1763334958.453494:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763334958.464411:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694275072 00000100:00100000:1.0:1763334958.464427:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694275072 00000100:00100000:1.0:1763334958.464527:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4193 00000100:00100000:1.0:1763334958.464541:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52938:x1848989694275072:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334958.464569:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334958.464637:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84983b9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aedc1 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.464740:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f84983c0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.464758:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f84983c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.464770:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f84983c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334958.464824:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x172:0x0]: returning size 5 00000004:00200000:1.0:1763334958.464830:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334958.464853:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f84983c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.464886:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84983b9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x172:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedc1 expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.464909:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f84983c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedc1 expref: 170 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.464919:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:1.0:1763334958.464922:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763334958.464928:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f600, rc 0) 00000100:00100000:1.0:1763334958.465037:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52938:x1848989694275072:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 498us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334958.465046:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4193 00000100:00100000:3.0:1763334958.465498:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694275200 00000100:00100000:3.0:1763334958.465507:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694275200 00000100:00100000:3.0:1763334958.465555:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4194 00000100:00100000:3.0:1763334958.465565:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52274:x1848989694275200:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334958.465609:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.465626:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84983c7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x173:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aedc8 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.465680:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84983c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedc8 expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.467500:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84983c7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedc8 expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334958.468443:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.468906:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694275328 00000100:00100000:1.0:1763334958.468920:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694275328 00000100:00100000:1.0:1763334958.468989:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4384 00000100:00100000:1.0:1763334958.469000:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+41:2360:x1848989694275328:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334958.469021:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334958.469050:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f800/0xcedf0054f84983ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aedcf expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334958.469081:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x202:0x0] initial LVB size: 5, mtime: 0x691a5b2e, atime: 0x0, ctime: 0x691a5b2e, blocks: 0x1 00010000:00010000:1.0:1763334958.469106:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334958.469121:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334958.469134:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f800/0xcedf0054f84983ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedcf expref: 42 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334958.469154:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f800/0xcedf0054f84983ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedcf expref: 42 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334958.469167:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f800, rc 0) 00000100:00100000:1.0:1763334958.469220:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+42:2360:x1848989694275328:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 222us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334958.469227:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4384 00000100:00100000:3.0:1763334958.470028:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694275584 00000100:00100000:3.0:1763334958.470037:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694275584 00000100:00100000:3.0:1763334958.470096:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4195 00000100:00100000:3.0:1763334958.470107:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52274:x1848989694275584:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334958.470772:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.470776:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334958.470814:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84983c7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedc8 expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.470838:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x173:0x0].0x0 (ffff9a5adaf40800) 00010000:00010000:3.0:1763334958.470843:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334958.470860:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84983d5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x173:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aedd6 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.470924:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84983dc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x173:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.470938:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84983b2 lrc: 2/0,1 mode: PW/PW res: [0x200000404:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.470947:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84983dc lrc: 4/0,1 mode: --/EX res: [0x200000404:0x173:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.470969:0:30972:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84983b2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x173:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.470982:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84983dc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x173:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.474339:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84983dc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.474350:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84983dc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:3.0:1763334958.475032:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].953, 88 off82728 00000004:00080000:3.0:1763334958.475045:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1023108472345ns, next at 1023271286332ns, rc = 0 00000040:00080000:3.0:1763334958.475101:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].964, 88 off83792 00000004:00080000:3.0:1763334958.475106:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1023108534698ns, next at 1023271341422ns, rc = 0 00000040:00080000:3.0:1763334958.475162:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].965, 88 off83880 00000004:00080000:3.0:1763334958.475167:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1023108595673ns, next at 1023271341422ns, rc = 0 00000040:00080000:3.0:1763334958.475182:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].954, 88 off82816 00000004:00080000:3.0:1763334958.475186:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1023108614441ns, next at 1023271286332ns, rc = 0 00010000:00010000:1.0:1763334958.526527:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84983dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x173:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedd6 expref: 164 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.526545:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x173:0x0].0x0 (ffff9a5adaf40800) 00010000:00010000:1.0:1763334958.526549:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334958.526594:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84983d5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x173:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedd6 expref: 164 pid: 30972 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763334958.526620:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84983dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x173:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedd6 expref: 163 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.526664:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x173:0x0].0x0 (ffff9a5adaf40800) 00010000:00010000:1.0:1763334958.526667:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334958.526670:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8800, rc 0) 00000100:00100000:1.0:1763334958.526762:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52274:x1848989694275584:12345-192.168.201.60@tcp:101:bash.0 Request processed in 56656us (57206us total) trans 8589938468 rc 0/0 00000100:00100000:1.0:1763334958.526773:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4195 00000100:00100000:3.0:1763334958.535291:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.539939:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.549293:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694275968 00000100:00100000:3.0:1763334958.549307:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694275968 00000100:00100000:3.0:1763334958.549389:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4196 00000100:00100000:3.0:1763334958.549446:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+163:52938:x1848989694275968:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334958.549480:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.549509:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84983f1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aede4 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.549549:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84983f8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.549567:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84983f8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.549619:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84983f8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.549754:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84983f1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x172:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aede4 expref: 165 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.549778:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8e00/0xcedf0054f84983f8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x172:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aede4 expref: 164 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.549788:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:3.0:1763334958.549792:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763334958.549797:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8e00, rc 0) 00000100:00100000:3.0:1763334958.549868:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+164:52938:x1848989694275968:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 468us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334958.549875:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4196 00000100:00100000:3.0:1763334958.562376:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.562425:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.562450:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694276096 00000100:00100000:3.0:1763334958.562452:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694276224 00000100:00100000:3.0:1763334958.562463:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694276224 00000100:00100000:1.0:1763334958.562463:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694276096 00000100:00100000:3.0:1763334958.562538:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4390 00000100:00100000:1.0:1763334958.562539:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1655 00000100:00100000:3.0:1763334958.562549:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+42:52274:x1848989694276224:12345-192.168.201.60@tcp:101:bash.0 00000100:00100000:1.0:1763334958.562549:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694276096:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:3.0:1763334958.562566:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.562612:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498406 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aedeb expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.562612:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84983ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.562636:0:6522:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84981a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed20 expref: 19 pid: 21625 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1763334958.562644:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x204:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334958.562644:0:6522:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334958.562647:0:6522:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334958.562651:0:6522:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84983ff lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.562658:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334958.562660:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334958.562668:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498406 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedeb expref: 43 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.562683:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498406 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedeb expref: 43 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.562696:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9e00, rc 0) 00010000:00010000:1.0:1763334958.562701:0:6522:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84981a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed20 expref: 19 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334958.562715:0:6522:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84981a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed20 expref: 19 pid: 21625 timeout: 1123 lvb_type: 1 00000100:00100000:1.0:1763334958.562731:0:6522:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:6522:1848989701774464:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334958.562761:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+43:52274:x1848989694276224:12345-192.168.201.60@tcp:101:bash.0 Request processed in 214us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334958.562775:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4390 00000100:00100000:1.0:1763334958.562813:0:6522:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeddcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334958.573076:0:6522:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:6522:1848989701774464:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334958.573113:0:6522:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84983ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334958.575612:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.575659:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.575744:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694276480 00000100:00100000:3.0:1763334958.575760:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694276480 00002000:00010000:3.0:1763334958.575820:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/516 (0->18446744073709551615) 00002000:00100000:3.0:1763334958.575826:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e4000 with x1848989694276480 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334958.575841:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c39e4000. 00000100:00100000:1.0:1763334958.577990:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1657 00000100:00100000:1.0:1763334958.578014:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+43:2360:x1848989694276480:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334958.578487:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x204:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334958.578492:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x204:0x0] updating lvb mtime from disk: 0 -> 1763334959 00002000:00010000:1.0:1763334958.578494:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x204:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334958.578497:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x204:0x0] updating lvb ctime from disk: 0 -> 1763334959 00002000:00010000:1.0:1763334958.578499:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x204:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334958.578617:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+44:2360:x1848989694276480:12345-192.168.201.60@tcp:10:bash.0 Request processed in 612us (3040us total) trans 17179870898 rc 0/0 00000100:00100000:1.0:1763334958.578627:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1657 00002000:00010000:1.0:1763334958.578634:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/516 (0->18446744073709551615) 00002000:00100000:1.0:1763334958.578638:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e4000 with x1848989694276480 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334958.578648:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c39e4000. 00000001:00080000:3.0:1763334958.639849:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838181 is committed 00000001:00080000:3.0:1763334958.639902:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838162 is committed 00000001:00080000:3.0:1763334958.639938:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838183 is committed 00000100:00100000:3.0:1763334958.660613:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694276992 00000100:00100000:3.0:1763334958.660627:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694276992 00000100:00100000:3.0:1763334958.660711:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4197 00000100:00100000:3.0:1763334958.660723:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52941:x1848989694276992:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:3.0:1763334958.660754:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.660782:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849840d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aedf2 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.660875:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498414 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.660891:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498414 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.660904:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498414 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.660919:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f849841b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.660925:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f849841b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.660931:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f849841b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661078:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498422 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x173:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661085:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498422 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x173:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661097:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498422 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x173:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334958.661139:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x173:0x0]: returning size 5 00000004:00200000:3.0:1763334958.661144:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334958.661167:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498422 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x173:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661179:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498422 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661188:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498414 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661194:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498414 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661200:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498414 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661205:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.661209:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498414 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661217:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498414 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661229:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.661233:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.661237:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498414 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661243:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498414 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661257:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f849841b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661262:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f849841b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661266:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f849841b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661270:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.661272:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f849841b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661277:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f849841b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661283:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32b00) 00010000:00010000:3.0:1763334958.661285:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.661288:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f849841b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661293:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f849841b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.661322:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849840d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedf2 expref: 167 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.661335:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498422 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedf2 expref: 166 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.661343:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x173:0x0].0x0 (ffff9a5adaf40800) 00010000:00010000:3.0:1763334958.661345:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334958.661348:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8a00, rc 0) 00000100:00100000:3.0:1763334958.661444:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52941:x1848989694276992:12345-192.168.201.60@tcp:101:rm.0 Request processed in 722us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334958.661452:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4197 00000100:00100000:1.0:1763334958.668904:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.669359:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694277248 00000100:00100000:3.0:1763334958.669384:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694277248 00000100:00100000:3.0:1763334958.669732:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4198 00000100:00100000:3.0:1763334958.669747:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52941:x1848989694277248:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:3.0:1763334958.669823:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1763334958.669862:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498422 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x173:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedf2 expref: 166 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.669888:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84983dc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x173:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedd6 expref: 165 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.669899:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x173:0x0].0x0 (ffff9a5adaf40800) 00010000:00010000:3.0:1763334958.669912:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334958.669944:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498429 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.669960:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498429 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.669971:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498429 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.669987:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498430 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.669993:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498430 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.670000:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498430 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.670156:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498437 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x173:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.670165:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498437 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.670171:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498437 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:3.0:1763334958.672916:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].955, 64 off82880 00000004:00080000:3.0:1763334958.672929:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1023306356035ns, next at 1024306351965ns, rc = 0 00000040:00080000:3.0:1763334958.672982:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].966, 64 off83944 00000004:00080000:3.0:1763334958.672988:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1023306415745ns, next at 1024306414423ns, rc = 0 00000040:00080000:3.0:1763334958.673005:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].967, 64 off84008 00000040:00080000:3.0:1763334958.673021:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].956, 64 off82944 00010000:00010000:3.0:1763334958.673131:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849843e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x173:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.673153:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849843e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.673168:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849843e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.673178:0:30972:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849843e lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.673186:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849843e lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.673260:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849843e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.673290:0:30972:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334958.673330:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334958.673340:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849843e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.673348:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334958.673353:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849843e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.673370:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849843e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x173:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.673377:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498437 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.673387:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498437 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.673392:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498437 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.673751:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.673757:0:5736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x173:0x0].0x0 (ffff9a5ae1a32700) 00010000:00010000:1.0:1763334958.673763:0:5736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763334958.673767:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498437 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.673769:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849843e lrc: 1/0,0 mode: --/PW res: [0x200000404:0x173:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.673786:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498437 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x173:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.673787:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849843e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x173:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.673810:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x173:0x0].0x0 (ffff9a5ae1a32700) 00010000:00010000:1.0:1763334958.673814:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334958.673815:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763334958.673819:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334958.673822:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498437 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x173:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334958.673824:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334958.673832:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498437 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x173:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.677625:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498429 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.677639:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498429 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.677655:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498429 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.677662:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.677668:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498429 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.677678:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498429 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.677698:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.677701:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.677707:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498429 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.677714:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498429 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:3.0:1763334958.677727:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005c106680 reply state 00000000a88621c9 transno 8589938470 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498430 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334958.677738:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334958.677865:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52941:x1848989694277248:12345-192.168.201.60@tcp:36:rm.0 Request processed in 8115us (8968us total) trans 8589938470 rc 0/0 00000100:00100000:3.0:1763334958.677878:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4198 00000100:00100000:1.0:1763334958.684915:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334958.686092:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498430 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.686111:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498430 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.686121:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498430 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.686129:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.686135:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498430 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.686145:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498430 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.686167:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32b00) 00010000:00010000:3.0:1763334958.686170:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.686176:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498430 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334958.686182:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498430 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334958.690404:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.700131:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.704422:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.704462:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.704549:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694278272 00000100:00100000:3.0:1763334958.704563:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694278272 00002000:00010000:3.0:1763334958.704637:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/515 (0->18446744073709551615) 00002000:00100000:3.0:1763334958.704643:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeefe4380 with x1848989694278272 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334958.704657:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeefe4380. 00000100:00100000:3.0:1763334958.704681:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694278144 00000100:00100000:3.0:1763334958.704684:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694278144 00002000:00010000:3.0:1763334958.704695:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/511 (5->18446744073709551615) 00002000:00100000:3.0:1763334958.704699:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeefe5880 with x1848989694278144 ext(5->18446744073709551615) 00002000:00010000:3.0:1763334958.704705:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeefe5880. 00000100:00100000:3.0:1763334958.704732:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1658 00000100:00100000:3.0:1763334958.704742:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+45:2361:x1848989694278272:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:3.0:1763334958.705139:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334958.705143:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb mtime from disk: 0 -> 1763334959 00002000:00010000:3.0:1763334958.705147:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334958.705150:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb ctime from disk: 0 -> 1763334959 00002000:00010000:3.0:1763334958.705153:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334958.705187:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+45:2361:x1848989694278272:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 447us (780us total) trans 17179870899 rc 0/0 00000100:00100000:3.0:1763334958.705195:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1658 00002000:00010000:3.0:1763334958.705198:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/515 (0->18446744073709551615) 00002000:00100000:3.0:1763334958.705201:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeefe4380 with x1848989694278272 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334958.705205:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeefe4380. 00000100:00100000:1.0:1763334958.716488:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.716545:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.716731:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694278528 00000100:00100000:3.0:1763334958.716748:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694278528 00000100:00100000:3.0:1763334958.717350:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694278016 00000100:00100000:3.0:1763334958.717368:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694278016 00000100:00100000:1.0:1763334958.723049:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334958.723295:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849845a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x172:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.723312:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849845a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x172:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.723320:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849845a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x172:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.723327:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.723332:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849845a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x172:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.723341:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849845a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x172:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.723371:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:3.0:1763334958.723376:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.723382:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849845a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x172:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.723387:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849845a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x172:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334958.732116:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694278912 00000100:00100000:1.0:1763334958.732124:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694278912 00010000:00010000:1.0:1763334958.732159:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f800/0xcedf0054f84983ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedcf expref: 46 pid: 6517 timeout: 1123 lvb_type: 1 00000100:00100000:1.0:1763334958.732196:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2340 00000100:00100000:1.0:1763334958.732206:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+46:2360:x1848989694278912:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334958.732223:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334958.732249:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f800/0xcedf0054f84983ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedcf expref: 46 pid: 6517 timeout: 1123 lvb_type: 1 00010000:00010000:1.0:1763334958.732542:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f800/0xcedf0054f84983ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedcf expref: 46 pid: 6517 timeout: 1123 lvb_type: 1 00010000:00010000:1.0:1763334958.732597:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f800/0xcedf0054f84983ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedcf expref: 46 pid: 6517 timeout: 1123 lvb_type: 1 00010000:00010000:1.0:1763334958.732613:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334958.732616:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334958.732625:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067800/0xcedf0054f8498476 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee0e expref: 45 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.732636:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067800/0xcedf0054f8498476 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee0e expref: 45 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.732681:0:6532:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067800/0xcedf0054f8498476 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee0e expref: 45 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334958.732702:0:6532:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6532:1848989701774976:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334958.732782:0:6532:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7900 going to sleep for 11 seconds 00000100:00100000:1.0:1763334958.735116:0:6532:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6532:1848989701774976:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334958.735147:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334958.735224:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+45:2360:x1848989694278912:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 3016us (3512us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334958.735237:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2340 00000100:00100000:3.0:1763334958.736274:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694279040 00000100:00100000:3.0:1763334958.736288:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694279040 00000100:00100000:3.0:1763334958.736372:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4203 00000100:00100000:3.0:1763334958.736385:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52942:x1848989694279040:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334958.736412:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.736439:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498492 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee1c expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.736530:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498499 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.736548:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498499 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.736561:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498499 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334958.736679:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334958.736684:0:29629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334958.736710:0:29629:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498499 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.736742:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f8498492 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee1c expref: 168 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.736765:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498499 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee1c expref: 167 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.736779:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.736783:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334958.736787:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8200, rc 0) 00000100:00100000:3.0:1763334958.736846:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52942:x1848989694279040:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 464us (1863us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334958.736853:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4203 00000100:00100000:3.0:1763334958.742498:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694279552 00000100:00100000:3.0:1763334958.742504:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694279552 00000100:00100000:3.0:1763334958.742547:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4204 00000100:00100000:3.0:1763334958.742556:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52942:x1848989694279552:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334958.742567:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.742619:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84984a7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee23 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.742678:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84984ae lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742690:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84984ae lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742701:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84984ae lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742717:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984b5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742723:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742733:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742814:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84984ae lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742822:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84984ae lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742829:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84984ae lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742835:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.742840:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84984ae lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742848:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84984ae lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742859:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.742863:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.742868:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84984ae lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742873:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84984ae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742886:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742891:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984b5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742896:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742902:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.742904:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742910:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984b5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742918:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32b00) 00010000:00010000:3.0:1763334958.742920:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.742923:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984b5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742927:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984b5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.742962:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84984a7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee23 expref: 169 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.742970:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.742973:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.742977:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84984a7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee23 expref: 169 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.742986:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9a00, rc 0) 00000100:00100000:3.0:1763334958.743025:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52942:x1848989694279552:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 470us (1188us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334958.743032:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4204 00000100:00100000:3.0:1763334958.747500:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694279680 00000100:00100000:3.0:1763334958.747513:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694279680 00000100:00100000:1.0:1763334958.750728:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694279936 00000100:00100000:1.0:1763334958.750748:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694279936 00000100:00100000:1.0:1763334958.750821:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4205 00000100:00100000:1.0:1763334958.750832:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52942:x1848989694279936:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334958.750858:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334958.750862:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334958.750895:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498499 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee1c expref: 168 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.750920:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334958.750926:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334958.750946:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca227e00/0xcedf0054f84984bc lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee2a expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.751108:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226200/0xcedf0054f84984c3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.751122:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226200/0xcedf0054f84984c3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.751133:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226200/0xcedf0054f84984c3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.751150:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226400/0xcedf0054f84984ca lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.751156:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226400/0xcedf0054f84984ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.751163:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226400/0xcedf0054f84984ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.751882:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84984d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.751894:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84984d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.751904:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84984d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334958.751917:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x175:0x0]: returning size 0 00010000:00010000:1.0:1763334958.751950:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226200/0xcedf0054f84984c3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.751959:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226200/0xcedf0054f84984c3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.751967:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226200/0xcedf0054f84984c3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.751973:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59ca226200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.751978:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226200/0xcedf0054f84984c3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.751986:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226200/0xcedf0054f84984c3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.751995:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334958.751998:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334958.752002:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226200/0xcedf0054f84984c3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.752009:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226200/0xcedf0054f84984c3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:1.0:1763334958.752024:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ce8442d5 reply state 00000000cc553713 transno 8589938474 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226400/0xcedf0054f84984ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334958.752039:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763334958.752072:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca227e00/0xcedf0054f84984bc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee2a expref: 170 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.752088:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84984d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee2a expref: 169 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.752096:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x175:0x0].0x0 (ffff9a5ad2829300) 00010000:00010000:1.0:1763334958.752098:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334958.752100:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59ca226e00, rc 0) 00000100:00100000:1.0:1763334958.752199:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52942:x1848989694279936:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1368us (4374us total) trans 8589938474 rc 0/0 00000100:00100000:1.0:1763334958.752208:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4205 00000100:00100000:3.0:1763334958.758489:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694280192 00000100:00100000:3.0:1763334958.758504:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694280192 00000100:00100000:3.0:1763334958.758596:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4206 00000100:00100000:3.0:1763334958.758609:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52942:x1848989694280192:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334958.758638:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.758664:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84984df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee31 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.758795:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984e6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x175:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.758812:0:29629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84984d1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee2a expref: 171 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.758824:0:29629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984e6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x175:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.758865:0:29629:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84984d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee2a expref: 171 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.758880:0:29629:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84984d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee2a expref: 171 pid: 29627 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334958.758896:0:29629:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701775232:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334958.758998:0:29629:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b240 going to sleep for 11 seconds 00010000:00010000:1.0:1763334958.762303:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226400/0xcedf0054f84984ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.762329:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226400/0xcedf0054f84984ca lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.762338:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226400/0xcedf0054f84984ca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.762345:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59ca226400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.762351:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226400/0xcedf0054f84984ca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.762369:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226400/0xcedf0054f84984ca lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.762393:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829b00) 00010000:00010000:1.0:1763334958.762398:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334958.762403:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226400/0xcedf0054f84984ca lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334958.762409:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226400/0xcedf0054f84984ca lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334958.766603:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.766727:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694280320 00000100:00100000:3.0:1763334958.766741:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694280320 00010000:00010000:3.0:1763334958.766797:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84984d1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee2a expref: 171 pid: 29627 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334958.766856:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2342 00000100:00100000:3.0:1763334958.766867:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+171:2359:x1848989694280320:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334958.766885:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334958.766894:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84984d1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee2a expref: 171 pid: 29627 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334958.766910:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84984d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee2a expref: 171 pid: 29627 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334958.766938:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x175:0x0].0x0 (ffff9a5ad2829300) 00010000:00010000:3.0:1763334958.766944:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984e6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x175:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.766955:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984e6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x175:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.766964:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984e6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x175:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.766987:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334958.767068:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+171:2359:x1848989694280320:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 201us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334958.767077:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2342 00010000:00010000:3.0:1763334958.767155:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84984d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee2a expref: 170 pid: 29627 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334958.767181:0:29629:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3adf80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701775232:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334958.767209:0:29629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84984e6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x175:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:1.0:1763334958.774907:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.785513:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694280832 00000100:00100000:1.0:1763334958.785528:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694280832 00000100:00100000:1.0:1763334958.785625:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1554 00000100:00100000:1.0:1763334958.785638:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af646e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52942:x1848989694280832:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334958.785959:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af646e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52942:x1848989694280832:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 322us (546us total) trans 8589938477 rc 0/0 00000100:00100000:1.0:1763334958.785967:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1554 00000100:00100000:3.0:1763334958.808268:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694281088 00000100:00100000:3.0:1763334958.808290:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694281088 00000100:00100000:3.0:1763334958.808385:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4207 00000100:00100000:3.0:1763334958.808397:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52274:x1848989694281088:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334958.808432:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.808469:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84984f4 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee38 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.808745:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f84984fb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.808766:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f84984fb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.808781:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f84984fb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.808799:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498502 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.808805:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498502 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.808810:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498502 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.808897:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498509 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.808906:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498509 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.808914:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498509 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334958.808929:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x175:0x0]: returning size 0 00010000:00010000:3.0:1763334958.809122:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f84984fb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.809132:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f84984fb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.809143:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f84984fb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.809150:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.809156:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f84984fb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.809165:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f84984fb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.809180:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.809183:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.809191:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f84984fb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.809197:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f84984fb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.809211:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498502 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.809218:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498502 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.809228:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498502 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.809233:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.809236:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498502 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.809241:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498502 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.809248:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32b00) 00010000:00010000:3.0:1763334958.809251:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.809254:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498502 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.809259:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498502 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334958.815740:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334958.832017:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498517 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x175:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.832042:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498517 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x175:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.832052:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498517 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x175:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.832058:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.832064:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498517 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x175:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.832073:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498517 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x175:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.832096:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x175:0x0].0x0 (ffff9a5acb935700) 00010000:00010000:3.0:1763334958.832104:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.832111:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498517 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x175:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.832119:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498517 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x175:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334958.837542:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84984a0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334958.837560:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84984a0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334958.837594:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84984a0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334958.837602:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334958.837607:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84984a0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334958.837618:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84984a0 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334958.837642:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:1.0:1763334958.837645:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334958.837649:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84984a0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334958.837656:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84984a0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00000100:00100000:3.0:1763334958.837848:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeef9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701775744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334958.837907:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.837942:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763334958.837947:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701775360:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334958.837964:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.837986:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701775488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334958.838006:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.838023:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763334958.838028:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeef9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701775616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334958.838045:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.838077:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701775744 00000100:00100000:3.0:1763334958.838085:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701775744 00000100:00100000:3.0:1763334958.838128:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701775360 00000100:00100000:3.0:1763334958.838144:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701775360 00000100:00100000:3.0:1763334958.838165:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701775488 00000100:00100000:3.0:1763334958.838168:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701775488 00000100:00100000:3.0:1763334958.838184:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701775616 00000100:00100000:3.0:1763334958.838187:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701775616 00000100:00100000:3.0:1763334958.838207:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4395 00000100:00100000:3.0:1763334958.838217:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701775744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334958.838515:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1ff:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763334958.838519:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1ff:0x0] updating lvb mtime from disk: 1763334959 -> 1763334959 00002000:00010000:3.0:1763334958.838522:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1ff:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334958.838525:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1ff:0x0] updating lvb ctime from disk: 1763334959 -> 1763334959 00002000:00010000:3.0:1763334958.838527:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1ff:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1763334958.839525:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701776000:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334958.839634:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334958.839680:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763334958.839689:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701776128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334958.839719:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.841876:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701775744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3656us (3964us total) trans 21474838185 rc 0/0 00000100:00100000:3.0:1763334958.841888:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4395 00000100:00100000:3.0:1763334958.841925:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4398 00000100:00100000:3.0:1763334958.841937:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701775616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334958.842295:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x1fe:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334958.842300:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x1fe:0x0] updating lvb mtime from disk: 1763334958 -> 1763334958 00002000:00010000:3.0:1763334958.842311:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x1fe:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334958.842314:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x1fe:0x0] updating lvb ctime from disk: 1763334958 -> 1763334958 00002000:00010000:3.0:1763334958.842317:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x1fe:0x0] updating lvb blocks from disk: 1 -> 3 00010000:00010000:1.0:1763334958.842468:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334958.842477:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849852c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.842487:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334958.842491:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849852c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.842501:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849852c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.842521:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849852c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.842528:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849852c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.842546:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334958.842548:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334958.842550:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334958.845250:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701775616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3314us (7200us total) trans 21474838186 rc 0/0 00000100:00100000:3.0:1763334958.845261:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4398 00000100:00100000:3.0:1763334958.845280:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4400 00000100:00100000:3.0:1763334958.845289:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+73:3292:x1848989701775872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334958.845305:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:516 count 1 00010000:00010000:3.0:1763334958.845320:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.845337:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498406 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedeb expref: 45 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.845353:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334958.845354:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334958.845369:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.845410:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498406 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedeb expref: 45 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.845426:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498406 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedeb expref: 45 pid: 26216 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334958.845442:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeef9ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701776512:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334958.845542:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa8f1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334958.845611:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4402 00000100:00100000:3.0:1763334958.845622:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+73:3292:x1848989701776256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334958.847610:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334958.847623:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb mtime from disk: 1763334959 -> 1763334959 00002000:00010000:3.0:1763334958.847627:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334958.847629:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb ctime from disk: 1763334959 -> 1763334959 00002000:00010000:3.0:1763334958.847632:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x203:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334958.849200:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+74:3292:x1848989701776256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3577us (9463us total) trans 17179870903 rc 0/0 00000100:00100000:3.0:1763334958.849209:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4402 00000100:00100000:3.0:1763334958.849322:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4211 00000100:00100000:3.0:1763334958.849332:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52938:x1848989694281856:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334958.849349:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.849388:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f849854f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x172:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee4d expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.849429:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f849854f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee4d expref: 170 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.849443:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8c00/0xcedf0054f849854f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x172:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee4d expref: 170 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.849464:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:3.0:1763334958.849467:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334958.849471:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8c00, rc 0) 00000100:00100000:3.0:1763334958.849522:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52938:x1848989694281856:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 192us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334958.849533:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4211 00000004:00080000:3.0:1763334958.850499:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeef9f480/2, rc 0, transno 21474838185 00000100:00100000:3.0:1763334958.850507:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeef9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701775744:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334958.850548:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa5fb480/2, rc 0, transno 17179870903 00000004:00080000:1.0:1763334958.850723:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 4 in progress, 2 in flight, 26 done 00000100:00100000:3.0:1763334958.854383:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701776256:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334958.854562:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.854809:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.854843:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694281984 00000100:00100000:3.0:1763334958.854854:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694281984 00010000:00010000:3.0:1763334958.854907:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84983ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeddd expref: 13 pid: 26564 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334958.854953:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694282112 00000100:00100000:3.0:1763334958.854957:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694282112 00010000:00010000:3.0:1763334958.854974:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498406 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedeb expref: 46 pid: 26216 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334958.855008:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2343 00000100:00100000:3.0:1763334958.855020:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694281984:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334958.855044:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334958.855050:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84983ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeddd expref: 13 pid: 26564 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334958.855066:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84983ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeddd expref: 13 pid: 26564 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334958.855098:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84983ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x200:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeddd expref: 13 pid: 26564 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334958.855119:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334958.855121:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334958.855126:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498525 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.855137:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498525 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334958.855544:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2344 00000100:00100000:1.0:1763334958.855557:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+46:2360:x1848989694282112:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334958.855589:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334958.855596:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498406 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedeb expref: 46 pid: 26216 timeout: 1123 lvb_type: 0 00010000:00010000:1.0:1763334958.855608:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498406 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedeb expref: 46 pid: 26216 timeout: 1123 lvb_type: 0 00010000:00010000:1.0:1763334958.855623:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334958.855626:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334958.855629:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.855637:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.855654:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334958.855718:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+46:2360:x1848989694282112:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 164us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334958.855727:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2344 00010000:00010000:3.0:1763334958.856519:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334958.856589:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694281984:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1554us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334958.856600:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2343 00010000:00010000:3.0:1763334958.858842:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498406 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedeb expref: 45 pid: 26216 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334958.858863:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeef9ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701776512:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334958.858889:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.859072:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.859081:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.859092:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.859100:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.859125:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334958.859287:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334958.859298:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.859308:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334958.859312:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.859320:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.859340:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.859346:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849853a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.859375:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334958.859377:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334958.859380:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334958.862263:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+74:3292:x1848989701775872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16959us (22589us total) trans 17179870904 rc 0/0 00000100:00100000:3.0:1763334958.862277:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4400 00000004:00080000:3.0:1763334958.862347:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77d500/2, rc 0, transno 17179870904 00000100:00100000:3.0:1763334958.862373:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701775872:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763334958.867674:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334958.867699:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f8498556 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x172:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334958.867714:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334958.867721:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f8498556 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x172:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334958.867733:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f8498556 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x172:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334958.867757:0:8206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x172:0x0].0x0 (ffff9a5adaf40000) 00010000:00010000:3.0:1763334958.867761:0:8206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763334958.867768:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f8498556 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x172:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334958.867774:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793600/0xcedf0054f8498556 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x172:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334958.867791:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334958.867794:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334958.867796:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334958.870475:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694282624 00000100:00100000:3.0:1763334958.870489:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694282624 00000100:00100000:3.0:1763334958.870593:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4212 00000100:00100000:3.0:1763334958.870608:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52938:x1848989694282624:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334958.871491:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.871527:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849855d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee54 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.871683:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498564 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.871701:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498564 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.871715:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498564 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.871735:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849856b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.871744:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849856b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.871752:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849856b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.871945:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498572 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.871956:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498572 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.871964:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498572 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334958.871977:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x175:0x0]: returning size 2 00010000:00010000:3.0:1763334958.872109:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498572 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872118:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498572 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872131:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498572 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872138:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.872143:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498572 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872152:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498572 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872166:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x175:0x0].0x0 (ffff9a5acb935400) 00010000:00010000:3.0:1763334958.872169:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763334958.872175:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498572 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872181:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498572 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872199:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498564 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872205:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498564 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872211:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498564 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872215:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.872217:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498564 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872222:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498564 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872233:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.872235:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.872238:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498564 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872243:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498564 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872258:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849856b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872264:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849856b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872270:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849856b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872275:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.872278:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849856b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872284:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849856b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872291:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32b00) 00010000:00010000:3.0:1763334958.872293:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.872296:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849856b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872303:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849856b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.872392:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849855d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee54 expref: 174 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.872407:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.872411:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763334958.872415:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849855d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee54 expref: 174 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.872427:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8200, rc 0) 00000100:00100000:3.0:1763334958.872562:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52938:x1848989694282624:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1956us (2158us total) trans 8589938483 rc 301/301 00000100:00100000:3.0:1763334958.872633:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4212 00000100:00100000:3.0:1763334958.878194:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694282752 00000100:00100000:3.0:1763334958.878210:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694282752 00000100:00100000:3.0:1763334958.878287:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4213 00000100:00100000:3.0:1763334958.878299:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52938:x1848989694282752:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334958.878330:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.878368:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498580 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x175:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee5b expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.878813:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498587 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.878830:0:29629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498548 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x175:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.878841:0:29629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498587 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.878863:0:29629:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498548 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x175:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.878879:0:29629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498587 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.902858:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498548 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x175:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee46 expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.902881:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x175:0x0].0x0 (ffff9a5acb935400) 00010000:00010000:3.0:1763334958.902885:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334958.902890:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498587 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.902903:0:29627:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498587 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.902912:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498587 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.902979:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498541 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x175:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee46 expref: 174 pid: 29627 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763334958.903004:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498548 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x175:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee46 expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.903047:0:29629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498587 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.903057:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498587 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334958.903111:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x175:0x0]: returning size 2 00000004:00200000:3.0:1763334958.903117:0:29629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334958.903144:0:29629:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498587 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.903172:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498580 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x175:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee5b expref: 174 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.903187:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498587 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee5b expref: 173 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.903194:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x175:0x0].0x0 (ffff9a5acb935400) 00010000:00010000:3.0:1763334958.903198:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334958.903201:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8a00, rc 0) 00000100:00100000:3.0:1763334958.903319:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52938:x1848989694282752:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 25019us (25447us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334958.903332:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4213 00010000:00010000:3.0:1763334958.903398:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:3.0:1763334958.903434:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52274:x1848989694281728:12345-192.168.201.60@tcp:101:bash.0 Request processed in 54585us (54947us total) trans 8589938481 rc 0/0 00000100:00100000:3.0:1763334958.903442:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4210 00000100:00100000:1.0:1763334958.903870:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701776768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334958.903953:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763334958.906482:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeefe7800/2, rc 0, transno 17179870905 00000100:00100000:1.0:1763334958.906506:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701776768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334958.906519:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763334958.906530:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad88bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701776896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334958.906620:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334958.907637:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701776896 00000100:00100000:3.0:1763334958.907650:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701776896 00000100:00100000:3.0:1763334958.907810:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4406 00000100:00100000:3.0:1763334958.907821:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701776896:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334958.908976:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.909014:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.909306:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701776896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1485us (2684us total) trans 21474838190 rc 0/0 00000100:00100000:3.0:1763334958.909319:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4406 00000100:00100000:3.0:1763334958.909346:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694282880 00000100:00100000:3.0:1763334958.909351:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694282880 00000100:00100000:3.0:1763334958.909712:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694283008 00000100:00100000:3.0:1763334958.909716:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694283008 00000100:00100000:1.0:1763334958.909785:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4407 00000100:00100000:1.0:1763334958.909798:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+46:52274:x1848989694282880:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334958.909817:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334958.909846:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f849858e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee62 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334958.909878:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x206:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334958.909906:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334958.909909:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334958.909921:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f849858e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee62 expref: 47 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.909941:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f849858e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee62 expref: 47 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334958.909957:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abf400, rc 0) 00000100:00100000:1.0:1763334958.910008:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+47:52274:x1848989694282880:12345-192.168.201.60@tcp:101:bash.0 Request processed in 214us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334958.910015:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4407 00000100:00100000:1.0:1763334958.910031:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4408 00000100:00100000:1.0:1763334958.910037:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+46:2359:x1848989694283008:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334958.910043:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334958.910051:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abee00/0xcedf0054f8498595 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee69 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334958.910106:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701777152:192.168.201.60@tcp:106: 00000100:00100000:1.0:1763334958.910173:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7a80 going to sleep for 11 seconds 00002000:00010000:1.0:1763334958.917853:0:6518:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x206:0x0] updating lvb mtime: 0 -> 1763334959 00002000:00010000:1.0:1763334958.917859:0:6518:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x206:0x0] updating lvb atime: 0 -> 1763334959 00002000:00010000:1.0:1763334958.917861:0:6518:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x206:0x0] updating lvb ctime: 0 -> 1763334959 00000100:00100000:1.0:1763334958.917881:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701777152:192.168.201.60@tcp:106: 00010000:00010000:1.0:1763334958.917928:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abee00/0xcedf0054f8498595 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee69 expref: 47 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334958.917948:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abee00/0xcedf0054f8498595 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee69 expref: 47 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334958.917963:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abee00, rc 0) 00000100:00100000:1.0:1763334958.917994:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+46:2359:x1848989694283008:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7957us (8980us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334958.918002:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4408 00000100:00100000:1.0:1763334958.920661:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694283264 00000100:00100000:1.0:1763334958.920680:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694283264 00002000:00010000:1.0:1763334958.920741:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/518 (0->18446744073709551615) 00002000:00100000:1.0:1763334958.920747:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa744000 with x1848989694283264 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334958.920764:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa744000. 00000100:00100000:1.0:1763334958.920805:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1660 00000100:00100000:1.0:1763334958.920815:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+46:2360:x1848989694283264:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334958.921314:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x206:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334958.921320:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x206:0x0] updating lvb mtime from disk: 1763334959 -> 1763334959 00002000:00010000:1.0:1763334958.921323:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x206:0x0] updating lvb atime from disk: 1763334959 -> 0 00002000:00010000:1.0:1763334958.921326:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x206:0x0] updating lvb ctime from disk: 1763334959 -> 1763334959 00002000:00010000:1.0:1763334958.921330:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x206:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334958.921555:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+47:2360:x1848989694283264:12345-192.168.201.60@tcp:10:bash.0 Request processed in 737us (1047us total) trans 17179870907 rc 0/0 00000100:00100000:1.0:1763334958.921640:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1660 00002000:00010000:1.0:1763334958.921648:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/518 (0->18446744073709551615) 00002000:00100000:1.0:1763334958.921651:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa744000 with x1848989694283264 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334958.921657:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa744000. 00000100:00100000:1.0:1763334958.924938:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694283392 00000100:00100000:1.0:1763334958.924955:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694283392 00002000:00010000:1.0:1763334958.925018:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/514 (0->18446744073709551615) 00002000:00100000:1.0:1763334958.925025:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af68ce300 with x1848989694283392 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334958.925041:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af68ce300. 00000100:00100000:1.0:1763334958.925368:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1661 00000100:00100000:1.0:1763334958.925383:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2359:x1848989694283392:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334958.926503:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x202:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334958.926508:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x202:0x0] updating lvb mtime from disk: 0 -> 1763334959 00002000:00010000:1.0:1763334958.926511:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x202:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334958.926513:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x202:0x0] updating lvb ctime from disk: 0 -> 1763334959 00002000:00010000:1.0:1763334958.926516:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x202:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334958.926619:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694283392:12345-192.168.201.60@tcp:10:bash.0 Request processed in 1237us (1864us total) trans 21474838191 rc 0/0 00000100:00100000:1.0:1763334958.926629:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1661 00002000:00010000:1.0:1763334958.926636:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/514 (0->18446744073709551615) 00002000:00100000:1.0:1763334958.926640:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af68ce300 with x1848989694283392 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334958.926646:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af68ce300. 00000100:00100000:1.0:1763334958.935000:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.935176:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694284160 00000100:00100000:3.0:1763334958.935190:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694284160 00000100:00100000:3.0:1763334958.935844:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4214 00000100:00100000:3.0:1763334958.935861:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52938:x1848989694284160:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334958.935897:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.935928:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84985a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee77 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.936035:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985aa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936053:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985aa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936064:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985aa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936081:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985b1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936088:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936094:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936302:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84985b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936313:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84985b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936325:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84985b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334958.936338:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x175:0x0]: returning size 5 00010000:00010000:3.0:1763334958.936495:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985aa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936504:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985aa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936511:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985aa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936518:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.936523:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985aa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936532:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985aa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936547:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.936551:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.936556:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985aa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936563:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985aa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936612:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985b1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936621:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985b1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936631:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985b1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936637:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.936640:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985b1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936646:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985b1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936653:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32b00) 00010000:00010000:3.0:1763334958.936656:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.936658:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985b1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936664:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985b1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.936719:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84985a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee77 expref: 170 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.936733:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84985b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee77 expref: 169 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.936742:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x175:0x0].0x0 (ffff9a5acb935400) 00010000:00010000:3.0:1763334958.936744:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334958.936747:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8000, rc 0) 00000100:00100000:3.0:1763334958.936848:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52938:x1848989694284160:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 992us (1866us total) trans 8589938486 rc 0/0 00000100:00100000:3.0:1763334958.936857:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4214 00000100:00100000:1.0:1763334958.940490:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.944674:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.945068:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694284544 00000100:00100000:3.0:1763334958.945082:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694284544 00000100:00100000:3.0:1763334958.945175:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4215 00000100:00100000:3.0:1763334958.945188:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52938:x1848989694284544:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334958.945217:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.945246:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84985c6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x175:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee7e expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.945441:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985cd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x175:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.945462:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x175:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.945475:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985cd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x175:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334958.945491:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x175:0x0]: returning size 5 00010000:00010000:3.0:1763334958.945729:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84985c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x175:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee7e expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.945752:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84985cd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x175:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee7e expref: 171 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.945763:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x175:0x0].0x0 (ffff9a5acb935400) 00010000:00010000:3.0:1763334958.945767:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763334958.945771:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9800, rc 0) 00000100:00100000:3.0:1763334958.947380:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52938:x1848989694284544:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2173us (2701us total) trans 8589938487 rc 0/0 00000100:00100000:3.0:1763334958.947395:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4215 00000100:00100000:1.0:1763334958.951441:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.951989:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.952060:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694284800 00000100:00100000:3.0:1763334958.952065:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694284800 00000100:00100000:3.0:1763334958.952157:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4216 00000100:00100000:3.0:1763334958.952168:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52943:x1848989694284800:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:3.0:1763334958.952245:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763334958.952352:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84985b8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee77 expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.952387:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498587 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x175:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee5b expref: 171 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.952398:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498548 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x175:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee46 expref: 170 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.952410:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x175:0x0].0x0 (ffff9a5acb935400) 00010000:00010000:3.0:1763334958.952415:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334958.952448:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985db lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.952463:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985db lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.952473:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985db lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.952487:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84985e2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.952493:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84985e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.952499:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84985e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.952709:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84985e9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x175:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.952719:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84985e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x175:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.952726:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84985e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x175:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00080000:3.0:1763334958.953233:0:29627:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x175:0x0] is inserted into orphan list, open count = 2 00010000:00010000:3.0:1763334958.953448:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84985e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x175:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.953457:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84985e9 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x175:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.953466:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84985e9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x175:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.953473:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.953479:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84985e9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x175:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.953490:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84985e9 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x175:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.953500:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x175:0x0].0x0 (ffff9a5acb935400) 00010000:00010000:3.0:1763334958.953504:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763334958.953509:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84985e9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x175:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.953517:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f84985e9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x175:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.953538:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985db lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.953544:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985db lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.953549:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985db lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.953554:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.953556:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985db lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.953562:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985db lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.953568:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.953594:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.953598:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985db lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.953605:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84985db lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:3.0:1763334958.953614:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b11d2b75 reply state 00000000330e9f8a transno 8589938488 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84985e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334958.953623:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334958.953740:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52943:x1848989694284800:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1574us (1751us total) trans 8589938488 rc 0/0 00000100:00100000:3.0:1763334958.953747:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4216 00000100:00100000:1.0:1763334958.965462:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334958.967017:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84985e2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.967027:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84985e2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.967035:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84985e2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.967042:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.967048:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84985e2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.967057:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84985e2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.967070:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32b00) 00010000:00010000:3.0:1763334958.967073:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.967078:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84985e2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334958.967084:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84985e2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334958.984032:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334958.984101:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334958.991177:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694285696 00000100:00100000:3.0:1763334958.991193:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694285696 00000100:00100000:3.0:1763334958.992725:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4219 00000100:00100000:3.0:1763334958.992752:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52944:x1848989694285696:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334958.992780:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334958.992810:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849861a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee93 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.992902:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498621 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.992921:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498621 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.992935:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498621 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.992953:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498628 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.992960:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498628 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.992967:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498628 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993062:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498621 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993071:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498621 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993077:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498621 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993083:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.993088:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498621 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993097:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498621 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993112:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.993116:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.993122:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498621 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993128:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498621 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993143:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498628 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993148:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498628 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993153:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498628 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993159:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334958.993162:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498628 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993167:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498628 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993173:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32b00) 00010000:00010000:3.0:1763334958.993175:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.993178:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498628 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993183:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498628 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334958.993224:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849861a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee93 expref: 172 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.993235:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334958.993238:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334958.993242:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849861a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee93 expref: 172 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334958.993265:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8200, rc 0) 00000100:00100000:3.0:1763334958.993380:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52944:x1848989694285696:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 639us (2266us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334958.993388:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4219 00000100:00100000:1.0:1763334959.000189:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694285824 00000100:00100000:1.0:1763334959.000204:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694285824 00000100:00100000:1.0:1763334959.000280:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4220 00000100:00100000:1.0:1763334959.000292:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52944:x1848989694285824:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334959.000324:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.000364:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849862f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aee9a expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.000505:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8498636 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.000525:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8498636 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.000540:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8498636 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334959.000654:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:1.0:1763334959.000658:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334959.000683:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8498636 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.000716:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849862f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee9a expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.000744:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8498636 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee9a expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.000753:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334959.000757:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763334959.000761:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abe800, rc 0) 00000100:00100000:1.0:1763334959.000832:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52944:x1848989694285824:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 543us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334959.000839:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4220 00000100:00100000:3.0:1763334959.019627:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694286080 00000100:00100000:3.0:1763334959.019641:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694286080 00000100:00100000:3.0:1763334959.019726:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4221 00000100:00100000:3.0:1763334959.019741:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52945:x1848989694286080:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334959.019768:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.019799:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849863d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeea1 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.019901:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498644 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.019917:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498644 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.019929:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498644 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.019945:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849864b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.019952:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849864b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.019958:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849864b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020048:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498644 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020057:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498644 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020063:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498644 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020070:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.020074:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498644 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020082:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498644 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020095:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334959.020099:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.020104:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498644 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020111:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498644 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020125:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849864b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020131:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849864b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020135:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849864b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020144:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.020146:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849864b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020153:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849864b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020161:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32b00) 00010000:00010000:3.0:1763334959.020163:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.020166:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849864b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020172:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849864b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.020214:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849863d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeea1 expref: 173 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.020225:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334959.020228:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763334959.020232:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849863d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeea1 expref: 173 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.020242:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8200, rc 0) 00000100:00100000:1.0:1763334959.031068:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334959.043428:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498660 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.043451:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498660 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.043460:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498660 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.043469:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.043476:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498660 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.043486:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498660 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.043509:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cabf00) 00010000:00010000:3.0:1763334959.043512:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.043518:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498660 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.043526:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498660 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:1.0:1763334959.047531:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.063503:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694287104 00000100:00100000:3.0:1763334959.063517:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694287104 00000100:00100000:3.0:1763334959.063606:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1561 00000100:00100000:3.0:1763334959.063618:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52946:x1848989694287104:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334959.063917:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52946:x1848989694287104:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 301us (2260us total) trans 8589938493 rc 0/0 00000100:00100000:3.0:1763334959.063926:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1561 00000100:00100000:1.0:1763334959.072340:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694287488 00000100:00100000:1.0:1763334959.072362:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694287488 00000100:00100000:1.0:1763334959.072442:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4225 00000100:00100000:1.0:1763334959.072454:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52946:x1848989694287488:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334959.072486:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.072517:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8498698 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeebd expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.072689:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849869f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x177:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.072707:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849869f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.072721:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849869f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334959.072739:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x177:0x0]: returning size 0 00010000:00010000:1.0:1763334959.072909:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8498698 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeebd expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.072933:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849869f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeebd expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.072943:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334959.072946:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334959.072951:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abee00, rc 0) 00000100:00100000:1.0:1763334959.073030:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52946:x1848989694287488:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 578us (1267us total) trans 8589938494 rc 0/0 00000100:00100000:1.0:1763334959.073039:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4225 00000100:00100000:3.0:1763334959.073749:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694287616 00000100:00100000:3.0:1763334959.073758:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694287616 00010000:00010000:3.0:1763334959.073791:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498667 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeea8 expref: 179 pid: 29629 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334959.073832:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2345 00000100:00100000:3.0:1763334959.073841:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:2362:x1848989694287616:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334959.073855:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334959.073862:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498667 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeea8 expref: 179 pid: 29629 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334959.073874:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498667 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeea8 expref: 179 pid: 29629 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334959.073894:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:3.0:1763334959.073899:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498691 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.073907:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498691 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.073914:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498691 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.073933:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334959.073970:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:2362:x1848989694287616:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 131us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.073978:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2345 00000100:00100000:1.0:1763334959.085756:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.090723:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.098087:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694288640 00000100:00100000:3.0:1763334959.098103:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694288640 00000100:00100000:3.0:1763334959.098189:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1564 00000100:00100000:3.0:1763334959.098204:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52947:x1848989694288640:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334959.098966:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52947:x1848989694288640:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 760us (954us total) trans 8589938499 rc 0/0 00000100:00100000:3.0:1763334959.098977:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1564 00000100:00100000:1.0:1763334959.103797:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694288768 00000100:00100000:1.0:1763334959.103812:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694288768 00000100:00100000:1.0:1763334959.103896:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4410 00000100:00100000:1.0:1763334959.103908:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2362:x1848989694288768:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334959.103934:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.103968:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59ca226200/0xcedf0054f84986d7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeecb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334959.104003:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x204:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334959.104030:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334959.104033:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334959.104047:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59ca226200/0xcedf0054f84986d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeecb expref: 15 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334959.104067:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a59ca226200/0xcedf0054f84986d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeecb expref: 15 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334959.104084:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59ca226200, rc 0) 00000100:00100000:1.0:1763334959.104163:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2362:x1848989694288768:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 257us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334959.104171:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4410 00000100:00100000:3.0:1763334959.104414:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694289024 00000100:00100000:3.0:1763334959.104421:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694289024 00000100:00100000:3.0:1763334959.104475:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4227 00000100:00100000:3.0:1763334959.104483:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52274:x1848989694289024:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334959.104500:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.104518:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84986de lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeed2 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334959.111194:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694289152 00000100:00100000:3.0:1763334959.111211:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694289152 00010000:00010000:3.0:1763334959.111284:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84986c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeec4 expref: 184 pid: 29629 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334959.111345:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2346 00000100:00100000:3.0:1763334959.111366:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2359:x1848989694289152:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334959.111393:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334959.111402:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84986c9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeec4 expref: 184 pid: 29629 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334959.111417:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84986c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeec4 expref: 184 pid: 29629 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334959.111449:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84986c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeec4 expref: 184 pid: 29629 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334959.111474:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:3.0:1763334959.111481:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84986e5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.111494:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84986e5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.111505:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84986e5 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334959.111553:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334959.111599:0:29629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84986e5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334959.111608:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84986e5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:1.0:1763334959.111635:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x177:0x0]: returning size 0 00000100:00100000:3.0:1763334959.111698:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+183:2359:x1848989694289152:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 343us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.111708:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2346 00010000:00010000:1.0:1763334959.111873:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84986de lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeed2 expref: 184 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.111894:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84986e5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeed2 expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.111901:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334959.111904:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334959.111907:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:1.0:1763334959.111943:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52274:x1848989694289024:12345-192.168.201.60@tcp:101:bash.0 Request processed in 7461us (8165us total) trans 8589938500 rc 0/0 00000100:00100000:1.0:1763334959.111951:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4227 00000100:00100000:1.0:1763334959.118698:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694289280 00000100:00100000:1.0:1763334959.118712:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694289280 00000100:00100000:1.0:1763334959.118784:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694289536 00000100:00100000:1.0:1763334959.118788:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694289536 00000100:00100000:1.0:1763334959.118825:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4228 00000100:00100000:1.0:1763334959.118837:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52947:x1848989694289280:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334959.118864:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763334959.118867:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4229 00000100:00100000:3.0:1763334959.118876:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52274:x1848989694289536:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1763334959.118911:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84986f3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x177:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeed9 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.118983:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84986f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeed9 expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.118999:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84986f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeed9 expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.119020:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334959.119023:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334959.119028:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59ca226e00, rc 0) 00000100:00100000:1.0:1763334959.119103:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52947:x1848989694289280:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 268us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334959.119110:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4228 00010000:00010000:3.0:1763334959.119235:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84986fa lrc: 3/0,1 mode: --/PW res: [0x200000404:0x177:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.119246:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84986fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.121119:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84986fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334959.133397:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4230 00000100:00100000:1.0:1763334959.133420:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52947:x1848989694289792:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334959.133453:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.133490:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226400/0xcedf0054f8498701 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeee0 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.133618:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca227e00/0xcedf0054f8498708 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.133638:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca227e00/0xcedf0054f8498708 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.133652:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca227e00/0xcedf0054f8498708 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.133670:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f849870f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.133676:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f849870f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.133683:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f849870f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.133872:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8498716 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x177:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.133883:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8498716 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.133891:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8498716 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334959.135103:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x177:0x0]: returning size 0 00010000:00010000:1.0:1763334959.135268:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca227e00/0xcedf0054f8498708 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135283:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca227e00/0xcedf0054f8498708 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135291:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca227e00/0xcedf0054f8498708 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135303:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59ca227e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.135308:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca227e00/0xcedf0054f8498708 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135316:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca227e00/0xcedf0054f8498708 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135334:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334959.135338:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.135344:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca227e00/0xcedf0054f8498708 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135350:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca227e00/0xcedf0054f8498708 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135379:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f849870f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135385:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f849870f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135390:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f849870f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135396:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5b02164800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.135399:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f849870f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135405:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f849870f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135413:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829400) 00010000:00010000:1.0:1763334959.135417:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.135420:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f849870f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135426:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164800/0xcedf0054f849870f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.135500:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226400/0xcedf0054f8498701 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeee0 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.135522:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8498716 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeee0 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.135530:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334959.135532:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 18 00010000:00010000:1.0:1763334959.135535:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5b02164000, rc 0) 00000100:00100000:1.0:1763334959.135702:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:52947:x1848989694289792:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2288us (3392us total) trans 8589938503 rc 0/0 00000100:00100000:1.0:1763334959.135713:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4230 00010000:00010000:3.0:1763334959.138321:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84986fa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.138338:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84986fa lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.138347:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84986fa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.138363:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.138368:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84986fa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.138381:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84986fa lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.138401:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:3.0:1763334959.138404:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.138410:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84986fa lrc: 2/0,0 mode: --/PW res: [0x200000404:0x177:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.138416:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f84986fa lrc: 0/0,0 mode: --/PW res: [0x200000404:0x177:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334959.138631:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694290048 00000100:00100000:1.0:1763334959.138647:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694290048 00000100:00100000:1.0:1763334959.138718:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4231 00000100:00100000:1.0:1763334959.138731:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694290048:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334959.138765:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.138769:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334959.138794:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59ca226e00/0xcedf0054f84986f3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x177:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeed9 expref: 188 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.138811:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334959.138816:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334959.138833:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02165c00/0xcedf0054f8498724 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeee7 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.138942:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849872b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.138959:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8498716 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeee0 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.138970:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849872b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.139012:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8498716 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeee0 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.139029:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8498716 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeee0 expref: 188 pid: 30972 timeout: 1123 lvb_type: 0 00000100:00100000:1.0:1763334959.139045:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701777536:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334959.139151:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334959.142067:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bed500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701777536:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334959.142108:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849872b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334959.144047:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694290304 00000100:00100000:3.0:1763334959.144061:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694290304 00000100:00100000:3.0:1763334959.150843:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.150988:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.151710:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694290560 00000100:00100000:1.0:1763334959.151716:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694290560 00010000:00010000:1.0:1763334959.151743:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8498716 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x18/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeee0 expref: 192 pid: 30972 timeout: 1123 lvb_type: 0 00000100:00100000:1.0:1763334959.151780:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2347 00000100:00100000:1.0:1763334959.151787:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694290560:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334959.151798:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334959.151804:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8498716 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x18/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeee0 expref: 192 pid: 30972 timeout: 1123 lvb_type: 0 00010000:00010000:1.0:1763334959.151817:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8498716 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x18/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeee0 expref: 192 pid: 30972 timeout: 1123 lvb_type: 0 00010000:00010000:1.0:1763334959.151838:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02164000/0xcedf0054f8498716 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x177:0x0].0x0 bits 0x18/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeee0 expref: 192 pid: 30972 timeout: 1123 lvb_type: 0 00010000:00010000:1.0:1763334959.151858:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334959.151863:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498739 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x177:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.151870:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849872b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.151877:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849872b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.151885:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849872b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.151892:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498739 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x177:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.151909:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498739 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x177:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.151936:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334959.152009:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:2360:x1848989694290560:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 222us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334959.152018:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2347 00010000:00010000:1.0:1763334959.152052:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849872b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.152060:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849872b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00000040:00080000:1.0:1763334959.152501:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].965, 88 off83640 00000004:00080000:1.0:1763334959.152513:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1023785940396ns, next at 1024306351965ns, rc = 0 00000040:00080000:1.0:1763334959.152556:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].976, 88 off84704 00000004:00080000:1.0:1763334959.152564:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1023785990971ns, next at 1024306414423ns, rc = 0 00000040:00080000:1.0:1763334959.152630:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].977, 88 off84792 00000004:00080000:1.0:1763334959.152635:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1023786063041ns, next at 1024306414423ns, rc = 0 00000040:00080000:1.0:1763334959.152650:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].966, 88 off83728 00000004:00080000:1.0:1763334959.152654:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1023786081786ns, next at 1024306351965ns, rc = 0 00000100:00100000:3.0:1763334959.163400:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694290688 00000100:00100000:3.0:1763334959.163417:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694290688 00010000:00010000:3.0:1763334959.163550:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84986e5 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeed2 expref: 192 pid: 29629 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334959.163626:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2348 00000100:00100000:3.0:1763334959.163639:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694290688:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334959.163662:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334959.163671:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84986e5 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeed2 expref: 192 pid: 29629 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334959.163686:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84986e5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeed2 expref: 192 pid: 29629 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334959.163727:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:3.0:1763334959.163735:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498739 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x177:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.163747:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498739 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x177:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.163753:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498739 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x177:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.163760:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334959.164639:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:2360:x1848989694290688:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1000us (1821us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.164650:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2348 00000001:00080000:1.0:1763334959.201202:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938505 is committed 00000004:00080000:1.0:1763334959.201211:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 633 committed 00000004:00080000:1.0:1763334959.201224:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 645 committed 00000004:00080000:1.0:1763334959.201237:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 644 committed 00000004:00080000:1.0:1763334959.201240:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 632 committed 00000100:00100000:1.0:1763334959.201534:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701778176:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334959.201656:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334959.201711:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1763334959.201718:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701777792:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334959.201743:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334959.201759:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701778304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334959.201777:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334959.201805:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701777920:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334959.201826:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334959.201842:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701778432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334959.201894:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763334959.202816:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849872b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeee7 expref: 167 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.202835:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:3.0:1763334959.202839:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334959.202844:0:30972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498739 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x177:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.202856:0:30972:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498739 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.202863:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498739 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.202924:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5b02165c00/0xcedf0054f8498724 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeee7 expref: 167 pid: 30972 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763334959.202948:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849872b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeee7 expref: 166 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.202998:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:3.0:1763334959.203082:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52274:x1848989694290048:12345-192.168.201.60@tcp:101:bash.0 Request processed in 64352us (65242us total) trans 8589938505 rc 0/0 00000100:00100000:3.0:1763334959.203093:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4231 00000100:00100000:3.0:1763334959.203139:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701778816:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.203184:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701778048:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334959.204736:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701778944:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334959.204793:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334959.212681:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334959.212735:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701778560:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.212784:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334959.212803:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701779072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.212822:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334959.212865:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701778048 00000100:00100000:3.0:1763334959.212875:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701778048 00000100:00100000:3.0:1763334959.212917:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701778560 00000100:00100000:3.0:1763334959.212920:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701778560 00000100:00100000:3.0:1763334959.212937:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701779072 00000100:00100000:3.0:1763334959.212940:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701779072 00000100:00100000:3.0:1763334959.212960:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4417 00000100:00100000:3.0:1763334959.212968:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701778048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334959.213006:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:514 count 1 00010000:00010000:3.0:1763334959.213037:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849875c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.213058:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849859c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee70 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.213072:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334959.213075:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334959.213079:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849875c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.213119:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849859c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee70 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.213133:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849859c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee70 expref: 14 pid: 6517 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334959.213148:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeef9fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701779584:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334959.213223:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6384480 going to sleep for 11 seconds 00000100:00100000:3.0:1763334959.213273:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.214233:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4418 00000100:00100000:1.0:1763334959.214251:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+78:3290:x1848989701778560:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763334959.214276:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:514 count 1 00010000:00010000:1.0:1763334959.214297:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f8498763 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.214315:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067800/0xcedf0054f8498476 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee0e expref: 46 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334959.214325:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334959.214329:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334959.214333:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334959.214336:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f8498763 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.214381:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067800/0xcedf0054f8498476 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee0e expref: 46 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334959.214382:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694290944 00000100:00100000:3.0:1763334959.214390:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694290944 00010000:00010000:1.0:1763334959.214399:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067800/0xcedf0054f8498476 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee0e expref: 46 pid: 26564 timeout: 1123 lvb_type: 0 00000100:00100000:1.0:1763334959.214415:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701779712:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334959.214438:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4419 00000100:00100000:3.0:1763334959.214448:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+78:3290:x1848989701779072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334959.214492:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac8393780 going to sleep for 11 seconds 00010000:00010000:1.0:1763334959.214511:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334959.214531:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701778688:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334959.214568:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334959.214611:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701779200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334959.214636:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763334959.214681:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6beca80/2, rc 0, transno 21474838192 00000100:00100000:1.0:1763334959.214689:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701778304:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334959.214704:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6bed180/2, rc 0, transno 21474838194 00000100:00100000:1.0:1763334959.214709:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701778176:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1763334959.214746:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44ea00/2, rc 0, transno 17179870908 00000100:00100000:1.0:1763334959.214752:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701778944:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1763334959.214767:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6beea00/2, rc 0, transno 21474838193 00000100:00100000:1.0:1763334959.214772:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701778432:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334959.214837:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+79:3290:x1848989701779072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 390us (2012us total) trans 17179870909 rc 0/0 00000100:00100000:3.0:1763334959.214846:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4419 00000100:00100000:3.0:1763334959.214871:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701778688 00000004:00080000:1.0:1763334959.214874:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44c380/2, rc 0, transno 17179870909 00000100:00100000:3.0:1763334959.214876:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701778688 00000100:00100000:1.0:1763334959.214883:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701779072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.214899:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701779200 00000100:00100000:3.0:1763334959.214903:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701779200 00000100:00100000:3.0:1763334959.214920:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4420 00000100:00100000:3.0:1763334959.214927:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+15:52274:x1848989694290944:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334959.214938:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.214952:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849876a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeefc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.214973:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59ca226200/0xcedf0054f84986d7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeecb expref: 16 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334959.214980:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334959.214982:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334959.214985:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849876a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeefc expref: 16 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.215007:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a59ca226200/0xcedf0054f84986d7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeecb expref: 16 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334959.215018:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a59ca226200/0xcedf0054f84986d7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeecb expref: 16 pid: 6518 timeout: 1123 lvb_type: 1 00000100:00100000:3.0:1763334959.215029:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701779840:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334959.215062:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6384900 going to sleep for 11 seconds 00000100:00100000:3.0:1763334959.215082:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4421 00000100:00100000:3.0:1763334959.215171:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+80:3291:x1848989701778688:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334959.215187:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:515 count 1 00010000:00010000:3.0:1763334959.215202:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498771 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.215220:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f8498453 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee00 expref: 46 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.215228:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334959.215229:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334959.215232:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498771 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.215252:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f8498453 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee00 expref: 46 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.215261:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f8498453 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee00 expref: 46 pid: 26564 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334959.215272:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701779968:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334959.215299:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af687b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334959.215320:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4422 00000100:00100000:3.0:1763334959.215327:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+80:3291:x1848989701779200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.215497:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+81:3291:x1848989701779200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 170us (860us total) trans 17179870910 rc 0/0 00000100:00100000:3.0:1763334959.215506:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4422 00000100:00100000:3.0:1763334959.215533:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334959.215602:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701778816 00000100:00100000:3.0:1763334959.215606:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701778816 00000100:00100000:3.0:1763334959.215626:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4423 00000100:00100000:3.0:1763334959.215631:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+81:3292:x1848989701778816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334959.215643:0:6518:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:518 count 1 00010000:00010000:3.0:1763334959.215657:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498778 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.215673:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f849858e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee62 expref: 46 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.215681:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334959.215683:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334959.215687:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498778 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763334959.215688:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44df80/2, rc 0, transno 17179870910 00000100:00100000:1.0:1763334959.215698:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701779200:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763334959.215716:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f849858e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee62 expref: 46 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.215728:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f849858e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee62 expref: 46 pid: 6518 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334959.215739:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af68cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701780096:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334959.215772:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa8f1d80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334959.215930:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694290816 00000100:00100000:3.0:1763334959.215935:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694290816 00000100:00100000:3.0:1763334959.215981:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4233 00000100:00100000:3.0:1763334959.215989:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52947:x1848989694290816:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334959.216003:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.216019:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849877f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x177:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeef5 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.216085:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849877f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeef5 expref: 166 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.216101:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849877f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeef5 expref: 166 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.216122:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:3.0:1763334959.216125:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334959.216129:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9800, rc 0) 00000100:00100000:3.0:1763334959.216166:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52947:x1848989694290816:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 178us (2893us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.216173:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4233 00000100:00100000:3.0:1763334959.218562:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.218634:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeef9fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701779584:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334959.218673:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849875c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334959.218794:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.218825:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.218856:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694291072 00000100:00100000:3.0:1763334959.218865:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694291072 00010000:00010000:3.0:1763334959.218906:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498285 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed66 expref: 17 pid: 26564 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334959.218948:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694291328 00000100:00100000:3.0:1763334959.218951:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694291328 00000100:00100000:1.0:1763334959.218953:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694291200 00000100:00100000:1.0:1763334959.218960:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694291200 00010000:00010000:3.0:1763334959.218967:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849859c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee70 expref: 19 pid: 6517 timeout: 1123 lvb_type: 0 00010000:00010000:1.0:1763334959.218985:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849844c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedf9 expref: 19 pid: 26564 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334959.219001:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2349 00000100:00100000:3.0:1763334959.219012:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694291072:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334959.219031:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334959.219037:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498285 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed66 expref: 19 pid: 26564 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334959.219049:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498285 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed66 expref: 19 pid: 26564 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334959.219077:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498285 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aed66 expref: 19 pid: 26564 timeout: 1123 lvb_type: 0 00010000:00010000:3.0:1763334959.219103:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334959.219105:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334959.219110:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.219120:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498747 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.219146:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334959.219213:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2351 00000100:00100000:1.0:1763334959.219228:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2361:x1848989694291200:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334959.219242:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1763334959.219302:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694291072:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 187us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.219310:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2349 00010000:00010000:3.0:1763334959.219342:0:6517:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.219350:0:6517:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.219378:0:6517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498747 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.219387:0:6517:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498747 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.219411:0:6517:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334959.219737:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849844c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedf9 expref: 15 pid: 26564 timeout: 1123 lvb_type: 0 00010000:00010000:1.0:1763334959.219752:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849844c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedf9 expref: 15 pid: 26564 timeout: 1123 lvb_type: 0 00010000:00010000:1.0:1763334959.219767:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849844c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aedf9 expref: 15 pid: 26564 timeout: 1123 lvb_type: 0 00010000:00010000:1.0:1763334959.219779:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334959.219782:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334959.219785:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849874e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.219795:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849874e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.219821:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334959.219852:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694291200:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 628us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334959.219860:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2351 00000100:00100000:3.0:1763334959.220287:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701777792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13824us (18541us total) trans 21474838195 rc 0/0 00000100:00100000:3.0:1763334959.220298:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4412 00010000:00010000:1.0:1763334959.222298:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849875c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.222319:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849875c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.222331:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849875c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.222337:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849875c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.222381:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334959.222843:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701778048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9872us (10164us total) trans 21474838196 rc 0/0 00000100:00100000:1.0:1763334959.222856:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4417 00000004:00080000:3.0:1763334959.223349:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6bedc00/2, rc 0, transno 21474838196 00000100:00100000:3.0:1763334959.223371:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701778048:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1763334959.224875:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6bec700/2, rc 0, transno 21474838197 00000100:00100000:1.0:1763334959.224890:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701777920:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763334959.226706:0:7819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067800/0xcedf0054f8498476 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee0e expref: 46 pid: 26564 timeout: 1123 lvb_type: 0 00000100:00100000:1.0:1763334959.226719:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701779712:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334959.226744:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f8498763 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.226759:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f8498763 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.226766:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f8498763 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.226776:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f8498763 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.226784:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f8498763 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.226810:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334959.227214:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+82:3290:x1848989701778560:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12969us (14427us total) trans 17179870911 rc 0/0 00000100:00100000:1.0:1763334959.227223:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4418 00010000:00010000:3.0:1763334959.227369:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f8498453 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee00 expref: 45 pid: 26564 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334959.227384:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701779968:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334959.227400:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498771 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227409:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498771 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227417:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498771 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227431:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498771 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227438:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498771 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227455:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763334959.227638:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+82:3291:x1848989701778688:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12549us (13068us total) trans 17179870912 rc 0/0 00000100:00100000:3.0:1763334959.227645:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4421 00010000:00010000:3.0:1763334959.227670:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763334959.227679:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f8498763 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227687:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334959.227692:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f8498763 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227703:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f8498763 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227719:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f8498763 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227727:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f8498763 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227748:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334959.227751:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498771 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227758:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334959.227761:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498771 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227767:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498771 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227776:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498771 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227782:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498771 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227796:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334959.227797:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334959.227799:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334959.227833:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afc8c1180/2, rc 0, transno 17179870912 00000100:00100000:3.0:1763334959.227841:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701778688:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763334959.227874:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f849858e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aee62 expref: 44 pid: 6518 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334959.227886:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af68cfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701780096:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334959.227900:0:6518:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498778 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227909:0:6518:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498778 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227915:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498778 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227922:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498778 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227929:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498778 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.227945:0:6518:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334959.228109:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+82:3292:x1848989701778816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12475us (12573us total) trans 17179870913 rc 0/0 00000100:00100000:3.0:1763334959.228117:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4423 00000004:00080000:3.0:1763334959.228154:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afc8c3100/2, rc 0, transno 17179870913 00000100:00100000:3.0:1763334959.228164:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701778816:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763334959.228183:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334959.228418:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59ca226200/0xcedf0054f84986d7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x204:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeecb expref: 16 pid: 6518 timeout: 1123 lvb_type: 1 00000100:00100000:3.0:1763334959.228433:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701779840:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334959.228454:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849876a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeefc expref: 15 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.228469:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8800, rc 0) 00000100:00100000:3.0:1763334959.228526:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+15:52274:x1848989694290944:12345-192.168.201.60@tcp:101:bash.0 Request processed in 13598us (14205us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.228533:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4420 00000100:00100000:3.0:1763334959.236048:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694292224 00000100:00100000:3.0:1763334959.236061:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694292224 00000100:00100000:3.0:1763334959.243999:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1663 00000100:00100000:3.0:1763334959.244013:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+45:2359:x1848989694292480:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334959.244423:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x208:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334959.244428:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x208:0x0] updating lvb mtime from disk: 0 -> 1763334959 00002000:00010000:3.0:1763334959.244433:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x208:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334959.244437:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x208:0x0] updating lvb ctime from disk: 0 -> 1763334959 00002000:00010000:3.0:1763334959.244443:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x208:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334959.244531:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+46:2359:x1848989694292480:12345-192.168.201.60@tcp:10:bash.0 Request processed in 521us (844us total) trans 17179870914 rc 0/0 00000100:00100000:3.0:1763334959.244541:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1663 00002000:00010000:3.0:1763334959.244546:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/520 (0->18446744073709551615) 00002000:00100000:3.0:1763334959.244549:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c5c00 with x1848989694292480 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334959.244555:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c58c5c00. 00000100:00100000:3.0:1763334959.244616:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694292736 00000100:00100000:3.0:1763334959.244622:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694292736 00000100:00100000:3.0:1763334959.244655:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4234 00000100:00100000:3.0:1763334959.244661:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+165:52947:x1848989694292736:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334959.244682:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.244707:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498794 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aef11 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.244799:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849879b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.244817:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849879b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.244830:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849879b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.244847:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987a2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.244854:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.244860:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245024:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84987a9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x177:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245035:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84987a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245042:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84987a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334959.245054:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x177:0x0]: returning size 2 00010000:00010000:3.0:1763334959.245177:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849879b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245187:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849879b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245195:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849879b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245201:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.245207:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849879b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245215:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849879b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245230:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334959.245233:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.245240:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849879b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245246:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849879b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245275:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245282:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987a2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245288:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245293:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.245297:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245303:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245312:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32b00) 00010000:00010000:3.0:1763334959.245314:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.245317:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987a2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245324:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.245380:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498794 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef11 expref: 168 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.245396:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84987a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef11 expref: 167 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.245404:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:3.0:1763334959.245406:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334959.245409:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9e00, rc 0) 00000100:00100000:3.0:1763334959.252386:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52947:x1848989694292736:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7678us (8693us total) trans 8589938506 rc 0/0 00000100:00100000:3.0:1763334959.252405:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4234 00000100:00100000:1.0:1763334959.260263:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.272464:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.272637:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.273610:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694293632 00000100:00100000:3.0:1763334959.273617:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694293632 00000100:00100000:3.0:1763334959.273665:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4235 00000100:00100000:3.0:1763334959.273674:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52948:x1848989694293632:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:3.0:1763334959.273711:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763334959.273747:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f84987a9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x177:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef11 expref: 169 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.273777:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498739 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x177:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeeee expref: 168 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.273791:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849872b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x177:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeee7 expref: 167 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.273804:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:3.0:1763334959.273810:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334959.273842:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84987b7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.273857:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84987b7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.273868:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84987b7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.273884:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987be lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.273890:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987be lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.273897:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987be lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.274037:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.274047:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849869f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeebd expref: 166 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.274060:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.274099:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849869f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeebd expref: 166 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.274114:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849869f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeebd expref: 166 pid: 30972 timeout: 1123 lvb_type: 0 00000100:00100000:3.0:1763334959.274142:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701780480:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334959.274218:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac736f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334959.278537:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694293888 00000100:00100000:1.0:1763334959.278551:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694293888 00000100:00100000:1.0:1763334959.278659:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4236 00000100:00100000:1.0:1763334959.278671:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52947:x1848989694293888:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334959.278701:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.278705:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334959.278723:0:30972:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849869f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeebd expref: 167 pid: 30972 timeout: 1123 lvb_type: 0 00010000:00010000:1.0:1763334959.278755:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334959.278761:0:30972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.278772:0:30972:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.278780:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.278804:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334959.278833:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84987cc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x177:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aef18 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.278989:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84987d3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x177:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.279001:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84987d3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.279009:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84987d3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334959.279021:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x177:0x0]: returning size 2 00010000:00010000:1.0:1763334959.279177:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84987cc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x177:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef18 expref: 170 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.279199:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84987d3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef18 expref: 169 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.279207:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334959.279211:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334959.279214:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334959.279295:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52947:x1848989694293888:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 626us (956us total) trans 8589938509 rc 0/0 00000100:00100000:1.0:1763334959.279304:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4236 00010000:00010000:1.0:1763334959.284515:0:29627:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.60@tcp) returned -22 from blocking AST (req@000000004467aad9 x1848989701780480) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849869f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeebd expref: 168 pid: 30972 timeout: 1123 lvb_type: 0 00010000:00010000:1.0:1763334959.284548:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849869f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x177:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeebd expref: 168 pid: 30972 timeout: 1123 lvb_type: 0 00000100:00100000:1.0:1763334959.284585:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701780480:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334959.284622:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334959.284633:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.284644:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.284651:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00080000:1.0:1763334959.285242:0:29627:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x177:0x0] is inserted into orphan list, open count = 2 00010000:00010000:1.0:1763334959.285417:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.285427:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.285435:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.285443:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.285448:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.285457:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.285471:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334959.285474:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763334959.285478:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.285484:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f84987c5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.285500:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84987b7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.285506:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84987b7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.285511:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84987b7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.285515:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.285518:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84987b7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.285522:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84987b7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.285528:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334959.285531:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.285535:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84987b7 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.285540:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f84987b7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:1.0:1763334959.285550:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b8318666 reply state 00000000a5aca20c transno 8589938510 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987be lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334959.285558:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334959.285686:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52948:x1848989694293632:12345-192.168.201.60@tcp:36:rm.0 Request processed in 12010us (13046us total) trans 8589938510 rc 0/0 00000100:00100000:1.0:1763334959.285697:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4235 00000100:00100000:1.0:1763334959.288829:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694294144 00000100:00100000:1.0:1763334959.288843:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694294144 00000100:00100000:1.0:1763334959.288914:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1569 00000100:00100000:1.0:1763334959.288926:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52947:x1848989694294144:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:1.0:1763334959.289022:0:29631:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x177:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84987d3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef18 expref: 169 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.289074:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84987e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334959.289090:0:29631:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84987e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334959.289100:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84987e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000004:00020000:1.0:1763334959.289415:0:29631:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000404:0x177:0x0]: rc = -1 00010000:00010000:1.0:1763334959.289456:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84987e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334959.289470:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84987e1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334959.289477:0:29631:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84987e1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334959.289484:0:29631:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.289490:0:29631:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84987e1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334959.289498:0:29631:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84987e1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x177:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334959.289509:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334959.289512:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1763334959.289518:0:29631:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84987e1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334959.289524:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84987e1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x177:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334959.289535:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334959.289537:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334959.289542:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84987d3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x177:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef18 expref: 169 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334959.289770:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52947:x1848989694294144:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 846us (1553us total) trans 8589938511 rc -1/-1 00000100:00100000:1.0:1763334959.289780:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1569 00010000:00010000:3.0:1763334959.290447:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987be lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.290458:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987be lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.290466:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987be lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.290471:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.290475:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987be lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.290482:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987be lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.290492:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32b00) 00010000:00010000:3.0:1763334959.290494:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.290498:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987be lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.290504:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84987be lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334959.295696:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694294272 00000100:00100000:1.0:1763334959.295710:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694294272 00000100:00100000:1.0:1763334959.296201:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4237 00000100:00100000:1.0:1763334959.296215:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52947:x1848989694294272:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334959.296249:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.296456:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479000/0xcedf0054f84987e8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x177:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aef1f expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.296534:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479000/0xcedf0054f84987e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef1f expref: 169 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.296549:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479000/0xcedf0054f84987e8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x177:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef1f expref: 169 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.296567:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac63d5100) 00010000:00010000:1.0:1763334959.296689:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334959.296694:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479000, rc 0) 00000100:00100000:1.0:1763334959.296886:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52947:x1848989694294272:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 673us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334959.296894:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4237 00010000:00010000:3.0:1763334959.311645:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334959.311656:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84987ef lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30956 initiator: MDT0 00010000:00010000:3.0:1763334959.311664:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334959.311668:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84987ef lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30956 initiator: MDT0 00010000:00010000:3.0:1763334959.311677:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84987ef lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x177:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 30956 initiator: MDT0 00010000:00010000:3.0:1763334959.311696:0:8206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x177:0x0].0x0 (ffff9a5ac63d5100) 00010000:00010000:3.0:1763334959.311700:0:8206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763334959.311705:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84987ef lrc: 1/0,0 mode: --/PW res: [0x200000404:0x177:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 30956 initiator: MDT0 00010000:00010000:3.0:1763334959.311711:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84987ef lrc: 0/0,0 mode: --/PW res: [0x200000404:0x177:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 30956 initiator: MDT0 00010000:00010000:3.0:1763334959.311725:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334959.311727:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334959.311729:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334959.312463:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.313201:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694294656 00000100:00100000:3.0:1763334959.313218:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694294656 00000100:00100000:3.0:1763334959.317657:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694294784 00000100:00100000:3.0:1763334959.317673:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694294784 00000100:00100000:1.0:1763334959.318032:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4239 00000100:00100000:1.0:1763334959.318047:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52949:x1848989694294784:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334959.318076:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.318106:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849880b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aef2d expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.318195:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498812 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318217:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498812 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318232:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498812 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318337:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498819 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318347:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498819 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318364:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498819 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318457:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498812 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318465:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498812 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318471:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498812 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318477:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.318481:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498812 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318490:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498812 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318504:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334959.318507:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.318514:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498812 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318520:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498812 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318534:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498819 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318541:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498819 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318547:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498819 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318551:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.318555:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498819 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318560:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498819 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.318567:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac63d5b00) 00010000:00010000:1.0:1763334959.322465:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.322483:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498819 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.322498:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498819 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.322613:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849880b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef2d expref: 171 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.322629:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334959.322633:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.322637:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849880b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef2d expref: 171 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.322648:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334959.322750:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52949:x1848989694294784:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4706us (5274us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334959.322762:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4239 00000100:00100000:1.0:1763334959.335567:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.340537:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694295040 00000100:00100000:1.0:1763334959.340551:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694295040 00000100:00100000:1.0:1763334959.340671:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4241 00000100:00100000:1.0:1763334959.340686:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52949:x1848989694295040:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334959.340713:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.340742:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849882e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aef3b expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.340831:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498835 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.340850:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498835 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.340864:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498835 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.340880:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849883c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.340886:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849883c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.340896:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849883c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.340981:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498835 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.340990:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498835 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.340997:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498835 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.341004:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.341008:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498835 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.341017:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498835 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.341031:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334959.341035:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.341041:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498835 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.341047:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498835 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.341062:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849883c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.341067:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849883c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.341073:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849883c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.341078:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.341081:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849883c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.341087:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849883c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.341094:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac63d5b00) 00010000:00010000:1.0:1763334959.341097:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.341099:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849883c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.341104:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849883c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.341144:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849882e lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef3b expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.341155:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334959.341158:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.341162:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849882e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef3b expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.341172:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334959.341247:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52949:x1848989694295040:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 565us (852us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334959.341257:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4241 00010000:00010000:3.0:1763334959.366328:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498851 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.366367:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498851 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.366379:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498851 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.366385:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.366392:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498851 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.366401:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498851 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.366425:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab200) 00010000:00010000:3.0:1763334959.366429:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.366438:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498851 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.366445:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498851 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334959.366632:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.366672:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.367364:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4244 00000100:00100000:1.0:1763334959.367376:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52950:x1848989694295808:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334959.367385:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.367395:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498874 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aef50 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.367442:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849887b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.367454:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849887b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.367467:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849887b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334959.367479:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x178:0x0]: returning size 0 00010000:00010000:1.0:1763334959.367647:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849887b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.367655:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849887b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.367662:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849887b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.367667:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.367671:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849887b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.367677:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849887b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.367685:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:1.0:1763334959.367689:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763334959.367692:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849887b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.367697:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849887b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334959.367739:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498874 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef50 expref: 176 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.367747:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334959.367749:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334959.367752:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498874 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef50 expref: 176 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.367759:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334959.367794:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52950:x1848989694295808:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 422us (1122us total) trans 8589938514 rc 301/301 00000100:00100000:1.0:1763334959.367801:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4244 00000100:00100000:1.0:1763334959.382901:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694296192 00000100:00100000:1.0:1763334959.382916:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694296192 00010000:00010000:1.0:1763334959.382977:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498858 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef42 expref: 176 pid: 32232 timeout: 1123 lvb_type: 0 00000100:00100000:1.0:1763334959.383031:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2356 00000100:00100000:1.0:1763334959.383042:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+176:2360:x1848989694296192:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334959.383065:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334959.383073:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498858 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef42 expref: 176 pid: 32232 timeout: 1123 lvb_type: 0 00010000:00010000:1.0:1763334959.383095:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498858 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef42 expref: 176 pid: 32232 timeout: 1123 lvb_type: 0 00010000:00010000:1.0:1763334959.383139:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:1.0:1763334959.383144:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f849886d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.383156:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f849886d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.383163:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f849886d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.383186:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334959.383256:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+176:2360:x1848989694296192:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 215us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334959.383265:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2356 00000100:00100000:1.0:1763334959.391292:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694296704 00000100:00100000:1.0:1763334959.391305:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694296704 00000100:00100000:1.0:1763334959.391373:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1572 00000100:00100000:1.0:1763334959.391383:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52949:x1848989694296704:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334959.400062:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.400265:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.411557:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.415877:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.424106:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694297984 00000100:00100000:3.0:1763334959.424117:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694297984 00000100:00100000:3.0:1763334959.424191:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4247 00000100:00100000:3.0:1763334959.424202:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52950:x1848989694297984:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334959.424233:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.424259:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f84988cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aef73 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.424426:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84988d6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.424444:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84988d6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x178:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.424455:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84988d6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x178:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334959.433272:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334959.434049:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84988d6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x178:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.434060:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f84988d6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x178:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334959.434086:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x178:0x0]: returning size 0 00000100:00100000:3.0:1763334959.450817:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.452488:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.456432:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334959.457365:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f84988eb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.457379:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f84988eb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.457393:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f84988eb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.457399:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.457404:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f84988eb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.457413:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f84988eb lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.457432:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:1.0:1763334959.457435:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.457441:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f84988eb lrc: 2/0,0 mode: --/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.457447:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f84988eb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334959.458675:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.483287:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.483364:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694299264 00000100:00100000:1.0:1763334959.483378:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694299264 00000100:00100000:1.0:1763334959.483463:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4250 00000100:00100000:1.0:1763334959.483475:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694299264:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334959.483505:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.483510:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334959.483544:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84988f2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef7a expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.483568:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:1.0:1763334959.483610:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334959.483631:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f84988f9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aef81 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.483697:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8498900 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.483713:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8498900 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.483724:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8498900 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000040:00080000:1.0:1763334959.484152:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].980, 88 off85008 00000004:00080000:1.0:1763334959.484161:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1024117588685ns, next at 1024306414423ns, rc = 0 00000040:00080000:1.0:1763334959.484206:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].969, 88 off83944 00000004:00080000:1.0:1763334959.484211:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1024117639469ns, next at 1024306351965ns, rc = 0 00000040:00080000:1.0:1763334959.484261:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].970, 88 off84032 00000004:00080000:1.0:1763334959.484267:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1024117694591ns, next at 1024306351965ns, rc = 0 00000040:00080000:1.0:1763334959.484285:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].981, 88 off85096 00000004:00080000:1.0:1763334959.484289:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1024117716871ns, next at 1024306414423ns, rc = 0 00000100:00100000:3.0:1763334959.492007:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.493693:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694299520 00000100:00100000:1.0:1763334959.493714:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694299520 00000100:00100000:1.0:1763334959.493813:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4251 00000100:00100000:1.0:1763334959.493827:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52951:x1848989694299520:12345-192.168.201.60@tcp:101:lfs.0 00000100:00100000:1.0:1763334959.506412:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.514883:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694299776 00000100:00100000:1.0:1763334959.514896:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694299776 00010000:00010000:1.0:1763334959.514952:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84988c8 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x178:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef6c expref: 190 pid: 32232 timeout: 1124 lvb_type: 0 00000100:00100000:1.0:1763334959.514997:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2358 00000100:00100000:1.0:1763334959.515009:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:2360:x1848989694299776:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334959.515028:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334959.515036:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84988c8 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x178:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef6c expref: 190 pid: 32232 timeout: 1124 lvb_type: 0 00010000:00010000:1.0:1763334959.515054:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84988c8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x178:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef6c expref: 190 pid: 32232 timeout: 1124 lvb_type: 0 00010000:00010000:1.0:1763334959.515089:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84988c8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x178:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef6c expref: 190 pid: 32232 timeout: 1124 lvb_type: 0 00010000:00010000:1.0:1763334959.515113:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:1.0:1763334959.515437:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498931 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.515449:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498931 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.515455:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498931 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.515462:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334959.515540:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d39850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2360:x1848989694299776:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 531us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334959.515550:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2358 00000001:00080000:3.0:1763334959.555480:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938522 is committed 00000001:00080000:3.0:1763334959.555515:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938526 is committed 00000004:00080000:3.0:1763334959.555520:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 647 committed 00000004:00080000:3.0:1763334959.555532:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 635 committed 00000004:00080000:3.0:1763334959.555541:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 634 committed 00000004:00080000:3.0:1763334959.555544:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 646 committed 00000100:00100000:3.0:1763334959.555888:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701780992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.555984:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334959.556026:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701781504:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334959.556049:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334959.556077:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1763334959.556084:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701781376:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.556106:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334959.556123:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701781888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334959.556141:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334959.556176:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701781248:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.556198:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334959.556212:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701781760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334959.556229:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334959.556243:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1763334959.556248:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701781120:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.556268:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334959.556283:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701781632:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334959.556303:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334959.556339:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701780992 00000100:00100000:3.0:1763334959.556360:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701780992 00000100:00100000:3.0:1763334959.556416:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701781504 00000100:00100000:3.0:1763334959.556420:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701781504 00000100:00100000:3.0:1763334959.556439:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701781376 00000100:00100000:3.0:1763334959.556443:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701781376 00000100:00100000:3.0:1763334959.556452:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701781888 00000100:00100000:3.0:1763334959.556455:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701781888 00000100:00100000:3.0:1763334959.556463:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701781248 00000100:00100000:3.0:1763334959.556465:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701781248 00000100:00100000:3.0:1763334959.556473:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701781760 00000100:00100000:3.0:1763334959.556475:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701781760 00000100:00100000:3.0:1763334959.556485:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701781120 00000100:00100000:3.0:1763334959.556487:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701781120 00000100:00100000:3.0:1763334959.556494:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701781632 00000100:00100000:3.0:1763334959.556496:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701781632 00000100:00100000:3.0:1763334959.556511:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4428 00000100:00100000:3.0:1763334959.556520:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3292:x1848989701780992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334959.556552:0:6518:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:520 count 1 00010000:00010000:3.0:1763334959.556612:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498938 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.556639:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849878d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef0a expref: 46 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.556648:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334959.556650:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334959.556655:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498938 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.556687:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849878d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef0a expref: 46 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.556702:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849878d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef0a expref: 46 pid: 26564 timeout: 1124 lvb_type: 0 00000100:00100000:3.0:1763334959.556716:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701782016:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334959.556795:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c25a8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1763334959.556815:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4429 00000100:00100000:3.0:1763334959.556821:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3292:x1848989701781504:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334959.556835:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:516 count 1 00010000:00010000:3.0:1763334959.556852:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849893f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.556869:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849876a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeefc expref: 13 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.556876:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334959.556878:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334959.556881:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849893f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.556897:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849876a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeefc expref: 13 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.556906:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849876a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeefc expref: 13 pid: 6519 timeout: 1124 lvb_type: 0 00000100:00100000:3.0:1763334959.556916:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701782144:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334959.556941:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c25a8900 going to sleep for 11 seconds 00000100:00100000:3.0:1763334959.556960:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4430 00000100:00100000:3.0:1763334959.556968:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3292:x1848989701781376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334959.557207:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334959.557212:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763334959.557214:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334959.557216:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763334959.557219:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334959.557269:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+86:3292:x1848989701781376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 301us (1161us total) trans 17179870915 rc 0/0 00000100:00100000:3.0:1763334959.557276:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4430 00000100:00100000:3.0:1763334959.557300:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4431 00000100:00100000:3.0:1763334959.557307:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3292:x1848989701781888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334959.557441:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334959.557445:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763334959.557447:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334959.557449:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763334959.557451:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334959.557476:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3292:x1848989701781888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 170us (1334us total) trans 21474838199 rc 0/0 00000100:00100000:3.0:1763334959.557483:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4431 00000100:00100000:3.0:1763334959.557497:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4432 00000100:00100000:3.0:1763334959.557503:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3290:x1848989701781248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.557649:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+86:3290:x1848989701781248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 145us (1448us total) trans 17179870916 rc 0/0 00000100:00100000:3.0:1763334959.557656:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4432 00000100:00100000:3.0:1763334959.557670:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4433 00000100:00100000:3.0:1763334959.557676:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3290:x1848989701781760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334959.557776:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3290:x1848989701781760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (1545us total) trans 21474838200 rc 0/0 00000100:00100000:3.0:1763334959.557783:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4433 00000100:00100000:3.0:1763334959.557796:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4434 00000100:00100000:3.0:1763334959.557803:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+85:3290:x1848989701781120:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334959.557815:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:521 count 1 00002000:00010000:3.0:1763334959.557837:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x209:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334959.557843:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498946 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.557853:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334959.557855:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334959.557861:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.557875:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.557886:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498946 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.557895:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.557915:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334959.558120:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb224850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+86:3290:x1848989701781120:12345-0@lo:6:osp-syn-1-0.0 Request processed in 317us (1850us total) trans 17179870917 rc 0/0 00000100:00100000:3.0:1763334959.558127:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4434 00000100:00100000:3.0:1763334959.558140:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4435 00000100:00100000:3.0:1763334959.558146:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+20:3290:x1848989701781632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334959.558158:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:517 count 1 00002000:00010000:3.0:1763334959.558173:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x205:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334959.558179:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849894d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558186:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334959.558188:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334959.558191:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849894d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558202:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849894d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558209:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849894d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558217:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849894d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558231:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763334959.558401:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3290:x1848989701781632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 254us (2096us total) trans 21474838201 rc 0/0 00000100:00100000:3.0:1763334959.558409:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4435 00010000:00010000:3.0:1763334959.558654:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763334959.558662:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558671:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334959.558676:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498946 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558685:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498946 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558704:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498946 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558712:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498946 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558729:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334959.558732:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849894d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558739:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334959.558742:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849894d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558750:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849894d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558760:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849894d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558766:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849894d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.558777:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334959.558779:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334959.558782:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334959.558861:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334959.558910:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4d880/2, rc 0, transno 17179870917 00000100:00100000:3.0:1763334959.558919:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701781120:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763334959.558938:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4f480/2, rc 0, transno 21474838201 00000100:00100000:3.0:1763334959.558942:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701781632:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763334959.558952:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4ea00/2, rc 0, transno 17179870916 00000100:00100000:3.0:1763334959.558955:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701781248:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334959.558965:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4ed80/2, rc 0, transno 21474838200 00000100:00100000:3.0:1763334959.558969:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701781760:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334959.558997:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4c000/2, rc 0, transno 17179870915 00000100:00100000:3.0:1763334959.559002:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701781376:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334959.559011:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4f100/2, rc 0, transno 21474838199 00000100:00100000:3.0:1763334959.559015:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701781888:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1763334959.576720:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498931 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.576822:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498931 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334959.576897:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x178:0x0]: returning size 2 00000004:00200000:3.0:1763334959.576903:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334959.576933:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498931 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.576991:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849892a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef8f expref: 167 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.577017:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498931 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef8f expref: 166 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.577034:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:3.0:1763334959.577039:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334959.577044:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:3.0:1763334959.577154:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52951:x1848989694299648:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 70516us (70756us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.577165:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4252 00000100:00100000:1.0:1763334959.578689:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694300160 00000100:00100000:1.0:1763334959.578694:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694300160 00000100:00100000:1.0:1763334959.578740:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4436 00000100:00100000:1.0:1763334959.578748:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+47:52274:x1848989694300160:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334959.578769:0:7819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.578792:0:7819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498954 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aef96 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334959.578823:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334959.578841:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334959.578843:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334959.578852:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498954 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef96 expref: 48 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.578864:0:7819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498954 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef96 expref: 48 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.578875:0:7819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334959.578904:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+48:52274:x1848989694300160:12345-192.168.201.60@tcp:101:bash.0 Request processed in 158us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334959.578910:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4436 00010000:00010000:3.0:1763334959.579280:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849876a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeefc expref: 13 pid: 6519 timeout: 1124 lvb_type: 0 00000100:00100000:3.0:1763334959.579299:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701782144:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334959.579326:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849893f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.579338:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849893f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.579356:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849893f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.579368:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849893f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.579378:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849893f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.579404:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334959.579849:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3292:x1848989701781504:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23024us (23795us total) trans 21474838202 rc 0/0 00000100:00100000:3.0:1763334959.579861:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4429 00000004:00080000:3.0:1763334959.579916:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4ca80/2, rc 0, transno 21474838202 00000100:00100000:3.0:1763334959.579924:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701781504:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763334959.579994:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334959.580003:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849893f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.580014:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334959.580020:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849893f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.580032:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849893f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.580059:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849893f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.580066:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849893f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.580087:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334959.580089:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334959.580091:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334959.582746:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334959.582756:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.582765:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334959.582769:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498938 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.582777:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498938 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.582797:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498938 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.582804:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498938 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.582823:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334959.582825:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334959.582827:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334959.583174:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4e680/2, rc 0, transno 17179870918 00000100:00100000:3.0:1763334959.583183:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701780992:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.590229:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694300288 00000100:00100000:3.0:1763334959.590247:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694300288 00000100:00100000:3.0:1763334959.590326:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4437 00000100:00100000:3.0:1763334959.590338:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+47:2361:x1848989694300288:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334959.590378:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.590406:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849895b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aef9d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334959.590496:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701782272:192.168.201.60@tcp:106: 00000100:00100000:3.0:1763334959.592118:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ae1ada480 going to sleep for 11 seconds 00000100:00100000:1.0:1763334959.592543:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.597795:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694300544 00000100:00100000:3.0:1763334959.597810:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694300544 00002000:00010000:3.0:1763334959.597871:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/522 (0->18446744073709551615) 00002000:00100000:3.0:1763334959.597877:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a81880 with x1848989694300544 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334959.597894:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a81880. 00000100:00100000:1.0:1763334959.614311:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694300928 00000100:00100000:1.0:1763334959.614329:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694300928 00000100:00100000:1.0:1763334959.614534:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1577 00000100:00100000:1.0:1763334959.614546:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52951:x1848989694300928:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334959.616244:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52951:x1848989694300928:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1699us (3463us total) trans 8589938528 rc 0/0 00000100:00100000:1.0:1763334959.616253:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1577 00000100:00100000:1.0:1763334959.620762:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.621271:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694301312 00000100:00100000:3.0:1763334959.621288:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694301312 00000100:00100000:3.0:1763334959.621377:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4253 00000100:00100000:3.0:1763334959.621390:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52951:x1848989694301312:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334959.621426:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.621456:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498969 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aefab expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.621545:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498970 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.621566:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498970 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.621633:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498970 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.621650:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498977 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.621658:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498977 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.621664:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498977 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334959.631456:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694301568 00000100:00100000:3.0:1763334959.631471:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694301568 00000100:00100000:3.0:1763334959.631540:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694301824 00000100:00100000:3.0:1763334959.631544:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694301824 00000100:00100000:3.0:1763334959.631603:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4254 00000100:00100000:3.0:1763334959.631616:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52951:x1848989694301568:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334959.631643:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.631673:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498985 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aefb2 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.631808:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849898c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.631827:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498931 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef8f expref: 171 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.631841:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849897e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefab expref: 171 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.631851:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849898c lrc: 5/0,1 mode: --/CW res: [0x200000404:0x178:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.631895:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849897e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefab expref: 171 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.631911:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849897e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefab expref: 171 pid: 32232 timeout: 1124 lvb_type: 0 00000100:00100000:3.0:1763334959.631927:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701782400:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334959.632037:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498931 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef8f expref: 171 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.632047:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498931 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef8f expref: 171 pid: 32232 timeout: 1124 lvb_type: 0 00000100:00100000:3.0:1763334959.632056:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab37480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701782528:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334959.632082:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ae1ada9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763334959.638917:0:32232:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.60@tcp) returned -22 from blocking AST (req@00000000285419be x1848989701782400) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849897e lrc: 1/0,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefab expref: 170 pid: 32232 timeout: 1124 lvb_type: 0 00010000:00010000:3.0:1763334959.638951:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849897e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefab expref: 170 pid: 32232 timeout: 1124 lvb_type: 0 00000100:00100000:3.0:1763334959.638977:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab35880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701782400:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334959.646935:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.647008:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334959.648027:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84989a1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.648040:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84989a1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00080000:3.0:1763334959.648694:0:29627:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x178:0x0] is inserted into orphan list, open count = 1 00010000:00010000:3.0:1763334959.648864:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84989a1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.648877:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84989a1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.648886:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84989a1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.648894:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.648899:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84989a1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.648908:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84989a1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.648924:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:3.0:1763334959.648927:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763334959.648932:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84989a1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x178:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.648939:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84989a1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x178:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.648970:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498993 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.648977:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498993 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.648983:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498993 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.648988:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.648991:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498993 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.648996:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498993 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.649003:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334959.649006:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.649009:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498993 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.649015:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498993 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:3.0:1763334959.649024:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b19f9747 reply state 0000000054a9bad2 transno 8589938531 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f849899a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334959.649034:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334959.649134:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52952:x1848989694301824:12345-192.168.201.60@tcp:36:rm.0 Request processed in 16826us (17764us total) trans 8589938531 rc 0/0 00000100:00100000:3.0:1763334959.649144:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4255 00000100:00100000:1.0:1763334959.667410:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694302080 00000100:00100000:1.0:1763334959.667438:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694302080 00000100:00100000:1.0:1763334959.667540:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4256 00000100:00100000:1.0:1763334959.667553:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52951:x1848989694302080:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334959.667615:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.667657:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479400/0xcedf0054f84989af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aefb9 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.667798:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84989b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.667817:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84989b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.667833:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84989b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334959.667883:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x178:0x0]: returning size 5 00000004:00200000:1.0:1763334959.667888:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334959.667911:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84989b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.667945:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479400/0xcedf0054f84989af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefb9 expref: 171 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.667968:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84989b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefb9 expref: 170 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.667979:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ad2829f00) 00010000:00010000:1.0:1763334959.667982:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763334959.667987:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334959.668084:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52951:x1848989694302080:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 532us (21074us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334959.668093:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4256 00000100:00100000:1.0:1763334959.675760:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334959.676634:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f849899a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.676655:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f849899a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.676665:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f849899a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.676672:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.676678:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f849899a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.676688:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f849899a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.676713:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bdc00) 00010000:00010000:3.0:1763334959.676718:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.676724:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f849899a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.676732:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f849899a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334959.680933:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.682811:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694302592 00000100:00100000:3.0:1763334959.682825:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694302592 00000100:00100000:3.0:1763334959.682902:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4439 00000100:00100000:3.0:1763334959.682914:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+48:2359:x1848989694302592:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:3.0:1763334959.682977:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f84989d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.683000:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498954 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef96 expref: 48 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.683014:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334959.683017:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334959.683021:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f84989d2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.683067:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498954 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef96 expref: 48 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.683083:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498954 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef96 expref: 48 pid: 7819 timeout: 1124 lvb_type: 0 00000100:00100000:3.0:1763334959.683102:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701782656:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334959.683320:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ae1ada180 going to sleep for 11 seconds 00000100:00100000:1.0:1763334959.686950:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694302720 00000100:00100000:1.0:1763334959.686963:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694302720 00000100:00100000:1.0:1763334959.687043:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4259 00000100:00100000:1.0:1763334959.687054:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52953:x1848989694302720:12345-192.168.201.60@tcp:101:lfs.0 00000100:00100000:3.0:1763334959.687061:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701782656:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334959.687084:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.687094:0:6518:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f84989d2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.687111:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479400/0xcedf0054f84989ee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aefce expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.687198:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84989f5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687214:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84989f5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687225:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84989f5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687241:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84989fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687248:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84989fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687255:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84989fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687337:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84989f5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687357:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84989f5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687363:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84989f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687371:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.687376:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84989f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687384:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84989f5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687398:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334959.687401:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.687406:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84989f5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687412:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84989f5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687426:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84989fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687431:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84989fc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687437:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84989fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687441:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.687443:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84989fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687448:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84989fc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687455:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829000) 00010000:00010000:1.0:1763334959.687458:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.687460:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84989fc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687466:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84989fc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.687499:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479400/0xcedf0054f84989ee lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefce expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.687509:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334959.687511:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.687515:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479400/0xcedf0054f84989ee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefce expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.687524:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479400, rc 0) 00000100:00100000:1.0:1763334959.687649:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52953:x1848989694302720:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 595us (803us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334959.687658:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4259 00000100:00100000:1.0:1763334959.688821:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+51:2362:x1848989694302848:12345-192.168.201.60@tcp:4:bash.0 Request processed in 685us (1873us total) trans 17179870920 rc 0/0 00000100:00100000:1.0:1763334959.688829:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 63 00002000:00100000:1.0:1763334959.688836:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x20a:0x0] (0->4) req@ffff9a59c58c7100 x1848989694302848/t17179870920(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:5/0 lens 496/448 e 0 to 0 dl 1763334970 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334959.688845:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c7100 with x1848989694302848 ext(0->4) 00010000:00010000:1.0:1763334959.688850:0:14384:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498954 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef96 expref: 51 pid: 7819 timeout: 1124 lvb_type: 0 00010000:00010000:1.0:1763334959.688868:0:14384:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498954 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef96 expref: 51 pid: 7819 timeout: 1124 lvb_type: 0 00002000:00010000:1.0:1763334959.688875:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a59c58c7100 00000100:00100000:1.0:1763334959.692935:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694302976 00000100:00100000:1.0:1763334959.692950:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694302976 00000100:00100000:1.0:1763334959.693029:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4260 00000100:00100000:1.0:1763334959.693041:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52953:x1848989694302976:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334959.693072:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.693100:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498a03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aefd5 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.693197:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498a0a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.693215:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498a0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.693230:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498a0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334959.693313:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:1.0:1763334959.693318:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334959.693353:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498a0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334959.693360:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334959.693386:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498a03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefd5 expref: 173 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.693414:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498a0a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefd5 expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.693424:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334959.693428:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763334959.693432:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334959.693511:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52953:x1848989694302976:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 471us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334959.693519:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4260 00010000:00010000:3.0:1763334959.694417:0:6518:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f84989d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.694427:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f84989d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.694453:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f84989d2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.694462:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f84989d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.694471:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f84989d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.694478:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334959.694483:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f84989d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.694492:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f84989d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.694504:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f84989d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.694511:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f84989d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334959.696832:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+49:2359:x1848989694302592:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 13902us (14126us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.696851:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4439 00000100:00100000:3.0:1763334959.702707:0:29624:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694303232 00000100:00100000:3.0:1763334959.702722:0:29624:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694303232 00000100:00100000:3.0:1763334959.702797:0:29624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 134 00000100:00100000:3.0:1763334959.702809:0:29624:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01e7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1264d40-158f-4e44-9f7a-49909c525321+9:2362:x1848989694303232:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1763334959.707399:0:29624:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01e7f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1264d40-158f-4e44-9f7a-49909c525321+9:2362:x1848989694303232:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 4572us (5149us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.707420:0:29624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 134 00000100:00100000:3.0:1763334959.711322:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694303872 00000100:00100000:3.0:1763334959.711339:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694303872 00000100:00100000:3.0:1763334959.711429:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4263 00000100:00100000:3.0:1763334959.711442:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52953:x1848989694303872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334959.711473:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.711477:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334959.711513:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498a0a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefd5 expref: 173 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.711536:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334959.711543:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334959.711560:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498a2d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aefe3 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.711747:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a34 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.711765:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a34 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.711775:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a34 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.711791:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498a3b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.711797:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498a3b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.711804:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498a3b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.712428:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498a42 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x179:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.712441:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498a42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.712449:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498a42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334959.712461:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x179:0x0]: returning size 0 00010000:00010000:3.0:1763334959.712494:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a34 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.712502:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a34 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.712510:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a34 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.712517:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.712522:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a34 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.712530:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a34 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.712538:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334959.712541:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.712546:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a34 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.712557:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a34 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:3.0:1763334959.712597:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a2d13b8e reply state 00000000024e3b87 transno 8589938534 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498a3b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334959.712607:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763334959.712641:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498a2d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefe3 expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.712658:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498a42 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefe3 expref: 174 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.712666:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x179:0x0].0x0 (ffff9a5ae1a32c00) 00010000:00010000:3.0:1763334959.712669:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334959.712672:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8a00, rc 0) 00000100:00100000:3.0:1763334959.712776:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52953:x1848989694303872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1337us (1680us total) trans 8589938534 rc 0/0 00000100:00100000:3.0:1763334959.712786:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4263 00010000:00010000:1.0:1763334959.721186:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498a3b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.721202:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498a3b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.721211:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498a3b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.721217:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.721223:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498a3b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.721232:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498a3b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.721253:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32400) 00010000:00010000:1.0:1763334959.721258:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334959.721263:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498a3b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.721275:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498a3b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334959.725273:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701782784:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334959.725312:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498a57 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334959.726129:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.726304:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694304256 00000100:00100000:3.0:1763334959.726316:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694304256 00010000:00010000:3.0:1763334959.726380:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498a42 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefe3 expref: 176 pid: 32232 timeout: 1124 lvb_type: 0 00000100:00100000:3.0:1763334959.726429:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2363 00000100:00100000:3.0:1763334959.726441:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+176:2360:x1848989694304256:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334959.726461:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334959.726469:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498a42 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefe3 expref: 176 pid: 32232 timeout: 1124 lvb_type: 0 00010000:00010000:3.0:1763334959.726490:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498a42 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefe3 expref: 176 pid: 32232 timeout: 1124 lvb_type: 0 00010000:00010000:3.0:1763334959.726519:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498a42 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefe3 expref: 176 pid: 32232 timeout: 1124 lvb_type: 0 00010000:00010000:3.0:1763334959.726539:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x179:0x0].0x0 (ffff9a5ae1a32c00) 00010000:00010000:3.0:1763334959.726546:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498a57 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.726557:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498a57 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.726565:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498a57 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.726638:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334959.726707:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+175:2360:x1848989694304256:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 267us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.726715:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2363 00010000:00010000:1.0:1763334959.727940:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498a57 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.727956:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498a57 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334959.727982:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x179:0x0]: returning size 0 00000004:00080000:1.0:1763334959.728377:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x208:0x0], index 0: 0 00000004:00080000:1.0:1763334959.728390:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20c:0x0], index 1: 0 00000004:00080000:1.0:1763334959.728397:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20d:0x0], index 1: 0 00000004:00080000:1.0:1763334959.728402:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x209:0x0], index 0: 0 00010000:00010000:1.0:1763334959.729560:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498a57 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.729611:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498a57 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.729621:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498a57 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.729628:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334959.729633:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498a57 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.729643:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498a57 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.729664:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x179:0x0].0x0 (ffff9a5ae1a32c00) 00010000:00010000:1.0:1763334959.729667:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334959.729672:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498a57 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.729679:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498a57 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334959.729760:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498a50 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefea expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.729773:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334959.729776:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334959.729780:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498a50 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefea expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.729789:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066c00, rc 0) 00000100:00100000:1.0:1763334959.729872:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52953:x1848989694304128:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 10132us (10896us total) trans 8589938535 rc 301/301 00000100:00100000:1.0:1763334959.729882:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4264 00000100:00100000:1.0:1763334959.737372:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.737422:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694304512 00000100:00100000:1.0:1763334959.737438:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694304512 00000100:00100000:1.0:1763334959.737510:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1579 00000100:00100000:1.0:1763334959.737522:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52953:x1848989694304512:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334959.738016:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52953:x1848989694304512:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 493us (654us total) trans 8589938536 rc 0/0 00000100:00100000:1.0:1763334959.738024:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1579 00000100:00100000:1.0:1763334959.742636:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.747824:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.748427:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694305024 00000100:00100000:3.0:1763334959.748445:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694305024 00000100:00100000:3.0:1763334959.748846:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4265 00000100:00100000:3.0:1763334959.748858:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52274:x1848989694305024:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334959.748884:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.748912:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498a65 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeff1 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.749160:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a6c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749178:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a6c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749192:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a6c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749206:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498a73 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749214:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498a73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749219:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498a73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749327:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498a7a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x179:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749336:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498a7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749355:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498a7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334959.749369:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x179:0x0]: returning size 0 00010000:00010000:3.0:1763334959.749508:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a6c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749516:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a6c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749523:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a6c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749534:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.749539:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a6c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749547:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a6c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749562:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334959.749566:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.749599:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a6c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749608:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498a6c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749624:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498a73 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749630:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498a73 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749636:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498a73 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749641:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.749643:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498a73 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749649:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498a73 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749656:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32700) 00010000:00010000:3.0:1763334959.749659:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.749661:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498a73 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749667:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498a73 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334959.749718:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498a65 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeff1 expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.749734:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498a7a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeff1 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.749742:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x179:0x0].0x0 (ffff9a5ae1a32c00) 00010000:00010000:3.0:1763334959.749745:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334959.749747:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9a00, rc 0) 00000100:00100000:3.0:1763334959.749826:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52274:x1848989694305024:12345-192.168.201.60@tcp:101:bash.0 Request processed in 970us (2018us total) trans 8589938538 rc 0/0 00000100:00100000:3.0:1763334959.749835:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4265 00000100:00100000:1.0:1763334959.756929:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.762142:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694305280 00000100:00100000:3.0:1763334959.762165:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694305280 00000100:00100000:3.0:1763334959.762261:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4266 00000100:00100000:3.0:1763334959.762273:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52274:x1848989694305280:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:3.0:1763334959.762359:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334959.762399:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498a7a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x179:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeff1 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.762425:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x179:0x0].0x0 (ffff9a5ae1a32c00) 00010000:00010000:3.0:1763334959.762440:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334959.762787:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498a88 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x179:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.762803:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498a88 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.762815:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498a88 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:3.0:1763334959.762882:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938539 00000004:00010000:3.0:1763334959.762910:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c3ab84a0 reply state 00000000948d5a80 transno 8589938540 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498a88 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334959.762919:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334959.763081:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52274:x1848989694305280:12345-192.168.201.60@tcp:36:bash.0 Request processed in 808us (6167us total) trans 8589938540 rc 0/0 00000100:00100000:3.0:1763334959.763091:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4266 00000020:00080000:3.0:1763334959.763097:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763334959.765304:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498a88 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.765325:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498a88 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.765333:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498a88 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.765339:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.765358:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498a88 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.765367:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498a88 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.765388:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x179:0x0].0x0 (ffff9a5ae1a32100) 00010000:00010000:3.0:1763334959.765392:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.765399:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498a88 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.765405:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498a88 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x179:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334959.766566:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.766883:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694305408 00000100:00100000:3.0:1763334959.766899:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694305408 00000100:00100000:3.0:1763334959.766970:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4267 00000100:00100000:3.0:1763334959.766981:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52274:x1848989694305408:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334959.767009:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.767036:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498a8f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x179:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aeff8 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.767115:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498a8f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeff8 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.767131:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498a8f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x179:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aeff8 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.767154:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x179:0x0].0x0 (ffff9a5ae1a32700) 00010000:00010000:3.0:1763334959.767157:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334959.767161:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8a00, rc 0) 00000100:00100000:3.0:1763334959.770812:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52274:x1848989694305408:12345-192.168.201.60@tcp:101:bash.0 Request processed in 3811us (4235us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.770830:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4267 00000100:00100000:3.0:1763334959.774123:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000001:00080000:1.0:1763334959.793724:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938532 is committed 00000001:00080000:1.0:1763334959.793761:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938533 is committed 00000004:00080000:1.0:1763334959.793767:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 649 committed 00000004:00080000:1.0:1763334959.793779:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 637 committed 00000004:00080000:1.0:1763334959.793787:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 636 committed 00000004:00080000:1.0:1763334959.793789:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 648 committed 00000001:00080000:1.0:1763334959.793796:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938534 is committed 00000100:00100000:1.0:1763334959.793988:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701782912:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334959.794080:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334959.794147:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701783040:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334959.794173:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334959.794216:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701782912 00000100:00100000:1.0:1763334959.794226:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701782912 00000100:00100000:1.0:1763334959.794276:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701783040 00000100:00100000:1.0:1763334959.794279:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701783040 00000100:00100000:1.0:1763334959.794303:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4440 00000100:00100000:1.0:1763334959.794313:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+87:3292:x1848989701782912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334959.794618:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+88:3292:x1848989701782912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 305us (536us total) trans 17179870921 rc 0/0 00000100:00100000:1.0:1763334959.794626:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4440 00000100:00100000:1.0:1763334959.794648:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4441 00000100:00100000:1.0:1763334959.794654:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+87:3289:x1848989701783040:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334959.794735:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334959.794738:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763334959.794741:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334959.794743:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763334959.794745:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334959.794770:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+88:3289:x1848989701783040:12345-0@lo:2:osp-syn-1-0.0 Request processed in 117us (596us total) trans 17179870922 rc 0/0 00000100:00100000:1.0:1763334959.794775:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4441 00000004:00080000:1.0:1763334959.794820:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6450e00/2, rc 0, transno 17179870922 00000100:00100000:1.0:1763334959.794831:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6450e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701783040:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334959.794854:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6452680/2, rc 0, transno 17179870921 00000100:00100000:1.0:1763334959.794863:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6452680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701782912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.802698:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.809224:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.809276:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694305920 00000100:00100000:3.0:1763334959.809292:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694305920 00000100:00100000:3.0:1763334959.809380:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4270 00000100:00100000:3.0:1763334959.809393:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52951:x1848989694305920:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334959.809419:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.809450:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498aab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af00d expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.809553:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498ab2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.809593:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.809608:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334959.809659:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x178:0x0]: returning size 5 00000004:00200000:3.0:1763334959.809665:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334959.809688:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498ab2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.809727:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498aab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af00d expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.809746:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498ab2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af00d expref: 175 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.809757:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ad2829f00) 00010000:00010000:3.0:1763334959.809761:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763334959.809765:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9a00, rc 0) 00000100:00100000:3.0:1763334959.809840:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52951:x1848989694305920:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 449us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.809848:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4270 00000100:00100000:3.0:1763334959.816035:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000001:00080000:1.0:1763334959.833265:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938537 is committed 00000001:00080000:3.0:1763334959.833471:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938541 is committed 00000004:00080000:3.0:1763334959.833478:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 639 committed 00000004:00080000:3.0:1763334959.833495:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 651 committed 00000004:00080000:3.0:1763334959.833513:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 650 committed 00000004:00080000:3.0:1763334959.833515:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 638 committed 00000100:00100000:1.0:1763334959.834765:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701783808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334959.834851:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334959.836136:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763334959.836146:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701783424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.838922:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701783424 00000100:00100000:3.0:1763334959.838929:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701783424 00000004:00080000:1.0:1763334959.840471:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c5f80/2, rc 0, transno 17179870924 00000100:00100000:1.0:1763334959.840480:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701783424:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334959.842234:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.846383:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.846425:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694306304 00000100:00100000:3.0:1763334959.846436:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694306304 00000100:00100000:3.0:1763334959.846497:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4450 00000100:00100000:3.0:1763334959.846509:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+50:52274:x1848989694306304:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334959.846529:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334959.846556:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498ac7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af022 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334959.846611:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334959.846635:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334959.846637:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334959.846648:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498ac7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af022 expref: 51 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.846665:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498ac7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af022 expref: 51 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334959.846685:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8000, rc 0) 00000100:00100000:3.0:1763334959.846746:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+51:52274:x1848989694306304:12345-192.168.201.60@tcp:101:bash.0 Request processed in 240us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.846753:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4450 00000100:00100000:0.0:1763334959.847546:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701783936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1763334959.847564:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334959.847608:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1848989701784448:0@lo:400:kworker.0 00000100:00100000:0.0:1763334959.847626:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334959.847649:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701784576 00000100:00100000:0.0:1763334959.847652:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701784576 00000100:00100000:0.0:1763334959.847669:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701783936 00000100:00100000:0.0:1763334959.847671:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701783936 00000100:00100000:0.0:1763334959.847682:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1763334959.847688:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+25:3290:x1848989701784576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1763334959.847704:0:6521:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 42532864 pending 0 free 3856662528 avail 3853516800 00000100:00100000:0.0:1763334959.847735:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+25:3290:x1848989701784576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334959.847741:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1763334959.847751:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1763334959.847756:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+90:3291:x1848989701783936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1763334959.847765:0:6521:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 67960832 pending 6815744 free 3856662528 avail 3854565376 00000100:00100000:0.0:1763334959.847788:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+90:3291:x1848989701783936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 32us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334959.847793:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1763334959.847821:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701784576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1763334959.847835:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701784320 00000100:00100000:0.0:1763334959.847838:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701784320 00000100:00100000:0.0:1763334959.847862:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701784448 00000100:00100000:0.0:1763334959.847864:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701784448 00000100:00100000:0.0:1763334959.847880:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1763334959.847885:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1848989701784320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763334959.847917:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1848989701784320:12345-0@lo:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334959.847924:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:1.0:1763334959.848773:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1763334959.848823:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701783936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1763334959.848837:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1848989701784448:0@lo:400:kworker.0 00000100:00100000:1.0:1763334959.848849:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1848989701784320:0@lo:400:kworker.0 00000100:00100000:3.0:1763334959.851358:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334959.857778:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.859887:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694306560 00000100:00100000:3.0:1763334959.859910:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694306560 00002000:00010000:3.0:1763334959.859985:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/524 (0->18446744073709551615) 00002000:00100000:3.0:1763334959.859991:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad81ffb80 with x1848989694306560 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334959.860010:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad81ffb80. 00000100:00100000:3.0:1763334959.860069:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1667 00000100:00100000:3.0:1763334959.860080:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+51:2360:x1848989694306560:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334959.860545:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334959.860551:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20c:0x0] updating lvb mtime from disk: 0 -> 1763334960 00002000:00010000:3.0:1763334959.860554:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334959.860556:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20c:0x0] updating lvb ctime from disk: 0 -> 1763334960 00002000:00010000:3.0:1763334959.860558:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334959.860687:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+52:2360:x1848989694306560:12345-192.168.201.60@tcp:10:bash.0 Request processed in 608us (2920us total) trans 17179870925 rc 0/0 00000100:00100000:3.0:1763334959.860697:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1667 00002000:00010000:3.0:1763334959.860703:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/524 (0->18446744073709551615) 00002000:00100000:3.0:1763334959.860706:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad81ffb80 with x1848989694306560 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334959.860711:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad81ffb80. 00000100:00100000:0.0:1763334959.866017:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.866922:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694306816 00000100:00100000:1.0:1763334959.866938:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694306816 00000100:00100000:1.0:1763334959.867092:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1581 00000100:00100000:1.0:1763334959.867107:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52274:x1848989694306816:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:1.0:1763334959.868688:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52274:x1848989694306816:12345-192.168.201.60@tcp:35:bash.0 Request processed in 1574us (2676us total) trans 8589938542 rc 0/0 00000100:00100000:1.0:1763334959.868702:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1581 00000100:00100000:0.0:1763334959.869462:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.869607:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694306944 00000100:00100000:1.0:1763334959.869620:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694306944 00000100:00100000:1.0:1763334959.869704:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1668 00000100:00100000:1.0:1763334959.869714:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+52:2360:x1848989694306944:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:1.0:1763334959.869762:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8498ace lrc: 3/1,0 mode: --/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.869782:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334959.869785:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334959.869792:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8498ace lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.869809:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8498ace lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.869980:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8498ace lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.869991:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8498ace lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.870000:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8498ace lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.870008:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334959.870013:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8498ace lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.870023:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8498ace lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.870059:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8498ace lrc: 2/0,0 mode: --/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.870068:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8498ace lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334959.870128:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+52:2360:x1848989694306944:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 415us (672us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763334959.870136:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1668 00000100:00100000:0.0:1763334959.880135:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334959.883027:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334959.883679:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4272 00000100:00100000:1.0:1763334959.884216:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52951:x1848989694307200:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334959.884241:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334959.884266:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8498af1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af030 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.884306:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479400/0xcedf0054f8498af8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.884330:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479400/0xcedf0054f8498af8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.884352:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479400/0xcedf0054f8498af8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334959.884479:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8498af1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af030 expref: 171 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.884495:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479400/0xcedf0054f8498af8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x178:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af030 expref: 170 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.884503:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ad2829f00) 00010000:00010000:1.0:1763334959.884506:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1763334959.884509:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479400, rc 0) 00000100:00100000:1.0:1763334959.884610:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52951:x1848989694307200:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 921us (1582us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334959.884618:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4272 00010000:00010000:3.0:1763334959.905422:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498b06 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.905450:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498b06 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.905461:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498b06 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.905468:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334959.905476:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498b06 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.905485:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498b06 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.907514:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab100) 00010000:00010000:3.0:1763334959.907528:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334959.907542:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498b06 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334959.907553:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498b06 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334959.907849:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694307712 00000100:00100000:1.0:1763334959.907859:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694307712 00000100:00100000:0.0:1763334959.907885:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14183:1848989701784704:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334959.907907:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84988b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef5e expref: 18 pid: 6519 timeout: 1124 lvb_type: 1 00010000:00010000:0.0:1763334959.907916:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498b1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334959.907955:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2364 00000100:00100000:1.0:1763334959.907965:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694307712:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334959.907989:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334959.908017:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84988b3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef5e expref: 18 pid: 6519 timeout: 1124 lvb_type: 1 00010000:00010000:1.0:1763334959.908032:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84988b3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef5e expref: 18 pid: 6519 timeout: 1124 lvb_type: 1 00010000:00010000:1.0:1763334959.908057:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84988b3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef5e expref: 18 pid: 6519 timeout: 1124 lvb_type: 1 00010000:00010000:1.0:1763334959.908072:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334959.908074:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334959.908079:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498b1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.908089:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498b1b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334959.908127:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334959.908257:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498b1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334959.908266:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498b1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334959.908759:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694307712:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 793us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334959.908769:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2364 00000100:00100000:0.0:1763334959.923055:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334959.923099:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694307840 00000100:00100000:0.0:1763334959.923112:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694307840 00000100:00100000:0.0:1763334959.923175:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4274 00000100:00100000:0.0:1763334959.923187:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52955:x1848989694307840:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334959.923218:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334959.923246:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498b22 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af037 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334959.923338:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498b29 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923368:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498b29 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923382:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498b29 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923397:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b30 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923404:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b30 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923410:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b30 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923492:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498b29 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923500:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498b29 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923506:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498b29 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923512:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334959.923517:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498b29 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923526:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498b29 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923550:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334959.923553:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334959.923560:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498b29 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923566:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498b29 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923600:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b30 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923606:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b30 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923612:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b30 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923617:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334959.923620:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b30 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923626:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b30 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923633:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bdc00) 00010000:00010000:0.0:1763334959.923636:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334959.923639:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b30 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923643:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b30 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.923678:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498b22 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af037 expref: 170 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334959.923690:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334959.923692:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334959.923695:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498b22 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af037 expref: 170 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334959.923703:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334959.923779:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52955:x1848989694307840:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 593us (737us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334959.923788:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4274 00000100:00100000:3.0:1763334959.930205:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334959.931804:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694307968 00000100:00100000:0.0:1763334959.931824:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694307968 00000100:00100000:0.0:1763334959.931914:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4275 00000100:00100000:0.0:1763334959.931928:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52955:x1848989694307968:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334959.931958:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334959.931990:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498b37 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af03e expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334959.932108:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498b3e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932126:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498b3e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932142:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498b3e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932158:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498b45 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932170:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498b45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932176:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498b45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932264:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498b3e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932272:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498b3e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932279:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498b3e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932285:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334959.932290:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498b3e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932298:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498b3e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932313:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334959.932317:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334959.932323:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498b3e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932330:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498b3e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932360:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498b45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932367:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498b45 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932373:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498b45 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932378:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334959.932381:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498b45 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932388:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498b45 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932394:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd200) 00010000:00010000:0.0:1763334959.932397:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334959.932400:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498b45 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932405:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498b45 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.932444:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498b37 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af03e expref: 170 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334959.932457:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334959.932459:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334959.932463:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498b37 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af03e expref: 170 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334959.932474:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334959.932618:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52955:x1848989694307968:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 643us (2379us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334959.932628:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4275 00000100:00100000:1.0:1763334959.937935:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334959.938369:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694308096 00000100:00100000:0.0:1763334959.938385:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694308096 00000100:00100000:0.0:1763334959.938464:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4276 00000100:00100000:0.0:1763334959.938479:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52955:x1848989694308096:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334959.938513:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334959.938545:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498b4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af045 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334959.938673:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b53 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.938693:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.938708:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334959.938791:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:0.0:1763334959.938796:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334959.938841:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334959.938877:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498b4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af045 expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334959.938900:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498b53 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af045 expref: 170 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334959.938911:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334959.938914:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763334959.938918:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792c00, rc 0) 00000100:00100000:0.0:1763334959.939007:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52955:x1848989694308096:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 532us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334959.939015:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4276 00000100:00100000:1.0:1763334959.946627:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334959.956488:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334959.960482:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694308480 00000100:00100000:0.0:1763334959.960508:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694308480 00000100:00100000:0.0:1763334959.969702:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694308736 00000100:00100000:0.0:1763334959.969718:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694308736 00000100:00100000:0.0:1763334959.969810:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4279 00000100:00100000:0.0:1763334959.969824:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52955:x1848989694308736:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334959.969859:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334959.969887:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498b92 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af05a expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334959.970024:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498b99 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.970042:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498b84 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af053 expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334959.970053:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498b99 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334959.970098:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498b84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af053 expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334959.970115:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498b84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af053 expref: 172 pid: 29627 timeout: 1124 lvb_type: 0 00000100:00100000:0.0:1763334959.970131:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701784832:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334959.970259:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af69b2c00 going to sleep for 11 seconds 00010000:00010000:1.0:1763334959.976435:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334959.978486:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334959.978768:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694308864 00000100:00100000:3.0:1763334959.978784:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694308864 00010000:00010000:3.0:1763334959.978840:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498b84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af053 expref: 173 pid: 29627 timeout: 1124 lvb_type: 0 00000100:00100000:3.0:1763334959.978891:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2365 00000100:00100000:3.0:1763334959.978901:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+173:2362:x1848989694308864:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334959.978920:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334959.978928:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498b84 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af053 expref: 173 pid: 29627 timeout: 1124 lvb_type: 0 00010000:00010000:3.0:1763334959.978942:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498b84 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af053 expref: 173 pid: 29627 timeout: 1124 lvb_type: 0 00010000:00010000:3.0:1763334959.978973:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498b84 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af053 expref: 173 pid: 29627 timeout: 1124 lvb_type: 0 00010000:00010000:3.0:1763334959.978995:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17b:0x0].0x0 (ffff9a5ac6cabc00) 00010000:00010000:3.0:1763334959.979001:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498b99 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.979012:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498b99 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.979020:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498b99 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334959.979060:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334959.979131:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d39050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:2362:x1848989694308864:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 230us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334959.979139:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2365 00000100:00100000:1.0:1763334959.988942:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334959.989035:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694309120 00000100:00100000:0.0:1763334959.989050:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694309120 00000100:00100000:0.0:1763334959.989118:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1582 00000100:00100000:0.0:1763334959.989131:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c36bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52955:x1848989694309120:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334959.989662:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c36bcc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52955:x1848989694309120:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 529us (733us total) trans 8589938546 rc 0/0 00000100:00100000:0.0:1763334959.989672:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1582 00000100:00100000:0.0:1763334959.992857:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.007671:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00002000:00010000:0.0:1763334960.009402:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763334960.009415:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb mtime from disk: 0 -> 1763334960 00002000:00010000:0.0:1763334960.009418:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb ctime from disk: 0 -> 1763334960 00002000:00010000:0.0:1763334960.009421:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1763334960.009438:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498b1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.009452:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498b1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.009462:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498b1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.009470:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334960.009474:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498b1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.009484:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498b1b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.009512:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498b1b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.009519:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498b1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334960.009700:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694307584:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 109870us (111913us total) trans 21474838209 rc 0/0 00000100:00100000:0.0:1763334960.009713:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1669 00000100:00100000:3.0:1763334960.010672:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694309632 00000100:00100000:3.0:1763334960.010691:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694309632 00000100:00100000:3.0:1763334960.010781:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4280 00000100:00100000:3.0:1763334960.010796:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52274:x1848989694309632:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334960.010825:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334960.010851:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498ba7 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af061 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.011063:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498bae lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011081:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498bae lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011092:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498bae lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011109:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498bb5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011116:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011141:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011281:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498bbc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011290:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498bbc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011297:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498bbc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334960.011308:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17b:0x0]: returning size 0 00010000:00010000:3.0:1763334960.011448:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498bae lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011456:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498bae lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011468:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498bae lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011474:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334960.011478:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498bae lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011486:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498bae lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011499:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334960.011502:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334960.011507:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498bae lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011513:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498bae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011526:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011532:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498bb5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011538:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011543:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334960.011545:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011551:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498bb5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011559:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32a00) 00010000:00010000:3.0:1763334960.011562:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334960.011564:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498bb5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011605:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498bb5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.011662:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498ba7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af061 expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.011678:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498bbc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af061 expref: 175 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.011688:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17b:0x0].0x0 (ffff9a5ae1a32c00) 00010000:00010000:3.0:1763334960.011692:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334960.011696:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8a00, rc 0) 00000100:00100000:3.0:1763334960.011778:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52274:x1848989694309632:12345-192.168.201.60@tcp:101:bash.0 Request processed in 985us (4123us total) trans 8589938548 rc 0/0 00000100:00100000:3.0:1763334960.011788:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4280 00000100:00080000:1.0:1763334960.012109:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1763334960.019716:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.019941:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694309888 00000100:00100000:3.0:1763334960.019957:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694309888 00000100:00100000:3.0:1763334960.020036:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4281 00000100:00100000:3.0:1763334960.020049:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52274:x1848989694309888:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:3.0:1763334960.020133:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334960.020172:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498bbc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af061 expref: 175 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.020201:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17b:0x0].0x0 (ffff9a5ae1a32c00) 00010000:00010000:3.0:1763334960.020214:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334960.020601:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498bca lrc: 3/0,1 mode: --/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.020619:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498bca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.020632:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498bca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:3.0:1763334960.020696:0:29627:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938549 00000004:00010000:3.0:1763334960.020721:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007fd6a2f7 reply state 00000000f2403f0b transno 8589938550 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498bca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334960.020732:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334960.021508:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52274:x1848989694309888:12345-192.168.201.60@tcp:36:bash.0 Request processed in 1455us (1800us total) trans 8589938550 rc 0/0 00000100:00100000:3.0:1763334960.021519:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4281 00000020:00080000:3.0:1763334960.021526:0:29627:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763334960.045788:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498bca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334960.045793:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334960.045804:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498bca lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.045812:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498bca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.045820:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334960.045826:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498bca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.045837:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498bca lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334960.045838:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334960.045856:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17b:0x0].0x0 (ffff9a5ae1a32100) 00010000:00010000:3.0:1763334960.045860:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334960.045866:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498bca lrc: 2/0,0 mode: --/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.045873:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498bca lrc: 0/0,0 mode: --/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334960.045929:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694310272 00000100:00100000:1.0:1763334960.045936:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694310272 00000100:00100000:1.0:1763334960.045994:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4283 00000100:00100000:1.0:1763334960.046007:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52951:x1848989694310272:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334960.046072:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334960.046095:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498ab2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x178:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af00d expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.046107:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ad2829f00) 00010000:00010000:1.0:1763334960.046112:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334960.046174:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498bd8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.046189:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.046201:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:1.0:1763334960.046450:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007d798884 reply state 0000000057524303 transno 8589938551 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334960.046461:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334960.046566:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52951:x1848989694310272:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 564us (726us total) trans 8589938551 rc 0/0 00000100:00100000:1.0:1763334960.046600:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4283 00000100:00100000:0.0:1763334960.050945:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000004:00080000:2.0:1763334960.052648:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1024686075842ns, next at 1025532430821ns, rc = 0 00010000:00010000:0.0:1763334960.053532:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498bd8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.053552:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498bd8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.053562:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498bd8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.053601:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.053607:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498bd8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.053616:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498bd8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.053635:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ad2829f00) 00010000:00010000:0.0:1763334960.053640:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.053646:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498bd8 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.053652:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8498bd8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334960.053831:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.053906:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694310656 00000100:00100000:1.0:1763334960.053920:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694310656 00000100:00080000:3.0:1763334960.054881:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763334960.055779:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4451 00000100:00100000:3.0:1763334960.055808:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+11:52951:x1848989694310656:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334960.055838:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334960.055872:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498bed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af076 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334960.055911:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x207:0x0] initial LVB size: 4096, mtime: 0x691a5b30, atime: 0x0, ctime: 0x691a5b30, blocks: 0xb 00010000:00010000:3.0:1763334960.055947:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.055951:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.055961:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498bed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af076 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.055981:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498bed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af076 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.056005:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9e00, rc 0) 00000100:00100000:3.0:1763334960.056116:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+12:52951:x1848989694310656:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 321us (2289us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334960.056140:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4451 00000100:00100000:0.0:1763334960.065045:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.065118:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694310784 00000100:00100000:0.0:1763334960.065133:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694310784 00000100:00080000:3.0:1763334960.065193:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763334960.065224:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4452 00000100:00100000:0.0:1763334960.065238:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+52:52951:x1848989694310784:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.065266:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.065310:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498bf4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af07d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.065361:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f84988ba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef65 expref: 53 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334960.065371:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.065374:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.065379:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498bf4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af07d expref: 53 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.065430:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f84988ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef65 expref: 53 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334960.065449:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f84988ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef65 expref: 53 pid: 6519 timeout: 1124 lvb_type: 1 00000100:00100000:0.0:1763334960.065556:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701784960:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334960.065950:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa806cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334960.069277:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3ae300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701784960:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334960.069328:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498bf4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af07d expref: 53 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.069365:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334960.069437:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+53:52951:x1848989694310784:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4202us (4408us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.069448:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4452 00000100:00100000:3.0:1763334960.076507:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.076655:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694310912 00000100:00100000:1.0:1763334960.076669:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694310912 00010000:00010000:1.0:1763334960.076723:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f84988ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef65 expref: 53 pid: 6519 timeout: 1124 lvb_type: 1 00000100:00100000:1.0:1763334960.076780:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2366 00000100:00100000:1.0:1763334960.076790:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+53:2360:x1848989694310912:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334960.076808:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334960.076836:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f84988ba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef65 expref: 53 pid: 6519 timeout: 1124 lvb_type: 1 00010000:00010000:1.0:1763334960.076850:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f84988ba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef65 expref: 53 pid: 6519 timeout: 1124 lvb_type: 1 00010000:00010000:1.0:1763334960.076881:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f84988ba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aef65 expref: 53 pid: 6519 timeout: 1124 lvb_type: 1 00010000:00010000:1.0:1763334960.076902:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.076905:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.076911:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498bf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af07d expref: 52 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.076924:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498bf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af07d expref: 52 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.076987:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498bf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af07d expref: 52 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334960.077007:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701785088:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334960.077138:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e70a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334960.084489:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.084603:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.084665:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694311040 00000100:00100000:2.0:1763334960.084679:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694311040 00002000:00010000:2.0:1763334960.084740:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/519 (5->18446744073709551615) 00002000:00100000:2.0:1763334960.084745:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a23480 with x1848989694311040 ext(5->18446744073709551615) 00002000:00010000:2.0:1763334960.084762:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6a23480. 00000100:00100000:2.0:1763334960.084794:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694311168 00000100:00100000:2.0:1763334960.084797:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694311168 00002000:00010000:2.0:1763334960.084812:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/523 (0->18446744073709551615) 00002000:00100000:2.0:1763334960.084816:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a20700 with x1848989694311168 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334960.084824:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a20700. 00000100:00100000:0.0:1763334960.084842:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1670 00000100:00100000:0.0:1763334960.084858:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2359:x1848989694311040:12345-192.168.201.60@tcp:10:lfs.0 00000100:00100000:2.0:1763334960.085054:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1671 00000100:00100000:2.0:1763334960.085064:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+53:2359:x1848989694311168:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:2.0:1763334960.085446:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334960.085447:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:2.0:1763334960.085452:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb mtime from disk: 0 -> 1763334960 00002000:00010000:0.0:1763334960.085453:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb mtime from disk: 1763334960 -> 1763334960 00002000:00010000:2.0:1763334960.085458:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334960.085460:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334960.085462:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb ctime from disk: 0 -> 1763334960 00002000:00010000:0.0:1763334960.085464:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb ctime from disk: 1763334960 -> 1763334960 00002000:00010000:2.0:1763334960.085467:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1763334960.085469:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1763334960.085746:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+54:2359:x1848989694311168:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 682us (1141us total) trans 17179870926 rc 0/0 00000100:00100000:2.0:1763334960.085754:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1671 00002000:00010000:2.0:1763334960.085759:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/523 (0->18446744073709551615) 00002000:00100000:2.0:1763334960.085762:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a20700 with x1848989694311168 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334960.085767:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a20700. 00000100:00100000:0.0:1763334960.088034:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2359:x1848989694311040:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 3163us (3544us total) trans 21474838210 rc 0/0 00000100:00100000:0.0:1763334960.088056:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1670 00002000:00010000:0.0:1763334960.088066:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/519 (5->18446744073709551615) 00002000:00100000:0.0:1763334960.088070:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a23480 with x1848989694311040 ext(5->18446744073709551615) 00002000:00010000:0.0:1763334960.088086:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6a23480. 00000100:00100000:1.0:1763334960.088534:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9830a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701785088:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334960.088603:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334960.088654:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+53:2360:x1848989694310912:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 11864us (12165us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.088666:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2366 00000100:00100000:1.0:1763334960.090015:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.090907:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694311424 00000100:00100000:0.0:1763334960.090924:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694311424 00000100:00100000:0.0:1763334960.091012:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4285 00000100:00100000:0.0:1763334960.091027:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52951:x1848989694311424:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334960.091172:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498bfb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.091198:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498bfb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.091213:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498bfb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334960.091493:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001dadc2e1 reply state 00000000a7a3939b transno 8589938553 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498bfb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334960.091505:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334960.091667:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52951:x1848989694311424:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 643us (1664us total) trans 8589938553 rc 0/0 00000100:00100000:0.0:1763334960.091677:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4285 00010000:00010000:1.0:1763334960.093983:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498bfb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.094010:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498bfb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.094019:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498bfb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.094026:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.094032:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498bfb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.094043:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498bfb lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.094064:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ad2829f00) 00010000:00010000:1.0:1763334960.094068:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334960.094074:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498bfb lrc: 2/0,0 mode: --/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.094082:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498bfb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x178:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334960.096012:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.096143:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694311552 00000100:00100000:0.0:1763334960.096158:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694311552 00000100:00100000:0.0:1763334960.096237:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4453 00000100:00100000:0.0:1763334960.096250:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+53:2359:x1848989694311552:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334960.096488:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20a:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763334960.096493:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20a:0x0] updating lvb mtime from disk: 1763334960 -> 1763334960 00002000:00010000:0.0:1763334960.096495:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20a:0x0] updating lvb atime from disk: 1763334960 -> 1763334960 00002000:00010000:0.0:1763334960.096498:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20a:0x0] updating lvb ctime from disk: 1763334960 -> 1763334960 00002000:00010000:0.0:1763334960.096500:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334960.098772:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+54:2359:x1848989694311552:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 2507us (2754us total) trans 17179870927 rc 0/0 00000100:00100000:0.0:1763334960.098790:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4453 00000100:00100000:0.0:1763334960.112740:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.112951:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694311808 00000100:00100000:2.0:1763334960.112965:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694311808 00000100:00100000:2.0:1763334960.113039:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1584 00000100:00100000:2.0:1763334960.113052:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52951:x1848989694311808:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:2.0:1763334960.113153:0:29630:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x178:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84989c4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefc0 expref: 180 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.113229:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334960.113245:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498aa4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af006 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.113256:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334960.113303:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498aa4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af006 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.113319:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498aa4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af006 expref: 180 pid: 29627 timeout: 1124 lvb_type: 0 00000100:00100000:2.0:1763334960.113346:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701785216:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334960.113459:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334960.118645:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.118807:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701785216:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334960.118844:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:0.0:1763334960.119133:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694311936 00000100:00100000:0.0:1763334960.119144:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694311936 00010000:00010000:0.0:1763334960.119195:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498aa4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af006 expref: 181 pid: 29627 timeout: 1124 lvb_type: 0 00000100:00100000:1.0:1763334960.119655:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2367 00000100:00100000:1.0:1763334960.119669:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:2359:x1848989694311936:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334960.119692:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334960.119701:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498aa4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af006 expref: 181 pid: 29627 timeout: 1124 lvb_type: 0 00010000:00010000:1.0:1763334960.119718:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498aa4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af006 expref: 181 pid: 29627 timeout: 1124 lvb_type: 0 00010000:00010000:1.0:1763334960.119753:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498aa4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af006 expref: 181 pid: 29627 timeout: 1124 lvb_type: 0 00010000:00010000:1.0:1763334960.119774:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ad2829f00) 00010000:00010000:1.0:1763334960.119781:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334960.119796:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334960.119806:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334960.119837:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334960.119911:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:2359:x1848989694311936:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 244us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.119921:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2367 00010000:00010000:1.0:1763334960.119959:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334960.119968:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000040:00080000:0.0:1763334960.120716:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].990, 88 off85840 00000004:00080000:0.0:1763334960.120729:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1024754156106ns, next at 1025532430821ns, rc = 0 00000040:00080000:0.0:1763334960.120790:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].979, 88 off84776 00000004:00080000:0.0:1763334960.120796:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1024754223811ns, next at 1025532371403ns, rc = 0 00000040:00080000:0.0:1763334960.120820:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].980, 88 off84864 00000004:00080000:0.0:1763334960.120824:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1024754252341ns, next at 1025532371403ns, rc = 0 00000040:00080000:0.0:1763334960.120840:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].991, 88 off85928 00000004:00080000:0.0:1763334960.120844:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1024754272351ns, next at 1025532430821ns, rc = 0 00000001:00080000:1.0:1763334960.156384:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938546 is committed 00000001:00080000:1.0:1763334960.156537:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938551 is committed 00000001:00080000:1.0:1763334960.156557:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938552 is committed 00000004:00080000:1.0:1763334960.156562:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 654 committed 00000004:00080000:1.0:1763334960.156595:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 642 committed 00000004:00080000:1.0:1763334960.156604:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 641 committed 00000004:00080000:1.0:1763334960.156608:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 653 committed 00000004:00080000:1.0:1763334960.156626:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 652 committed 00000004:00080000:1.0:1763334960.156628:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 640 committed 00000100:00100000:2.0:1763334960.157734:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701785728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.157827:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.157880:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763334960.157887:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701785344:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.157910:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.157949:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701785472:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.157977:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.157995:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763334960.158002:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701785600:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.158021:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.158060:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701785728 00000100:00100000:2.0:1763334960.158070:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701785728 00000100:00100000:2.0:1763334960.158133:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701785344 00000100:00100000:2.0:1763334960.158136:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701785344 00000100:00100000:2.0:1763334960.158155:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701785472 00000100:00100000:2.0:1763334960.158157:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701785472 00000100:00100000:2.0:1763334960.158174:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701785600 00000100:00100000:2.0:1763334960.158177:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701785600 00000100:00100000:2.0:1763334960.158197:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4454 00000100:00100000:2.0:1763334960.158206:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701785728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.158509:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701785728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 301us (680us total) trans 21474838211 rc 0/0 00000100:00100000:2.0:1763334960.158519:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4454 00000100:00100000:2.0:1763334960.158542:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4455 00000100:00100000:2.0:1763334960.158550:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701785344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334960.158565:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:520 count 1 00010000:00010000:2.0:1763334960.158621:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.158647:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067800/0xcedf0054f8498ac0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af01b expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.158656:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334960.158659:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334960.158665:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.158707:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067800/0xcedf0054f8498ac0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af01b expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.158724:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067800/0xcedf0054f8498ac0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af01b expref: 12 pid: 32241 timeout: 1124 lvb_type: 0 00000100:00100000:2.0:1763334960.158739:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701785856:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334960.158816:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334960.158838:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4456 00000100:00100000:2.0:1763334960.158848:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701785472:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334960.158862:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:521 count 1 00002000:00010000:2.0:1763334960.158889:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x209:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334960.158896:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.158905:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334960.158907:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334960.158912:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.158927:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.158939:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.158954:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.158976:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334960.159250:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701785472:12345-0@lo:6:osp-syn-0-0.0 Request processed in 404us (1271us total) trans 21474838212 rc 0/0 00000100:00100000:2.0:1763334960.159259:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4456 00000100:00100000:2.0:1763334960.159277:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4457 00000100:00100000:2.0:1763334960.159285:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701785600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.159428:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701785600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (1405us total) trans 21474838213 rc 0/0 00000100:00100000:2.0:1763334960.159436:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4457 00000100:00080000:2.0:1763334960.159459:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1763334960.159639:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334960.159647:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.159656:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334960.159662:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.159671:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.159690:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.159703:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.159718:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334960.159719:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334960.159721:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334960.159770:0:3291:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838207 gen 2 00000004:00080000:2.0:1763334960.159776:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeef9f480, transno 21474838185 00000004:00080000:2.0:1763334960.159790:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeef9df80, transno 21474838186 00000004:00080000:2.0:1763334960.159795:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa3aed80, transno 21474838187 00000004:00080000:2.0:1763334960.159798:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa3adc00, transno 21474838188 00000004:00080000:2.0:1763334960.159803:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad88be680, transno 21474838189 00000004:00080000:2.0:1763334960.159806:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad88bd500, transno 21474838190 00000004:00080000:2.0:1763334960.159809:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6beca80, transno 21474838192 00000004:00080000:2.0:1763334960.159812:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6beea00, transno 21474838193 00000004:00080000:2.0:1763334960.159814:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6bed180, transno 21474838194 00000004:00080000:2.0:1763334960.159817:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6bed500, transno 21474838195 00000004:00080000:2.0:1763334960.159820:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6bedc00, transno 21474838196 00000004:00080000:2.0:1763334960.159822:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6bec700, transno 21474838197 00000004:00080000:2.0:1763334960.159825:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4f100, transno 21474838199 00000004:00080000:2.0:1763334960.159828:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4ed80, transno 21474838200 00000004:00080000:2.0:1763334960.159831:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4f480, transno 21474838201 00000004:00080000:2.0:1763334960.159834:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4ca80, transno 21474838202 00000004:00080000:2.0:1763334960.159837:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5577b80, transno 21474838204 00000004:00080000:2.0:1763334960.159840:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5576680, transno 21474838205 00000004:00080000:2.0:1763334960.159844:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c39e7100, transno 21474838206 00000004:00080000:2.0:1763334960.159846:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c39e5f80, transno 21474838207 00000100:00100000:2.0:1763334960.159855:0:3291:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5afb1f0000 x1848989701785600/t21474838213(21474838213) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334976 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763334960.159866:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f0000/2, rc 0, transno 21474838213 00000100:00100000:2.0:1763334960.159872:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701785600:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334960.159990:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f1180/2, rc 0, transno 21474838212 00000100:00100000:2.0:1763334960.159995:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701785472:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763334960.160291:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 4 in progress, 2 in flight, 20 done 00000004:00080000:2.0:1763334960.160321:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f1f80/2, rc 0, transno 21474838211 00000100:00100000:2.0:1763334960.160519:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701785728:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1763334960.160612:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498be6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af06f expref: 170 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.160625:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17b:0x0].0x0 (ffff9a5ac6cab700) 00010000:00010000:2.0:1763334960.160629:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334960.160650:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498bdf lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af06f expref: 170 pid: 32232 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763334960.160670:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498be6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17b:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af06f expref: 169 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.160708:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17b:0x0].0x0 (ffff9a5ac6cab700) 00010000:00010000:2.0:1763334960.160711:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334960.160714:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:0.0:1763334960.161240:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701786240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334960.161323:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334960.161376:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763334960.161383:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701786112:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334960.161408:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334960.161906:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701786240 00000100:00100000:0.0:1763334960.161914:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701786240 00000100:00100000:0.0:1763334960.161969:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701786112 00000100:00100000:0.0:1763334960.161973:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701786112 00000100:00100000:0.0:1763334960.161993:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4458 00000100:00100000:0.0:1763334960.162002:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+91:3292:x1848989701786240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334960.162260:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+92:3292:x1848989701786240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 257us (936us total) trans 17179870928 rc 0/0 00000100:00100000:0.0:1763334960.162268:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4458 00000100:00100000:0.0:1763334960.162288:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4459 00000100:00100000:0.0:1763334960.162294:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+91:3292:x1848989701786112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334960.162310:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:525 count 1 00002000:00010000:0.0:1763334960.162352:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334960.162361:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f8498c17 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.162377:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.162379:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.162386:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f8498c17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.162400:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f8498c17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.162411:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f8498c17 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334960.164923:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52274:x1848989694310528:12345-192.168.201.60@tcp:101:bash.0 Request processed in 113249us (113978us total) trans 8589938552 rc 0/0 00000100:00100000:2.0:1763334960.164940:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4284 00000100:00100000:2.0:1763334960.165051:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701785856:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334960.165083:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334960.165238:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.165322:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694312064 00000100:00100000:2.0:1763334960.165331:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694312064 00010000:00010000:2.0:1763334960.165378:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067800/0xcedf0054f8498ac0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af01b expref: 13 pid: 32241 timeout: 1124 lvb_type: 0 00000100:00100000:2.0:1763334960.165482:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2368 00000100:00100000:2.0:1763334960.165494:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694312064:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334960.165494:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f8498c17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.165521:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334960.165527:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334960.165531:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067800/0xcedf0054f8498ac0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af01b expref: 13 pid: 32241 timeout: 1124 lvb_type: 0 00010000:00010000:2.0:1763334960.165548:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067800/0xcedf0054f8498ac0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af01b expref: 13 pid: 32241 timeout: 1124 lvb_type: 0 00010000:00010000:2.0:1763334960.165606:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067800/0xcedf0054f8498ac0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af01b expref: 13 pid: 32241 timeout: 1124 lvb_type: 0 00010000:00010000:2.0:1763334960.165627:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334960.165630:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334960.165635:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.165647:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.165675:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334960.165878:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+92:3292:x1848989701786112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3582us (4467us total) trans 17179870929 rc 0/0 00000100:00100000:0.0:1763334960.165893:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4459 00010000:00010000:0.0:1763334960.165934:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334960.165942:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f8498c17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.165953:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334960.165959:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f8498c17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.165972:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f8498c17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334960.166362:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694312064:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 868us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334960.166372:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2368 00010000:00010000:2.0:1763334960.166422:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.166432:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.166443:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.166452:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.166471:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334960.167081:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.167262:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701785984:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334960.167325:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701785344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8774us (9410us total) trans 21474838214 rc 0/0 00000100:00100000:1.0:1763334960.167325:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.167349:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4455 00010000:00010000:0.0:1763334960.167445:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f8498c17 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.167455:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f8498c17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.167481:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334960.167486:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.167494:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334960.167497:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.167508:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.167525:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.167533:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498c09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.167549:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334960.167552:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334960.167554:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334960.167860:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763334960.167872:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694312192 00000100:00100000:1.0:1763334960.167872:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701786368:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334960.167882:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694312192 00000100:00100000:1.0:1763334960.167906:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.167934:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701785984 00000100:00100000:2.0:1763334960.167939:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701785984 00000100:00100000:2.0:1763334960.167961:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701786368 00000100:00100000:2.0:1763334960.167965:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701786368 00000100:00100000:2.0:1763334960.167989:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4460 00000100:00100000:2.0:1763334960.167999:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+54:52274:x1848989694312192:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334960.168017:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334960.168039:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498c1e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af084 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334960.168064:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334960.168084:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334960.168086:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334960.168096:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498c1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af084 expref: 55 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.168110:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498c1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af084 expref: 55 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.168121:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:2.0:1763334960.168162:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+55:52274:x1848989694312192:12345-192.168.201.60@tcp:101:bash.0 Request processed in 164us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.168558:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4461 00000100:00100000:1.0:1763334960.168600:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+93:3290:x1848989701785984:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334960.168615:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4460 00002000:00080000:1.0:1763334960.168626:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:524 count 1 00000100:00100000:2.0:1763334960.168639:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4462 00010000:00010000:1.0:1763334960.168648:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334960.168649:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+93:3290:x1848989701786368:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1763334960.168671:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498ac7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af022 expref: 54 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.168681:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334960.168684:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334960.168687:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.168730:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498ac7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af022 expref: 54 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.168747:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498ac7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af022 expref: 54 pid: 32241 timeout: 1124 lvb_type: 0 00000100:00100000:1.0:1763334960.168761:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701786496:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334960.168811:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e70a80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334960.169016:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+94:3290:x1848989701786368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 369us (1111us total) trans 17179870930 rc 0/0 00000100:00100000:2.0:1763334960.169024:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4462 00010000:00010000:2.0:1763334960.169045:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763334960.170169:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa3adc00/2, rc 0, transno 17179870930 00000100:00100000:1.0:1763334960.170195:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701786368:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334960.170314:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa3ace00/2, rc 0, transno 17179870929 00000100:00100000:0.0:1763334960.170321:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701786112:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763334960.170332:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa3aed80/2, rc 0, transno 17179870928 00000100:00100000:0.0:1763334960.170348:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701786240:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1763334960.170370:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1763334960.170683:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f0380/2, rc 0, transno 21474838214 00000100:00100000:0.0:1763334960.170699:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701785344:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334960.171759:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.171766:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9831f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701786496:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334960.171797:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694312320 00010000:00010000:3.0:1763334960.171803:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334960.171806:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694312320 00010000:00010000:0.0:1763334960.171847:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498ac7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af022 expref: 55 pid: 32241 timeout: 1124 lvb_type: 0 00000100:00100000:0.0:1763334960.171891:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2369 00000100:00100000:0.0:1763334960.171902:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+55:2359:x1848989694312320:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334960.171921:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334960.171928:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498ac7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af022 expref: 55 pid: 32241 timeout: 1124 lvb_type: 0 00010000:00010000:0.0:1763334960.171943:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498ac7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af022 expref: 55 pid: 32241 timeout: 1124 lvb_type: 0 00010000:00010000:0.0:1763334960.171970:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498ac7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af022 expref: 55 pid: 32241 timeout: 1124 lvb_type: 0 00010000:00010000:0.0:1763334960.171987:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.171990:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.171996:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.172007:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.172034:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334960.172088:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+54:2359:x1848989694312320:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 187us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.172096:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2369 00010000:00010000:0.0:1763334960.172183:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.172193:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.172205:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.172214:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.172234:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334960.174815:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+94:3290:x1848989701785984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6238us (7482us total) trans 17179870931 rc 0/0 00000100:00100000:0.0:1763334960.174833:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4461 00000004:00080000:1.0:1763334960.174884:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa3ac380/2, rc 0, transno 17179870931 00010000:00010000:0.0:1763334960.174887:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334960.174904:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.174915:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334960.174921:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334960.174922:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701785984:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763334960.174946:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.174972:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.174980:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8498c25 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.175007:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334960.175009:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334960.175012:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334960.175083:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.176640:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694312448 00000100:00100000:3.0:1763334960.176655:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694312448 00000100:00100000:3.0:1763334960.176725:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4463 00000100:00100000:3.0:1763334960.176736:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+12:52274:x1848989694312448:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334960.176757:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334960.176787:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498c2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af08b expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334960.176812:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x20a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334960.176832:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.176836:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.176844:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498c2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af08b expref: 13 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.176860:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498c2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af08b expref: 13 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.176871:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8800, rc 0) 00000100:00100000:3.0:1763334960.176936:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+13:52274:x1848989694312448:12345-192.168.201.60@tcp:101:bash.0 Request processed in 202us (1858us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334960.176943:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4463 00000100:00100000:0.0:1763334960.190959:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.191693:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.192427:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694312576 00000100:00100000:3.0:1763334960.192445:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694312576 00002000:00010000:3.0:1763334960.192509:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/526 (0->18446744073709551615) 00002000:00100000:3.0:1763334960.192515:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a1c00 with x1848989694312576 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334960.192531:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aef0a1c00. 00000100:00100000:3.0:1763334960.192595:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694312704 00000100:00100000:3.0:1763334960.192599:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694312704 00002000:00010000:3.0:1763334960.192614:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/522 (0->18446744073709551615) 00002000:00100000:3.0:1763334960.192618:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a2680 with x1848989694312704 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334960.192626:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aef0a2680. 00000100:00100000:3.0:1763334960.192655:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1672 00000100:00100000:3.0:1763334960.192666:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+54:2360:x1848989694312576:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334960.193027:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334960.193033:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb mtime from disk: 0 -> 1763334960 00002000:00010000:3.0:1763334960.193035:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334960.193038:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb ctime from disk: 0 -> 1763334960 00002000:00010000:3.0:1763334960.193041:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334960.193116:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+55:2360:x1848989694312576:12345-192.168.201.60@tcp:10:bash.0 Request processed in 450us (2169us total) trans 17179870932 rc 0/0 00000100:00100000:3.0:1763334960.193125:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1672 00002000:00010000:3.0:1763334960.193129:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/526 (0->18446744073709551615) 00002000:00100000:3.0:1763334960.193132:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a1c00 with x1848989694312576 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334960.193136:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aef0a1c00. 00000100:00100000:3.0:1763334960.193157:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1673 00000100:00100000:3.0:1763334960.193165:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694312704:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334960.193359:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x20a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334960.193362:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x20a:0x0] updating lvb mtime from disk: 0 -> 1763334960 00002000:00010000:3.0:1763334960.193365:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x20a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334960.193367:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x20a:0x0] updating lvb ctime from disk: 0 -> 1763334960 00002000:00010000:3.0:1763334960.193369:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x20a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334960.193392:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694312704:12345-192.168.201.60@tcp:10:bash.0 Request processed in 227us (1702us total) trans 21474838215 rc 0/0 00000100:00100000:3.0:1763334960.193400:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1673 00002000:00010000:3.0:1763334960.193403:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/522 (0->18446744073709551615) 00002000:00100000:3.0:1763334960.193406:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a2680 with x1848989694312704 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334960.193411:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aef0a2680. 00000100:00100000:3.0:1763334960.200776:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.203486:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694312960 00000100:00100000:0.0:1763334960.203508:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694312960 00000100:00100000:0.0:1763334960.203664:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1585 00000100:00100000:0.0:1763334960.203679:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52274:x1848989694312960:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:0.0:1763334960.204210:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52274:x1848989694312960:12345-192.168.201.60@tcp:35:bash.0 Request processed in 532us (3448us total) trans 8589938555 rc 0/0 00000100:00100000:0.0:1763334960.204220:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1585 00000004:00010000:2.0:1763334960.214722:0:29630:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d97048d6 reply state 000000005d093ca8 transno 8589938554 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:2.0:1763334960.214757:0:29630:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334960.214773:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ad2829f00) 00010000:00010000:2.0:1763334960.214777:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334960.214789:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84989c4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x178:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefc0 expref: 169 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334960.214984:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52951:x1848989694311808:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 101933us (102269us total) trans 8589938554 rc 0/0 00000100:00100000:2.0:1763334960.214996:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1584 00000001:00080000:1.0:1763334960.215282:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938554 is committed 00000004:00080000:1.0:1763334960.215293:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 656 committed 00000004:00080000:1.0:1763334960.215311:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 644 committed 00000004:00080000:1.0:1763334960.215329:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 643 committed 00000004:00080000:1.0:1763334960.215333:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 655 committed 00010000:00010000:0.0:1763334960.215367:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334960.215379:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334960.215388:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334960.215394:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.215401:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334960.215412:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334960.215434:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ad2829f00) 00010000:00010000:0.0:1763334960.215438:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334960.215443:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334960.215454:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498c02 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00000100:00100000:3.0:1763334960.215568:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701786880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334960.215677:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334960.215688:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad88be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701787008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334960.215735:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334960.215741:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334960.215751:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701786752:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334960.215764:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763334960.215773:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701786624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.215787:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.215851:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701786880 00000100:00100000:1.0:1763334960.215859:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701787008 00000100:00100000:2.0:1763334960.215863:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701786880 00000100:00100000:1.0:1763334960.215865:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701787008 00000100:00100000:2.0:1763334960.215920:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701786752 00000100:00100000:2.0:1763334960.215924:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701786752 00000100:00100000:1.0:1763334960.215937:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4464 00000100:00100000:1.0:1763334960.215954:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701786880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.216012:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4465 00000100:00100000:2.0:1763334960.216022:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701787008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334960.216239:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763334960.216244:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb mtime from disk: 1763334960 -> 1763334960 00002000:00010000:2.0:1763334960.216246:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334960.216248:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb ctime from disk: 1763334960 -> 1763334960 00002000:00010000:2.0:1763334960.216264:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x207:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1763334960.216961:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701787008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 937us (1221us total) trans 21474838216 rc 0/0 00000100:00100000:2.0:1763334960.216973:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4465 00000100:00100000:3.0:1763334960.216985:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4466 00000100:00100000:3.0:1763334960.216999:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+94:3292:x1848989701786752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334960.217048:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763334960.217107:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad88be680/2, rc 0, transno 21474838216 00000100:00100000:0.0:1763334960.217115:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad88be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701787008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.217167:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701786624 00000100:00100000:2.0:1763334960.217173:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701786624 00002000:00010000:3.0:1763334960.217187:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334960.217192:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb mtime from disk: 1763334960 -> 1763334960 00002000:00010000:3.0:1763334960.217195:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334960.217197:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb ctime from disk: 1763334960 -> 1763334960 00002000:00010000:3.0:1763334960.217199:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334960.217215:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4467 00000100:00100000:2.0:1763334960.217225:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+96:3289:x1848989701786624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.217242:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+96:3292:x1848989701786752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 248us (1455us total) trans 17179870933 rc 0/0 00002000:00010000:2.0:1763334960.217445:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x20a:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763334960.217449:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x20a:0x0] updating lvb mtime from disk: 1763334960 -> 1763334960 00002000:00010000:2.0:1763334960.217451:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x20a:0x0] updating lvb atime from disk: 1763334960 -> 1763334960 00002000:00010000:2.0:1763334960.217453:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x20a:0x0] updating lvb ctime from disk: 1763334960 -> 1763334960 00002000:00010000:2.0:1763334960.217456:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x20a:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1763334960.217482:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x206:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334960.217486:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x206:0x0] updating lvb mtime from disk: 1763334960 -> 1763334960 00002000:00010000:1.0:1763334960.217490:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x206:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334960.217492:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x206:0x0] updating lvb ctime from disk: 1763334960 -> 1763334960 00002000:00010000:1.0:1763334960.217495:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x206:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:1.0:1763334960.217530:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701786880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1584us (1855us total) trans 21474838217 rc 0/0 00000100:00100000:2.0:1763334960.217650:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+97:3289:x1848989701786624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 426us (603us total) trans 17179870934 rc 0/0 00000004:00080000:0.0:1763334960.217700:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a23b80/2, rc 0, transno 17179870934 00000100:00100000:0.0:1763334960.217706:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701786624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.219297:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4466 00000004:00080000:3.0:1763334960.219396:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a83100/2, rc 0, transno 17179870933 00000100:00100000:3.0:1763334960.219407:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701786752:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334960.219425:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841aa00/2, rc 0, transno 21474838217 00000100:00100000:3.0:1763334960.219429:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701786880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334960.219476:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.221000:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4464 00000100:00100000:2.0:1763334960.221233:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4467 00000100:00100000:2.0:1763334960.221290:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694313088 00000100:00100000:2.0:1763334960.221303:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694313088 00000100:00100000:2.0:1763334960.221402:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4286 00000100:00100000:2.0:1763334960.221414:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+166:52951:x1848989694313088:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334960.221458:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334960.221494:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f8498c33 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af092 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.221617:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f8498c33 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af092 expref: 167 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.221638:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067800/0xcedf0054f8498c33 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x178:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af092 expref: 167 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.221991:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ad2829f00) 00010000:00010000:2.0:1763334960.221996:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334960.222002:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067800, rc 0) 00000100:00100000:2.0:1763334960.222426:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52951:x1848989694313088:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1011us (2949us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334960.222438:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4286 00000100:00100000:1.0:1763334960.223601:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.223653:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694313216 00000100:00100000:3.0:1763334960.223668:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694313216 00000100:00100000:3.0:1763334960.223747:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4287 00000100:00100000:3.0:1763334960.223760:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52956:x1848989694313216:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:3.0:1763334960.223788:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334960.223818:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498c3a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af099 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.223912:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498c41 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.223928:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498c41 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.223942:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498c41 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.223959:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498c48 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.223966:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498c48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.223972:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498c48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224146:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498c4f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224155:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498c4f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224162:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498c4f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334960.224206:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17b:0x0]: returning size 5 00000004:00200000:3.0:1763334960.224212:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334960.224235:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498c4f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224249:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498c4f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224258:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498c41 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224266:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498c41 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224277:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498c41 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224283:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334960.224288:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498c41 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224296:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498c41 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224308:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334960.224311:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334960.224316:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498c41 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224323:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498c41 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224346:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498c48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224353:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498c48 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224359:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498c48 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224364:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334960.224368:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498c48 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224373:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498c48 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224381:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5adaf40800) 00010000:00010000:3.0:1763334960.224384:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334960.224386:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498c48 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224391:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498c48 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.224428:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498c3a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af099 expref: 169 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.224441:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498c4f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af099 expref: 168 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.224449:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17b:0x0].0x0 (ffff9a5ac6cab700) 00010000:00010000:3.0:1763334960.224451:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334960.224454:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8000, rc 0) 00000100:00100000:3.0:1763334960.225426:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52956:x1848989694313216:12345-192.168.201.60@tcp:101:rm.0 Request processed in 1658us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334960.225439:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4287 00000100:00100000:1.0:1763334960.231680:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.231768:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694313472 00000100:00100000:2.0:1763334960.231791:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694313472 00000100:00100000:2.0:1763334960.231884:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1586 00000100:00100000:2.0:1763334960.231907:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52951:x1848989694313472:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:2.0:1763334960.232517:0:29630:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x178:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763334960.232811:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].992, 64 off85992 00000040:00080000:2.0:1763334960.232879:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].981, 64 off84928 00000040:00080000:2.0:1763334960.232899:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].982, 64 off84992 00000040:00080000:2.0:1763334960.232915:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].993, 64 off86056 00010000:00010000:2.0:1763334960.233011:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498c56 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x178:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334960.233033:0:29630:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498c56 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334960.233046:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498c56 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334960.233056:0:29630:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498c56 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334960.233062:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498c56 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334960.233069:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498c56 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334960.233106:0:29630:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334960.233306:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52951:x1848989694313472:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1406us (1635us total) trans 8589938556 rc 0/0 00000100:00100000:2.0:1763334960.233321:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1586 00010000:00010000:1.0:1763334960.233651:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334960.233663:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498c56 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334960.233673:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334960.233678:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498c56 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334960.233688:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498c56 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334960.233707:0:5736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x178:0x0].0x0 (ffff9a5ad2829f00) 00010000:00010000:1.0:1763334960.233711:0:5736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763334960.233719:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498c56 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334960.233726:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498c56 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x178:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334960.233740:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334960.233743:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334960.233745:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334960.234011:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.234459:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694313728 00000100:00100000:2.0:1763334960.234477:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694313728 00000100:00100000:2.0:1763334960.235231:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4288 00000100:00100000:2.0:1763334960.235249:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52956:x1848989694313728:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:2.0:1763334960.235325:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1763334960.235481:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498c4f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af099 expref: 169 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.235504:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498be6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af06f expref: 168 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.235516:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17b:0x0].0x0 (ffff9a5ac6cab700) 00010000:00010000:2.0:1763334960.235529:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334960.235562:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c5d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.235659:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c5d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.235672:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c5d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.235692:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498c64 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.235700:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498c64 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.235705:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498c64 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.235887:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c6b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.235895:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c6b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.235903:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c6b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:2.0:1763334960.236503:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].994, 64 off86120 00000040:00080000:2.0:1763334960.236536:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].983, 64 off85056 00000040:00080000:2.0:1763334960.236552:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].984, 64 off85120 00000040:00080000:2.0:1763334960.236567:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].995, 64 off86184 00010000:00010000:2.0:1763334960.236710:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498c72 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236725:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498c72 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236736:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498c72 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236745:0:32232:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498c72 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236752:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498c72 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236760:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498c72 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236779:0:32232:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334960.236806:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c6b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236814:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c6b lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236821:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c6b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236827:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.236833:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c6b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236842:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c6b lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236854:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17b:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:2.0:1763334960.236857:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763334960.236862:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c6b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236868:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c6b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236944:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c5d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236951:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c5d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236957:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c5d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236962:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.236965:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c5d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236976:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c5d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236984:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.236987:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.236991:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c5d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.236997:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c5d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:2.0:1763334960.237008:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ebff6deb reply state 000000001cc864bd transno 8589938557 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498c64 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334960.237019:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334960.237152:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52956:x1848989694313728:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1903us (3137us total) trans 8589938557 rc 0/0 00000100:00100000:2.0:1763334960.237164:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4288 00010000:00010000:0.0:1763334960.237326:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334960.237344:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498c72 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.237351:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334960.237355:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498c72 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.237361:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498c72 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.237371:0:8206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17b:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:0.0:1763334960.237373:0:8206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763334960.237377:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498c72 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.237383:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498c72 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x17b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.237400:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334960.237402:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334960.237404:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334960.243108:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334960.243108:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498c64 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.243127:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498c64 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.243137:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498c64 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.243144:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.243151:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498c64 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.243160:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498c64 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.243186:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cabc00) 00010000:00010000:1.0:1763334960.243190:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334960.243196:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498c64 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.243204:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498c64 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334960.243248:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694313984 00000100:00100000:2.0:1763334960.243262:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694313984 00000100:00100000:2.0:1763334960.243333:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4289 00000100:00100000:2.0:1763334960.243357:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52951:x1848989694313984:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334960.243392:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334960.243420:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c79 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0a0 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.243528:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c80 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243545:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c80 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243558:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c80 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243601:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498c87 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243608:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498c87 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243614:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498c87 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243707:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c80 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243714:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c80 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243720:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c80 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243726:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.243729:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c80 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243735:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c80 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243743:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.243746:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.243749:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c80 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243755:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498c80 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243767:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498c87 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243772:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498c87 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243777:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498c87 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243782:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.243785:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498c87 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243790:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498c87 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243798:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab700) 00010000:00010000:2.0:1763334960.243801:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.243805:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498c87 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243811:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498c87 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.243848:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c79 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0a0 expref: 169 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.243859:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.243861:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334960.243869:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498c79 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0a0 expref: 169 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.243884:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:2.0:1763334960.243978:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52951:x1848989694313984:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 622us (890us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334960.243987:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4289 00000100:00100000:3.0:1763334960.250281:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.251595:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694314112 00000100:00100000:0.0:1763334960.251613:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694314112 00000100:00100000:0.0:1763334960.251692:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4290 00000100:00100000:0.0:1763334960.251704:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52957:x1848989694314112:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.251730:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.251757:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498c8e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0a7 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.251885:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498c95 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.251901:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498c95 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.251914:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498c95 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.251929:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498c9c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.251936:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498c9c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.251942:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498c9c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252039:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498c95 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252047:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498c95 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252054:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498c95 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252061:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.252066:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498c95 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252075:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498c95 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252091:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.252095:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.252101:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498c95 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252108:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498c95 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252124:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498c9c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252130:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498c9c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252136:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498c9c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252145:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.252147:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498c9c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252154:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498c9c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252162:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd900) 00010000:00010000:0.0:1763334960.252164:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.252166:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498c9c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252172:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498c9c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.252219:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498c8e lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0a7 expref: 169 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.252231:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.252234:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.252238:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498c8e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0a7 expref: 169 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.252247:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334960.252367:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52957:x1848989694314112:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 664us (2102us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334960.252376:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4290 00000100:00100000:1.0:1763334960.257424:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.257712:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694314240 00000100:00100000:2.0:1763334960.257729:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694314240 00000100:00100000:2.0:1763334960.257808:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4291 00000100:00100000:2.0:1763334960.257822:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52957:x1848989694314240:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334960.257851:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334960.257882:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498ca3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0ae expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.257979:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498caa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.257997:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498caa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258012:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498caa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258029:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498cb1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258036:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258042:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258134:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498caa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258143:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498caa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258151:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498caa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258158:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.258163:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498caa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258172:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498caa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258186:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.258190:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.258198:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498caa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258205:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498caa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258222:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258229:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498cb1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258236:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258246:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.258248:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258267:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258274:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab700) 00010000:00010000:2.0:1763334960.258276:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.258279:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498cb1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258285:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498cb1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.258329:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498ca3 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0ae expref: 169 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.258353:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.258356:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.258360:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498ca3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0ae expref: 169 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.258372:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:2.0:1763334960.259228:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52957:x1848989694314240:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1399us (1810us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334960.259241:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4291 00000100:00100000:1.0:1763334960.262438:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.263084:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694314368 00000100:00100000:2.0:1763334960.263099:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694314368 00000100:00100000:1.0:1763334960.263415:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.263950:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694314624 00000100:00100000:0.0:1763334960.263959:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694314624 00000100:00100000:3.0:1763334960.264012:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4292 00000100:00100000:3.0:1763334960.264027:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52957:x1848989694314368:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334960.264107:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334960.264136:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498cb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0b5 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334960.264190:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4293 00000100:00100000:0.0:1763334960.264199:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52958:x1848989694314624:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.264207:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.264217:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498cbf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0bc expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.264229:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498cc6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.264246:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.264360:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334960.264455:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334960.264460:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334960.264486:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498cc6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.264517:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498cb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0b5 expref: 172 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.264523:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498ccd lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264532:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498ccd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264540:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498ccd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.264545:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498cc6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0b5 expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.264554:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498cd4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.264555:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334960.264558:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763334960.264560:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.264563:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8200, rc 0) 00010000:00010000:0.0:1763334960.264566:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264658:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498ccd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264666:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498ccd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264671:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498ccd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264677:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.264682:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498ccd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264690:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498ccd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264699:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.264702:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.264706:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498ccd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334960.264709:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52957:x1848989694314368:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 685us (2289us total) trans 0 rc 0/0 00010000:00010000:0.0:1763334960.264713:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498ccd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334960.264717:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4292 00010000:00010000:0.0:1763334960.264721:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264727:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498cd4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264732:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264737:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.264739:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264745:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498cd4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264752:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd900) 00010000:00010000:0.0:1763334960.264755:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.264758:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498cd4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264768:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498cd4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.264796:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498cbf lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0bc expref: 170 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.264814:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.264816:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334960.264820:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498cbf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0bc expref: 170 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.264830:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334960.264960:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52958:x1848989694314624:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 762us (1546us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334960.264967:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4293 00000100:00100000:1.0:1763334960.267845:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.268616:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694314880 00000100:00100000:0.0:1763334960.268635:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694314880 00000100:00100000:0.0:1763334960.268724:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4294 00000100:00100000:0.0:1763334960.268737:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+169:52957:x1848989694314880:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.268774:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.268778:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334960.268816:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498cc6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0b5 expref: 169 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.268841:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.268856:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334960.268875:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498cdb lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0c3 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.269055:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ce2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269071:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ce2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269083:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ce2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269099:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498ce9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269106:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498ce9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269112:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498ce9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269856:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498cf0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269868:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269875:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:0.0:1763334960.269887:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17d:0x0]: returning size 0 00010000:00010000:0.0:1763334960.269921:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ce2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269929:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ce2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269941:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ce2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269948:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.269952:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ce2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269961:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ce2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269971:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.269974:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.269980:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ce2 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.269986:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ce2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:0.0:1763334960.270001:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c1dbf7cc reply state 0000000099740bfd transno 8589938558 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498ce9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334960.270012:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763334960.270046:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498cdb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0c3 expref: 171 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.270061:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0c3 expref: 170 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.270069:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ac51bd200) 00010000:00010000:0.0:1763334960.270072:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334960.270074:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334960.270175:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52957:x1848989694314880:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1439us (2345us total) trans 8589938558 rc 0/0 00000100:00100000:0.0:1763334960.270184:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4294 00010000:00010000:0.0:1763334960.274034:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498ce9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.274060:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498ce9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.274071:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498ce9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.274078:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.274085:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498ce9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.274094:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498ce9 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.274125:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bdc00) 00010000:00010000:0.0:1763334960.274130:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.274136:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498ce9 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.274143:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498ce9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334960.274912:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.275258:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694315136 00000100:00100000:3.0:1763334960.275274:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694315136 00000100:00100000:3.0:1763334960.275358:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4295 00000100:00100000:3.0:1763334960.275371:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52957:x1848989694315136:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334960.275408:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334960.275437:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498cfe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0ca expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.276187:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.276211:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498cf0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0c3 expref: 171 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.276223:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.276291:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0c3 expref: 171 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.276310:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0c3 expref: 171 pid: 29627 timeout: 1124 lvb_type: 0 00000100:00100000:3.0:1763334960.276327:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701787136:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334960.276463:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c3e9a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334960.280092:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701787136:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334960.280133:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334960.280327:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.281037:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694315264 00000100:00100000:3.0:1763334960.281050:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694315264 00010000:00010000:3.0:1763334960.281103:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0c3 expref: 172 pid: 29627 timeout: 1124 lvb_type: 0 00000100:00100000:3.0:1763334960.281566:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2370 00000100:00100000:3.0:1763334960.281608:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:2359:x1848989694315264:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334960.281631:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334960.281640:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498cf0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0c3 expref: 172 pid: 29627 timeout: 1124 lvb_type: 0 00010000:00010000:3.0:1763334960.281656:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0c3 expref: 172 pid: 29627 timeout: 1124 lvb_type: 0 00010000:00010000:3.0:1763334960.281686:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498cf0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0c3 expref: 172 pid: 29627 timeout: 1124 lvb_type: 0 00010000:00010000:3.0:1763334960.281708:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ac51bd200) 00010000:00010000:3.0:1763334960.281714:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.281726:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.281734:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.281777:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334960.281867:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:2359:x1848989694315264:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 264us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334960.281875:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2370 00010000:00010000:1.0:1763334960.281954:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.281963:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334960.281990:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17d:0x0]: returning size 0 00000004:00080000:1.0:1763334960.282739:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20c:0x0], index 0: 0 00000004:00080000:1.0:1763334960.282755:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x210:0x0], index 1: 0 00000004:00080000:1.0:1763334960.282764:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x211:0x0], index 1: 0 00000004:00080000:1.0:1763334960.282770:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20d:0x0], index 0: 0 00010000:00010000:1.0:1763334960.282964:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.282976:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.282984:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.282990:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.282995:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.283005:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.283020:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ac51bd200) 00010000:00010000:1.0:1763334960.283023:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334960.283027:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.283034:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d05 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.283108:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498cfe lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0ca expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.283125:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334960.283128:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334960.283132:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498cfe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0ca expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.283141:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8a00, rc 0) 00000100:00100000:1.0:1763334960.283210:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52957:x1848989694315136:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7841us (8306us total) trans 8589938559 rc 301/301 00000100:00100000:1.0:1763334960.283219:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4295 00000100:00100000:2.0:1763334960.286537:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.286616:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.286646:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694315520 00000100:00100000:1.0:1763334960.286661:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694315520 00000100:00100000:1.0:1763334960.286744:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4296 00000100:00100000:1.0:1763334960.286757:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52959:x1848989694315520:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334960.286791:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334960.286821:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f8498d13 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0d1 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.286931:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498d1a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.286947:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498d1a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.286958:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498d1a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.286973:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498d21 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.286984:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498d21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.286990:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498d21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287142:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498d28 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287149:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498d28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287156:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498d28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287293:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498d1a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287301:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498d1a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287308:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498d1a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287315:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.287320:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498d1a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287328:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498d1a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287348:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334960.287351:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334960.287358:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498d1a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287364:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498d1a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287376:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498d21 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287381:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498d21 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287386:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498d21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287390:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.287392:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498d21 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287397:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498d21 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287402:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829000) 00010000:00010000:1.0:1763334960.287404:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334960.287406:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498d21 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287411:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498d21 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.287460:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f8498d13 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d1 expref: 173 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.287474:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498d28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d1 expref: 172 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.287482:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:1.0:1763334960.287485:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334960.287488:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:3.0:1763334960.287543:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694315776 00000100:00100000:3.0:1763334960.287550:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694315776 00000100:00100000:1.0:1763334960.287598:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52959:x1848989694315520:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 844us (1078us total) trans 8589938560 rc 0/0 00000100:00100000:1.0:1763334960.287606:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4296 00000100:00100000:3.0:1763334960.287662:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1587 00000100:00100000:3.0:1763334960.287672:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c36bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52957:x1848989694315776:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334960.287957:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c36bc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52957:x1848989694315776:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 286us (1339us total) trans 8589938561 rc 0/0 00000100:00100000:3.0:1763334960.288024:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1587 00000100:00100000:2.0:1763334960.290402:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.290458:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.290561:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694316160 00000100:00100000:0.0:1763334960.290609:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694316160 00000100:00100000:0.0:1763334960.290682:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4468 00000100:00100000:0.0:1763334960.290695:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694316160:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.290724:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763334960.290868:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694316032 00000100:00100000:3.0:1763334960.290874:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694316032 00000100:00100000:3.0:1763334960.290966:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1588 00000100:00100000:3.0:1763334960.290974:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52957:x1848989694316032:12345-192.168.201.60@tcp:35:lfs.0 00010000:00010000:2.0:1763334960.291178:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498d36 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0d8 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334960.291211:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x20c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334960.291231:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334960.291233:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334960.291246:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498d36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d8 expref: 15 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334960.291266:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498d36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d8 expref: 15 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334960.291280:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:3.0:1763334960.291310:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52957:x1848989694316032:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 336us (925us total) trans 8589938562 rc 0/0 00000100:00100000:3.0:1763334960.291318:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1588 00000100:00100000:2.0:1763334960.291363:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2361:x1848989694316160:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 670us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334960.291370:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4468 00000100:00100000:1.0:1763334960.294311:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.294358:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.294522:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694316416 00000100:00100000:3.0:1763334960.294543:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694316416 00000100:00100000:3.0:1763334960.294712:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1589 00000100:00100000:3.0:1763334960.294726:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52959:x1848989694316416:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334960.294893:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694316672 00000100:00100000:1.0:1763334960.294898:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694316672 00000100:00100000:1.0:1763334960.294930:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4297 00000100:00100000:1.0:1763334960.294938:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52274:x1848989694316672:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334960.294951:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334960.294981:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498d3d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0df expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.295085:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.295105:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498d28 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d1 expref: 176 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.295116:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.295164:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498d28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d1 expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.295180:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498d28 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d1 expref: 177 pid: 30972 timeout: 1124 lvb_type: 0 00000100:00100000:1.0:1763334960.295197:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d71180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701787264:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334960.295323:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e70780 going to sleep for 11 seconds 00000100:00100000:3.0:1763334960.295377:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52959:x1848989694316416:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 653us (1082us total) trans 8589938563 rc 0/0 00000100:00100000:3.0:1763334960.295386:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1589 00000100:00100000:2.0:1763334960.302706:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.302750:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d71180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701787264:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334960.302788:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334960.302808:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694317056 00000100:00100000:0.0:1763334960.302817:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694317056 00000100:00100000:1.0:1763334960.302831:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.302875:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694316928 00000100:00100000:2.0:1763334960.302880:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694316928 00010000:00010000:0.0:1763334960.302918:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498d28 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d1 expref: 178 pid: 30972 timeout: 1124 lvb_type: 0 00000100:00100000:2.0:1763334960.302942:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4298 00000100:00100000:2.0:1763334960.302954:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52959:x1848989694316928:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334960.302986:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763334960.302989:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2371 00000100:00100000:0.0:1763334960.302995:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2360:x1848989694317056:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334960.303016:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498d4b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0e6 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.303016:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334960.303022:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498d28 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d1 expref: 178 pid: 30972 timeout: 1124 lvb_type: 0 00010000:00010000:0.0:1763334960.303038:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498d28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d1 expref: 179 pid: 30972 timeout: 1124 lvb_type: 0 00010000:00010000:0.0:1763334960.303064:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498d28 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d1 expref: 179 pid: 30972 timeout: 1124 lvb_type: 0 00010000:00010000:0.0:1763334960.303082:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:0.0:1763334960.303088:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.303099:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.303106:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.303129:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334960.303152:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498d52 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.303163:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498d52 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x17d:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.303172:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498d52 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x17d:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334960.303184:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17d:0x0]: returning size 0 00000100:00100000:0.0:1763334960.303199:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2360:x1848989694317056:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 204us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.303210:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2371 00010000:00010000:3.0:1763334960.303276:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.303288:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334960.303304:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17d:0x0]: returning size 0 00010000:00010000:3.0:1763334960.303474:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498d3d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0df expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.303492:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0df expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.303499:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:3.0:1763334960.303502:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763334960.303504:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478800, rc 0) 00000100:00100000:3.0:1763334960.303806:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52274:x1848989694316672:12345-192.168.201.60@tcp:101:bash.0 Request processed in 8867us (9448us total) trans 8589938564 rc 0/0 00000100:00100000:3.0:1763334960.303814:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4297 00010000:00010000:2.0:1763334960.303940:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498d4b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0e6 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.303954:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498d52 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17d:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0e6 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.303961:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:2.0:1763334960.303964:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763334960.303966:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:2.0:1763334960.304305:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52959:x1848989694316928:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1352us (1644us total) trans 8589938565 rc 0/0 00000100:00100000:2.0:1763334960.304313:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4298 00000100:00100000:1.0:1763334960.306723:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.306812:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694317312 00000100:00100000:2.0:1763334960.306826:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694317312 00000100:00100000:2.0:1763334960.306897:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4299 00000100:00100000:2.0:1763334960.306909:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52274:x1848989694317312:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:2.0:1763334960.307346:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498d67 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.307375:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498d67 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.307390:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498d67 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:2.0:1763334960.307459:0:29627:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938566 00000004:00010000:2.0:1763334960.307486:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fe4debe5 reply state 00000000ed47a1ae transno 8589938567 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498d67 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334960.307495:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334960.307652:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52274:x1848989694317312:12345-192.168.201.60@tcp:36:bash.0 Request processed in 744us (943us total) trans 8589938567 rc 0/0 00000100:00100000:2.0:1763334960.307661:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4299 00000020:00080000:2.0:1763334960.307668:0:29627:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763334960.308054:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.308766:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694317440 00000100:00100000:2.0:1763334960.308778:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694317440 00000100:00100000:2.0:1763334960.308841:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4300 00000100:00100000:2.0:1763334960.308851:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52959:x1848989694317440:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334960.308875:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334960.308893:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498d6e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0ed expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.309014:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.309028:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0df expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.309036:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498d67 lrc: 2/0,1 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.309045:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.309065:0:32232:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498d67 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.309097:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0df expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.309112:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0df expref: 182 pid: 30972 timeout: 1124 lvb_type: 0 00000100:00100000:2.0:1763334960.309128:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701787392:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334960.309224:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b0c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763334960.311033:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498d67 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.311055:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498d67 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.311063:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498d67 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.311070:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.311075:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498d67 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.311084:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498d67 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.311106:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:1.0:1763334960.311110:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334960.311114:0:3275:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.311126:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498d67 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.311132:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8498d67 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334960.313125:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.313181:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.313275:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694317696 00000100:00100000:0.0:1763334960.313290:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694317696 00000100:00100000:0.0:1763334960.313382:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4301 00000100:00100000:0.0:1763334960.313397:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52274:x1848989694317696:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334960.313436:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.313441:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334960.313486:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8498d52 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17d:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0e6 expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.313509:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:0.0:1763334960.313516:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.313526:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.313532:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.313538:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334960.313555:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498d7c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0f4 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.313662:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.313673:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.313686:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.313711:0:29627:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.313722:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334960.314024:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694317824 00000100:00100000:3.0:1763334960.314032:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694317824 00010000:00010000:3.0:1763334960.314060:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0df expref: 183 pid: 30972 timeout: 1124 lvb_type: 0 00000100:00100000:3.0:1763334960.314097:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2372 00000100:00100000:3.0:1763334960.314105:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:2362:x1848989694317824:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334960.314116:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334960.314121:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0df expref: 183 pid: 30972 timeout: 1124 lvb_type: 0 00010000:00010000:3.0:1763334960.314140:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0df expref: 183 pid: 30972 timeout: 1124 lvb_type: 0 00010000:00010000:3.0:1763334960.314155:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:3.0:1763334960.314158:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.314166:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.314173:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40290400000020 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.314180:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.314185:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.314198:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334960.314279:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:2362:x1848989694317824:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 175us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334960.314288:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2372 00010000:00010000:2.0:1763334960.314643:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8498d44 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x17d:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0df expref: 182 pid: 30972 timeout: 1124 lvb_type: 0 00000100:00100000:2.0:1763334960.314659:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701787392:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334960.314680:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.314688:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.314693:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334960.314744:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17d:0x0]: returning size 0 00000004:00200000:2.0:1763334960.314750:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334960.314778:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.314815:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498d6e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17d:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0ed expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.314837:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0ed expref: 181 pid: 32232 timeout: 1124 lvb_type: 0 00010000:00010000:2.0:1763334960.314848:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0ed expref: 181 pid: 32232 timeout: 1124 lvb_type: 0 00010000:00010000:2.0:1763334960.314856:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:2.0:1763334960.314903:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52959:x1848989694317440:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6053us (6849us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334960.314910:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4300 00000100:00100000:1.0:1763334960.323363:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.323416:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.323488:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694317952 00000100:00100000:3.0:1763334960.323501:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694317952 00000100:00100000:3.0:1763334960.323844:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4302 00000100:00100000:3.0:1763334960.323855:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52959:x1848989694317952:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334960.323883:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334960.323908:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498d8a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af0fb expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.323984:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.323995:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498d8a lrc: 4/0,0 mode: --/CR res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0fb expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.324019:0:30972:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.324034:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498d8a lrc: 3/0,0 mode: --/CR res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0fb expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.324051:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:3.0:1763334960.324055:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334960.324058:0:30972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334960.324065:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9a00, rc 0) 00000100:00100000:3.0:1763334960.324143:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52959:x1848989694317952:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 289us (793us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334960.324151:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4302 00000100:00100000:0.0:1763334960.324666:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694318080 00000100:00100000:0.0:1763334960.324675:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694318080 00010000:00010000:0.0:1763334960.324718:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0ed expref: 182 pid: 32232 timeout: 1124 lvb_type: 0 00000100:00100000:0.0:1763334960.324758:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2373 00000100:00100000:0.0:1763334960.324767:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2362:x1848989694318080:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334960.324780:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334960.324787:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0ed expref: 182 pid: 32232 timeout: 1124 lvb_type: 0 00010000:00010000:0.0:1763334960.324800:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0ed expref: 182 pid: 32232 timeout: 1124 lvb_type: 0 00010000:00010000:0.0:1763334960.324826:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8498d75 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0ed expref: 182 pid: 32232 timeout: 1124 lvb_type: 0 00010000:00010000:0.0:1763334960.324844:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:0.0:1763334960.324849:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.324861:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.324869:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.324879:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498d8a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0fb expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.324903:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334960.324933:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:2362:x1848989694318080:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 168us (1516us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.324940:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2373 00010000:00010000:0.0:1763334960.324968:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.324977:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00000040:00080000:0.0:1763334960.325776:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].985, 88 off85208 00000004:00080000:0.0:1763334960.325790:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1024959216988ns, next at 1025532371403ns, rc = 0 00000040:00080000:0.0:1763334960.329403:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].996, 88 off86272 00000004:00080000:0.0:1763334960.329431:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1024962857952ns, next at 1025532430821ns, rc = 0 00000040:00080000:0.0:1763334960.329469:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].997, 88 off86360 00000004:00080000:0.0:1763334960.329474:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1024962902540ns, next at 1025532430821ns, rc = 0 00000040:00080000:0.0:1763334960.329498:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].986, 88 off85296 00000004:00080000:0.0:1763334960.329503:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1024962930932ns, next at 1025532371403ns, rc = 0 00000001:00080000:3.0:1763334960.399851:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938568 is committed 00000004:00080000:3.0:1763334960.399868:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 646 committed 00000004:00080000:3.0:1763334960.399879:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 658 committed 00000004:00080000:3.0:1763334960.399888:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 657 committed 00000004:00080000:3.0:1763334960.399891:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 645 committed 00000100:00100000:3.0:1763334960.400107:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701787520:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.400211:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334960.400254:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701788032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.400274:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334960.400304:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763334960.400310:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701787904:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.400351:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334960.400380:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701787648:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.400405:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334960.400422:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701788160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.400441:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334960.400457:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763334960.400462:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701787776:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.400484:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334960.400523:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701787520 00000100:00100000:3.0:1763334960.400533:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701787520 00000100:00100000:3.0:1763334960.400610:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701788032 00000100:00100000:3.0:1763334960.400614:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701788032 00000100:00100000:3.0:1763334960.400630:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701787904 00000100:00100000:3.0:1763334960.400633:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701787904 00000100:00100000:3.0:1763334960.400647:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701787648 00000100:00100000:3.0:1763334960.400650:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701787648 00000100:00100000:3.0:1763334960.400665:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701788160 00000100:00100000:3.0:1763334960.400668:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701788160 00000100:00100000:3.0:1763334960.400676:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701787776 00000100:00100000:3.0:1763334960.400678:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701787776 00000100:00100000:3.0:1763334960.400694:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4469 00000100:00100000:3.0:1763334960.400705:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+101:3290:x1848989701787520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334960.400742:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:522 count 1 00010000:00010000:3.0:1763334960.400782:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.400811:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8498ab9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af014 expref: 54 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334960.400820:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.400822:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.400826:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.400893:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8498ab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af014 expref: 54 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334960.400911:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8498ab9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af014 expref: 54 pid: 26216 timeout: 1125 lvb_type: 1 00000100:00100000:3.0:1763334960.400925:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeecead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701788288:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334960.401001:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334960.401022:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4470 00000100:00100000:3.0:1763334960.401030:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+101:3290:x1848989701788032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.401431:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+102:3290:x1848989701788032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 400us (1153us total) trans 17179870935 rc 0/0 00000100:00100000:3.0:1763334960.401442:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4470 00000100:00100000:3.0:1763334960.401471:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4471 00000100:00100000:3.0:1763334960.401478:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef84b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+101:3290:x1848989701787904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334960.401491:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:527 count 1 00002000:00010000:3.0:1763334960.401522:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x20f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334960.401530:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d98 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.401539:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.401541:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.401546:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.401564:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.401609:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d98 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.401618:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.401637:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334960.401878:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef84b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+102:3290:x1848989701787904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 399us (1526us total) trans 17179870936 rc 0/0 00000100:00100000:3.0:1763334960.401884:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4471 00000100:00100000:3.0:1763334960.401898:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4472 00000100:00100000:3.0:1763334960.401905:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+101:3291:x1848989701787648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334960.401916:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:523 count 1 00010000:00010000:3.0:1763334960.401928:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.401941:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498bf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af07d expref: 54 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.401948:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334960.401950:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334960.401953:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.401975:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498bf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af07d expref: 54 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.401985:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498bf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af07d expref: 54 pid: 6518 timeout: 1125 lvb_type: 0 00000100:00100000:3.0:1763334960.401997:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeeceb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701788416:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334960.402038:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c25a8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1763334960.402063:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4473 00000100:00100000:3.0:1763334960.402070:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+101:3291:x1848989701788160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.402193:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+102:3291:x1848989701788160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 123us (1750us total) trans 17179870937 rc 0/0 00000100:00100000:3.0:1763334960.402200:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4473 00000100:00100000:3.0:1763334960.402215:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4474 00000100:00100000:3.0:1763334960.402221:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+101:3291:x1848989701787776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334960.402232:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:526 count 1 00010000:00010000:3.0:1763334960.402243:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.402254:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498c1e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af084 expref: 54 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.402261:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334960.402263:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334960.402265:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.402283:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498c1e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af084 expref: 54 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.402292:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498c1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af084 expref: 54 pid: 32241 timeout: 1125 lvb_type: 0 00000100:00100000:3.0:1763334960.402301:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701788544:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334960.402324:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c25a8900 going to sleep for 11 seconds 00000004:00080000:3.0:1763334960.402394:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c9831180/2, rc 0, transno 17179870937 00000100:00100000:3.0:1763334960.402402:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701788160:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334960.402427:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a21180/2, rc 0, transno 17179870936 00000100:00100000:3.0:1763334960.402432:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701787904:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763334960.402440:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa3ae300/2, rc 0, transno 17179870935 00000100:00100000:3.0:1763334960.402443:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701788032:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763334960.403006:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334960.403016:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.403027:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334960.403033:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d98 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.403043:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d98 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.403068:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d98 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.403082:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f8498d98 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.403102:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334960.403104:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334960.403105:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334960.403134:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701789056:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.403186:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.403223:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1763334960.403230:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701788672:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.403250:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.403264:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701789184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.403284:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.403308:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701789056 00000100:00100000:2.0:1763334960.403317:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701789056 00000100:00100000:2.0:1763334960.403369:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701788672 00000100:00100000:2.0:1763334960.403373:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701788672 00000100:00100000:2.0:1763334960.403391:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701789184 00000100:00100000:2.0:1763334960.403394:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701789184 00000100:00100000:2.0:1763334960.403409:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4475 00000100:00100000:2.0:1763334960.403417:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3291:x1848989701789056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334960.403439:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:523 count 1 00002000:00010000:2.0:1763334960.403478:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x20b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334960.403484:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498dad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.403496:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334960.403498:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334960.403503:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498dad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.403517:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498dad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.403527:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498dad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.403535:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498dad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.403556:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334960.403893:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+14:3291:x1848989701789056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 475us (705us total) trans 21474838218 rc 0/0 00000100:00100000:2.0:1763334960.403901:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4475 00000100:00100000:2.0:1763334960.403922:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4476 00000100:00100000:2.0:1763334960.403928:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3291:x1848989701788672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334960.403940:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:518 count 1 00010000:00010000:2.0:1763334960.403955:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.403971:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498962 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefa4 expref: 14 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.403980:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334960.403981:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334960.403984:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404011:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498962 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefa4 expref: 14 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404024:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498962 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefa4 expref: 14 pid: 26216 timeout: 1125 lvb_type: 0 00000100:00100000:2.0:1763334960.404037:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701789440:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334960.404101:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa806900 going to sleep for 11 seconds 00010000:00010000:2.0:1763334960.404114:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334960.404120:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498dad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404128:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334960.404132:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498dad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404140:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498dad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404151:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498dad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404158:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498dad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404173:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334960.404176:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334960.404178:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334960.404194:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4477 00000100:00100000:2.0:1763334960.404203:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3291:x1848989701789184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334960.404381:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x20c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334960.404385:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x20c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763334960.404388:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x20c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334960.404391:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x20c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763334960.404393:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x20c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334960.404425:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3291:x1848989701789184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (1139us total) trans 21474838219 rc 0/0 00000100:00100000:2.0:1763334960.404432:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4477 00000100:00100000:2.0:1763334960.404472:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701788928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.404503:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.404532:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1763334960.404539:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701788800:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.404561:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.404603:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701789312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.404627:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.404650:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701788928 00000100:00100000:2.0:1763334960.404658:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701788928 00000100:00100000:2.0:1763334960.404684:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701788800 00000100:00100000:2.0:1763334960.404687:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701788800 00000100:00100000:2.0:1763334960.404697:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701789312 00000100:00100000:2.0:1763334960.404700:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701789312 00000100:00100000:2.0:1763334960.404712:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4478 00000100:00100000:2.0:1763334960.404719:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701788928:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334960.404734:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:522 count 1 00010000:00010000:2.0:1763334960.404749:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404765:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498c2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af08b expref: 14 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404772:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334960.404774:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334960.404778:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404801:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498c2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af08b expref: 14 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404812:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498c2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af08b expref: 14 pid: 26564 timeout: 1125 lvb_type: 0 00000100:00100000:2.0:1763334960.404823:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701789568:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334960.404855:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa8069c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334960.404871:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4479 00000100:00100000:2.0:1763334960.404878:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701788800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334960.404892:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:519 count 1 00010000:00010000:2.0:1763334960.404905:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404919:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498bed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af076 expref: 14 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404935:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334960.404937:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334960.404940:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404959:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498bed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af076 expref: 14 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.404969:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498bed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af076 expref: 14 pid: 32241 timeout: 1125 lvb_type: 0 00000100:00100000:2.0:1763334960.404979:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee93df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701789696:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334960.405001:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa806b40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334960.405019:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4480 00000100:00100000:2.0:1763334960.405027:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701789312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.405175:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701789312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 148us (547us total) trans 21474838220 rc 0/0 00000100:00100000:2.0:1763334960.405182:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4480 00000004:00080000:2.0:1763334960.405231:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4f100/2, rc 0, transno 21474838219 00000100:00100000:2.0:1763334960.405239:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701789184:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334960.405251:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4fb80/2, rc 0, transno 21474838218 00000100:00100000:2.0:1763334960.405254:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701789056:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763334960.405272:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4ed80/2, rc 0, transno 21474838220 00000100:00100000:2.0:1763334960.405275:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701789312:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763334960.405447:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0f4 expref: 168 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.405467:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:0.0:1763334960.405471:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763334960.405477:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498d8a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0fb expref: 168 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.405490:0:29627:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498d8a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0fb expref: 168 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.405499:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498d8a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0fb expref: 168 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.405535:0:29627:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498d8a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0fb expref: 168 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334960.405549:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701789824:192.168.201.60@tcp:105: 00000100:00100000:0.0:1763334960.405633:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bfb600 going to sleep for 11 seconds 00000100:00100000:0.0:1763334960.412349:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.412404:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.412441:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694318208 00000100:00100000:0.0:1763334960.412455:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694318208 00010000:00010000:0.0:1763334960.412516:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8498ab9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af014 expref: 55 pid: 26216 timeout: 1125 lvb_type: 1 00000100:00100000:0.0:1763334960.412564:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2374 00000100:00100000:0.0:1763334960.412611:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+55:2359:x1848989694318208:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334960.412632:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334960.412639:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8498ab9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af014 expref: 55 pid: 26216 timeout: 1125 lvb_type: 1 00010000:00010000:0.0:1763334960.412658:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8498ab9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af014 expref: 55 pid: 26216 timeout: 1125 lvb_type: 1 00010000:00010000:0.0:1763334960.412704:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.412707:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.412715:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.412729:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.412761:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334960.412848:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+55:2359:x1848989694318208:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 241us (521us total) trans 0 rc 0/0 00010000:00010000:3.0:1763334960.412854:0:7819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8498ab9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af014 expref: 55 pid: 26216 timeout: 1125 lvb_type: 1 00000100:00100000:0.0:1763334960.412861:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2374 00000100:00100000:3.0:1763334960.412884:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeecead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701788288:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334960.412893:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694318336 00000100:00100000:0.0:1763334960.412898:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694318336 00010000:00010000:0.0:1763334960.412913:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498bf4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af07d expref: 54 pid: 6518 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334960.412919:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.412934:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334960.412939:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2375 00010000:00010000:3.0:1763334960.412950:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334960.412951:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+54:2359:x1848989694318336:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334960.412964:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334960.412968:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.412970:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498bf4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af07d expref: 54 pid: 6518 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334960.412987:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.413002:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498bf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af07d expref: 54 pid: 6518 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334960.413016:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763334960.413019:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.413022:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.413026:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.413033:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.413048:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334960.413069:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+54:2359:x1848989694318336:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 119us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.413076:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2375 00000100:00100000:3.0:1763334960.413568:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+102:3290:x1848989701787520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12861us (13354us total) trans 17179870938 rc 0/0 00000100:00100000:3.0:1763334960.413617:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4469 00010000:00010000:1.0:1763334960.413638:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498bf4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af07d expref: 53 pid: 6518 timeout: 1125 lvb_type: 0 00000100:00100000:1.0:1763334960.413654:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeeceb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701788416:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334960.413677:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.413687:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.413694:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.413703:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.413711:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.413733:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1763334960.413840:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763334960.413850:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.413861:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334960.413869:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.413881:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.413904:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.413912:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f8498d91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.413934:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334960.413938:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.413946:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334960.413950:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.413958:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.413970:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334960.413972:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+102:3291:x1848989701787648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12065us (13564us total) trans 17179870939 rc 0/0 00010000:00010000:3.0:1763334960.413987:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f8498d9f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334960.413995:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4472 00010000:00010000:3.0:1763334960.414013:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334960.414016:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334960.414019:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334960.414028:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334960.414318:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a22a00/2, rc 0, transno 17179870938 00000100:00100000:0.0:1763334960.414328:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701787520:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763334960.416443:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a21880/2, rc 0, transno 17179870939 00000100:00100000:0.0:1763334960.416463:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701787648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334960.419539:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.419564:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.419609:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.419637:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.419676:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694318592 00000100:00100000:1.0:1763334960.419689:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694318592 00010000:00010000:1.0:1763334960.419742:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498c1e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af084 expref: 53 pid: 32241 timeout: 1125 lvb_type: 0 00000100:00100000:1.0:1763334960.419783:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694318848 00000100:00100000:1.0:1763334960.419786:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694318848 00010000:00010000:1.0:1763334960.419804:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498bed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af076 expref: 15 pid: 32241 timeout: 1125 lvb_type: 0 00000100:00100000:1.0:1763334960.419821:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694318720 00000100:00100000:1.0:1763334960.419824:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694318720 00010000:00010000:1.0:1763334960.419837:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498c2c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af08b expref: 16 pid: 26564 timeout: 1125 lvb_type: 0 00000100:00100000:1.0:1763334960.419853:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2376 00000100:00100000:1.0:1763334960.419864:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+53:2362:x1848989694318592:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334960.419883:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334960.419888:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498c1e lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af084 expref: 53 pid: 32241 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.419909:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498c1e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af084 expref: 53 pid: 32241 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.419948:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.419951:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.419959:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.419971:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.419997:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334960.420073:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+53:2362:x1848989694318592:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 209us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.420081:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2376 00000100:00100000:1.0:1763334960.420104:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2377 00000100:00100000:1.0:1763334960.420111:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2362:x1848989694318848:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334960.420120:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334960.420124:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498bed lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af076 expref: 16 pid: 32241 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.420134:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498bed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af076 expref: 16 pid: 32241 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.420149:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.420150:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.420154:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.420162:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.420174:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334960.420194:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2362:x1848989694318848:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 84us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.420200:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2377 00000100:00100000:1.0:1763334960.420212:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2378 00000100:00100000:1.0:1763334960.420218:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2362:x1848989694318720:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334960.420225:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334960.420228:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498c2c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af08b expref: 15 pid: 26564 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.420237:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498c2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af08b expref: 15 pid: 26564 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.420248:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.420249:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.420252:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.420260:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.420272:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334960.420290:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2362:x1848989694318720:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 72us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.420296:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2378 00000100:00100000:1.0:1763334960.420368:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701789824:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334960.420412:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498d7c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0f4 expref: 168 pid: 29627 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763334960.420435:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0f4 expref: 167 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.420479:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:1.0:1763334960.420504:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52274:x1848989694317696:12345-192.168.201.60@tcp:101:bash.0 Request processed in 107112us (107399us total) trans 8589938568 rc 0/0 00000100:00100000:1.0:1763334960.420511:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4301 00010000:00010000:2.0:1763334960.421868:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f8498bed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af076 expref: 14 pid: 32241 timeout: 1125 lvb_type: 0 00000100:00100000:2.0:1763334960.421891:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee93df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701789696:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334960.421913:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.421924:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.421932:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.421944:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.421952:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.421971:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334960.422415:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701788800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17536us (17851us total) trans 21474838221 rc 0/0 00000100:00100000:2.0:1763334960.422425:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4479 00010000:00010000:2.0:1763334960.422462:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334960.422470:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422484:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334960.422489:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422498:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422519:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422526:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498dc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422545:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334960.422547:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334960.422549:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334960.422599:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f8498c2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af08b expref: 13 pid: 26564 timeout: 1125 lvb_type: 0 00000100:00100000:2.0:1763334960.422611:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701789568:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334960.422627:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422636:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422649:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422658:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422665:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422678:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334960.422834:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701788928:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18114us (18330us total) trans 21474838222 rc 0/0 00000100:00100000:2.0:1763334960.422842:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4478 00010000:00010000:2.0:1763334960.422862:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334960.422868:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422874:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334960.422877:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422886:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422898:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422911:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498dbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.422923:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334960.422925:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334960.422927:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334960.422958:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6bec700/2, rc 0, transno 21474838221 00000100:00100000:2.0:1763334960.422965:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701788800:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763334960.422973:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6bed500/2, rc 0, transno 21474838222 00000100:00100000:2.0:1763334960.422977:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701788928:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334960.423003:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701789440:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334960.423016:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.425934:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498c1e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af084 expref: 52 pid: 32241 timeout: 1125 lvb_type: 0 00000100:00100000:3.0:1763334960.425968:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701788544:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334960.426003:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.426015:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.426023:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.426035:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.426045:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.426071:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334960.426566:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+102:3291:x1848989701787776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24342us (26077us total) trans 17179870940 rc 0/0 00000100:00100000:3.0:1763334960.426606:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4474 00010000:00010000:3.0:1763334960.426663:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334960.426672:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.426682:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334960.426689:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.426700:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.426735:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.426745:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f8498da6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.426772:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334960.426774:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334960.426776:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334960.426821:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a21500/2, rc 0, transno 17179870940 00000100:00100000:3.0:1763334960.426830:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701787776:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.426860:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694318976 00000100:00100000:3.0:1763334960.426869:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694318976 00000100:00100000:3.0:1763334960.426923:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1590 00000100:00100000:3.0:1763334960.426934:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52959:x1848989694318976:12345-192.168.201.60@tcp:49:lfs.0 00000100:00100000:3.0:1763334960.427098:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52959:x1848989694318976:12345-192.168.201.60@tcp:49:lfs.0 Request processed in 165us (7459us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334960.427106:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1590 00000100:00100000:1.0:1763334960.429161:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.429239:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694318464 00000100:00100000:2.0:1763334960.429253:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694318464 00010000:00010000:2.0:1763334960.429308:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498962 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefa4 expref: 13 pid: 26216 timeout: 1125 lvb_type: 0 00000100:00100000:2.0:1763334960.429370:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2379 00000100:00100000:2.0:1763334960.429381:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694318464:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334960.429399:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334960.429404:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498962 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefa4 expref: 13 pid: 26216 timeout: 1125 lvb_type: 0 00010000:00010000:2.0:1763334960.429425:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498962 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefa4 expref: 13 pid: 26216 timeout: 1125 lvb_type: 0 00010000:00010000:2.0:1763334960.429452:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498962 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aefa4 expref: 13 pid: 26216 timeout: 1125 lvb_type: 0 00010000:00010000:2.0:1763334960.429473:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334960.429475:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334960.429481:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.429492:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.429522:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334960.429601:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d3b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694318464:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 222us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334960.429609:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2379 00010000:00010000:2.0:1763334960.429667:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.429676:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.429686:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.429700:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.429718:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334960.430116:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701788672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26185us (26862us total) trans 21474838223 rc 0/0 00000100:00100000:2.0:1763334960.430126:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4476 00010000:00010000:2.0:1763334960.430151:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334960.430158:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.430167:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334960.430171:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.430181:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.430193:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.430201:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498db4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.430221:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334960.430223:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334960.430226:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334960.430270:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6bedc00/2, rc 0, transno 21474838223 00000100:00100000:2.0:1763334960.430279:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701788672:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334960.433130:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.433179:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.433215:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694319360 00000100:00100000:3.0:1763334960.433230:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694319360 00000100:00100000:3.0:1763334960.433292:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1591 00000100:00100000:3.0:1763334960.433304:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52959:x1848989694319360:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334960.434853:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52959:x1848989694319360:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1532us (1652us total) trans 8589938569 rc 0/0 00000100:00100000:3.0:1763334960.434872:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1591 00000100:00100000:3.0:1763334960.434930:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694319104 00000100:00100000:3.0:1763334960.434938:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694319104 00000100:00100000:3.0:1763334960.434987:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4481 00000100:00100000:3.0:1763334960.434997:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+12:52274:x1848989694319104:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334960.435015:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334960.435042:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8498dc9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af102 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.435076:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498d36 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d8 expref: 13 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334960.435084:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.435087:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.435093:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8498dc9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af102 expref: 13 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.435137:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498d36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d8 expref: 13 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334960.435152:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498d36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d8 expref: 13 pid: 26216 timeout: 1125 lvb_type: 1 00000100:00100000:3.0:1763334960.435176:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeeceb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701789952:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334960.435245:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334960.442039:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeeceb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701789952:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334960.442093:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8498dc9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af102 expref: 13 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.442122:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abee00, rc 0) 00000100:00100000:1.0:1763334960.442206:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+13:52274:x1848989694319104:12345-192.168.201.60@tcp:101:bash.0 Request processed in 7208us (9089us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.442217:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4481 00000100:00100000:1.0:1763334960.442304:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.444546:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694319488 00000100:00100000:0.0:1763334960.444583:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694319488 00010000:00010000:0.0:1763334960.444650:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498d36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d8 expref: 13 pid: 26216 timeout: 1125 lvb_type: 1 00000100:00100000:0.0:1763334960.444699:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2380 00000100:00100000:0.0:1763334960.444712:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2361:x1848989694319488:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334960.444733:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334960.444740:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498d36 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d8 expref: 13 pid: 26216 timeout: 1125 lvb_type: 1 00010000:00010000:0.0:1763334960.444756:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498d36 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d8 expref: 13 pid: 26216 timeout: 1125 lvb_type: 1 00010000:00010000:0.0:1763334960.444791:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498d36 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0d8 expref: 13 pid: 26216 timeout: 1125 lvb_type: 1 00010000:00010000:0.0:1763334960.444814:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.444816:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1763334960.444826:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334960.444830:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8498dc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af102 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.444844:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8498dc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af102 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334960.444859:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694319744 00000100:00100000:1.0:1763334960.444865:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694319744 00010000:00010000:0.0:1763334960.444900:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8498dc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af102 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334960.444911:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4303 00000100:00100000:0.0:1763334960.444922:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701790080:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334960.444923:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52959:x1848989694319744:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334960.444955:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334960.444985:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8498dd0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af109 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334960.445024:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5adac00 going to sleep for 11 seconds 00010000:00010000:1.0:1763334960.445244:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498dd7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445261:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445273:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445289:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dde lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445296:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dde lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445302:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dde lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445547:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498de5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445556:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498de5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445563:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498de5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334960.445603:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17d:0x0]: returning size 2 00010000:00010000:1.0:1763334960.445725:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445733:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498dd7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445747:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445754:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.445759:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445767:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498dd7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445778:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334960.445782:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334960.445788:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498dd7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445794:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498dd7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445805:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dde lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445811:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dde lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445817:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dde lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445826:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.445828:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dde lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445834:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dde lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445840:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829300) 00010000:00010000:1.0:1763334960.445843:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334960.445846:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dde lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445851:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dde lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.445906:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8498dd0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af109 expref: 171 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.445920:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498de5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af109 expref: 170 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.445927:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:1.0:1763334960.445929:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334960.445933:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334960.447262:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52959:x1848989694319744:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2333us (2428us total) trans 8589938570 rc 0/0 00000100:00100000:1.0:1763334960.447275:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4303 00000100:00100000:1.0:1763334960.453234:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.453670:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694319872 00000100:00100000:3.0:1763334960.453688:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694319872 00000100:00100000:3.0:1763334960.453767:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4482 00000100:00100000:3.0:1763334960.453779:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+52:52274:x1848989694319872:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334960.453802:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334960.453831:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f8498df3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af110 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334960.453864:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x210:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334960.453894:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.453898:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.453911:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f8498df3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af110 expref: 53 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.453932:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f8498df3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af110 expref: 53 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.453949:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abf400, rc 0) 00000100:00100000:3.0:1763334960.454115:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+53:52274:x1848989694319872:12345-192.168.201.60@tcp:101:bash.0 Request processed in 336us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334960.454124:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4482 00000100:00100000:2.0:1763334960.454361:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.455113:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694320128 00000100:00100000:0.0:1763334960.455123:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694320128 00000100:00100000:0.0:1763334960.455171:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1592 00000100:00100000:0.0:1763334960.455183:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52959:x1848989694320128:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334960.455490:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52959:x1848989694320128:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 307us (1128us total) trans 8589938571 rc 0/0 00000100:00100000:0.0:1763334960.455498:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1592 00000100:00100000:3.0:1763334960.456744:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701790080:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334960.456785:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334960.456855:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2361:x1848989694319488:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 12144us (14549us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334960.456866:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2380 00000100:00100000:2.0:1763334960.459134:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.459179:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.459626:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694320256 00000100:00100000:0.0:1763334960.459640:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694320256 00002000:00010000:0.0:1763334960.459696:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/524 (0->18446744073709551615) 00002000:00100000:0.0:1763334960.459702:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee93ce00 with x1848989694320256 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334960.459718:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aee93ce00. 00000100:00100000:0.0:1763334960.459744:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694320384 00000100:00100000:0.0:1763334960.459747:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694320384 00002000:00010000:0.0:1763334960.459761:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/528 (0->18446744073709551615) 00002000:00100000:0.0:1763334960.459764:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee93d880 with x1848989694320384 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334960.459771:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee93d880. 00000100:00100000:0.0:1763334960.459801:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1674 00000100:00100000:0.0:1763334960.459812:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694320256:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:1.0:1763334960.459829:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1675 00000100:00100000:1.0:1763334960.459843:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+53:2359:x1848989694320384:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334960.460339:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x210:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334960.460345:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x210:0x0] updating lvb mtime from disk: 0 -> 1763334960 00002000:00010000:1.0:1763334960.460348:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x210:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334960.460351:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x210:0x0] updating lvb ctime from disk: 0 -> 1763334960 00002000:00010000:1.0:1763334960.460353:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x210:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334960.460449:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+54:2359:x1848989694320384:12345-192.168.201.60@tcp:10:bash.0 Request processed in 609us (1268us total) trans 17179870941 rc 0/0 00000100:00100000:1.0:1763334960.460459:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1675 00002000:00010000:1.0:1763334960.460464:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/528 (0->18446744073709551615) 00002000:00100000:1.0:1763334960.460467:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee93d880 with x1848989694320384 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334960.460473:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee93d880. 00002000:00010000:0.0:1763334960.462742:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x20c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334960.462754:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x20c:0x0] updating lvb mtime from disk: 0 -> 1763334960 00002000:00010000:0.0:1763334960.462759:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x20c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334960.462761:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x20c:0x0] updating lvb ctime from disk: 0 -> 1763334960 00002000:00010000:0.0:1763334960.462764:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x20c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334960.462861:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694320256:12345-192.168.201.60@tcp:10:bash.0 Request processed in 3042us (3734us total) trans 21474838224 rc 0/0 00000100:00100000:0.0:1763334960.462875:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1674 00002000:00010000:0.0:1763334960.462882:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/524 (0->18446744073709551615) 00002000:00100000:0.0:1763334960.462887:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee93ce00 with x1848989694320256 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334960.462898:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aee93ce00. 00000100:00100000:2.0:1763334960.463050:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.463360:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694320512 00000100:00100000:0.0:1763334960.463372:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694320512 00000100:00100000:0.0:1763334960.463426:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1593 00000100:00100000:0.0:1763334960.463436:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52959:x1848989694320512:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:0.0:1763334960.463624:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52959:x1848989694320512:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 188us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.463632:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1593 00000100:00100000:3.0:1763334960.470204:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.471478:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694320768 00000100:00100000:0.0:1763334960.471497:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694320768 00000100:00100000:2.0:1763334960.471859:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1594 00000100:00100000:2.0:1763334960.471872:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52274:x1848989694320768:12345-192.168.201.60@tcp:35:bash.0 00000001:00080000:2.0:1763334960.472301:0:29630:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938572 00000100:00100000:2.0:1763334960.472474:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52274:x1848989694320768:12345-192.168.201.60@tcp:35:bash.0 Request processed in 603us (2285us total) trans 8589938573 rc 0/0 00000100:00100000:2.0:1763334960.472485:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1594 00000020:00080000:2.0:1763334960.472492:0:29630:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000001:00080000:0.0:1763334960.472967:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179870931 is committed 00000001:00080000:0.0:1763334960.472987:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179870927 is committed 00000001:00080000:0.0:1763334960.473124:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179870934 is committed 00000001:00080000:0.0:1763334960.473238:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179870932 is committed 00000100:00100000:0.0:1763334960.481304:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.481475:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694321024 00000100:00100000:1.0:1763334960.481496:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694321024 00000100:00100000:1.0:1763334960.481630:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4304 00000100:00100000:1.0:1763334960.481642:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52961:x1848989694321024:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:1.0:1763334960.481751:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763334960.481799:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498de5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17d:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af109 expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.481830:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498d83 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17d:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0f4 expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.481844:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f8498d8a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af0fb expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.481856:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:1.0:1763334960.481872:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334960.481910:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dfa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.481929:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dfa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.481940:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dfa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.481957:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498e01 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.481963:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498e01 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.481969:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498e01 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.482169:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498e08 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.482179:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498e08 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.482186:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498e08 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:1.0:1763334960.487403:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].987, 64 off85360 00000040:00080000:1.0:1763334960.487472:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].998, 64 off86424 00000040:00080000:1.0:1763334960.487491:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].999, 64 off86488 00000040:00080000:1.0:1763334960.487506:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].988, 64 off85424 00010000:00010000:1.0:1763334960.487659:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498e0f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487685:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498e0f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487702:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498e0f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487712:0:30972:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498e0f lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487720:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498e0f lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487727:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498e0f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487767:0:30972:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334960.487798:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498e08 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487804:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498e08 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487811:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498e08 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487817:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.487821:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498e08 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487830:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498e08 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487845:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829000) 00010000:00010000:1.0:1763334960.487849:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763334960.487855:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498e08 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487866:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498e08 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487978:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dfa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487984:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dfa lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487989:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dfa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.487994:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.487997:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dfa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.488002:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dfa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.488010:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334960.488013:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334960.488016:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dfa lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.488021:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8498dfa lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:1.0:1763334960.488031:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000050dcd88e reply state 0000000021c09c1d transno 8589938574 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498e01 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334960.488040:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334960.488161:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52961:x1848989694321024:12345-192.168.201.60@tcp:36:rm.0 Request processed in 6515us (6872us total) trans 8589938574 rc 0/0 00000100:00100000:1.0:1763334960.488176:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4304 00010000:00010000:3.0:1763334960.488742:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334960.488752:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498e0f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.488761:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334960.488764:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498e0f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.488771:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498e0f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.488781:0:5737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17d:0x0].0x0 (ffff9a5ad2829000) 00010000:00010000:3.0:1763334960.488784:0:5737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763334960.488787:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498e0f lrc: 1/0,0 mode: --/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.488793:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8498e0f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x17d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.488810:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334960.488812:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334960.488814:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334960.492841:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.492990:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694321280 00000100:00100000:2.0:1763334960.493004:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694321280 00000100:00100000:2.0:1763334960.493073:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4305 00000100:00100000:2.0:1763334960.493085:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52960:x1848989694321280:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334960.493118:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334960.493148:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498e16 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af117 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.493249:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e1d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.493279:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e1d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.493292:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e1d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.493305:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.493313:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498e01 lrc: 2/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.493321:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.493349:0:30972:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498e01 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.493360:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.502815:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498e01 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.502840:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498e01 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.502848:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498e01 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.502854:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.502860:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498e01 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.502868:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498e01 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.502890:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829300) 00010000:00010000:0.0:1763334960.502895:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.502899:0:3276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.502909:0:3276:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.502917:0:3276:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.503138:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498e01 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.503150:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8498e01 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503165:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503176:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503294:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e1d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503301:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e1d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503307:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e1d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503311:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.503314:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e1d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503324:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e1d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503344:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.503347:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.503350:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e1d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503357:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e1d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503366:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503372:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503377:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503382:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.503384:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503389:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503395:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829300) 00010000:00010000:2.0:1763334960.503397:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.503399:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503405:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e24 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.503470:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498e16 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af117 expref: 172 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.503482:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.503484:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334960.503488:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498e16 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af117 expref: 172 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.503496:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066200, rc 0) 00000100:00100000:2.0:1763334960.506504:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52960:x1848989694321280:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 13401us (13660us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334960.506522:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4305 00000100:00100000:3.0:1763334960.509760:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.509959:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694321408 00000100:00100000:2.0:1763334960.509973:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694321408 00000100:00100000:2.0:1763334960.510043:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4306 00000100:00100000:2.0:1763334960.510055:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52960:x1848989694321408:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334960.510086:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334960.510115:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498e2b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af11e expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.510224:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e32 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510243:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e32 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510407:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e32 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510434:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e39 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510442:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510449:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510554:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e32 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510563:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e32 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510789:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e32 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510798:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.510803:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e32 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510812:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e32 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510828:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.510831:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.510837:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e32 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510845:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e32 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510859:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510866:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e39 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510872:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e39 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510878:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.510881:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e39 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510887:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e39 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510893:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334960.510896:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.510898:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e39 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510904:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e39 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.510945:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498e2b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af11e expref: 172 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.510954:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.510956:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.510960:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498e2b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af11e expref: 172 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.510969:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067a00, rc 0) 00000100:00100000:2.0:1763334960.511068:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52960:x1848989694321408:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1013us (1323us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334960.511078:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4306 00000100:00100000:0.0:1763334960.517830:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.518209:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694321536 00000100:00100000:2.0:1763334960.518226:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694321536 00000100:00100000:2.0:1763334960.518553:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4307 00000100:00100000:2.0:1763334960.518566:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52962:x1848989694321536:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334960.518693:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334960.518724:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498e40 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af125 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.518819:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e47 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.518838:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e47 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.518853:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e47 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.518868:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e4e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.518876:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.518883:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.518986:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e47 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.518994:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e47 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.519003:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.519009:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.519014:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.519023:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e47 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.519039:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.519043:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.519049:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e47 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.519055:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e47 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.519070:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.519076:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e4e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.519081:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e4e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.519086:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.519088:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e4e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.519094:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e4e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.519102:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab200) 00010000:00010000:2.0:1763334960.519104:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.519107:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e4e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.519112:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e4e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.519152:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498e40 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af125 expref: 172 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.519163:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.519165:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.519168:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498e40 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af125 expref: 172 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.519177:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066200, rc 0) 00000100:00100000:2.0:1763334960.519936:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52962:x1848989694321536:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1357us (2112us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334960.519950:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4307 00000100:00100000:1.0:1763334960.525505:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.526442:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694321664 00000100:00100000:2.0:1763334960.526462:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694321664 00000100:00100000:2.0:1763334960.527105:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4308 00000100:00100000:2.0:1763334960.527122:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52962:x1848989694321664:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334960.527153:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334960.527189:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498e55 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af12c expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.527436:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e5c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527456:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e5c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527469:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e5c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527483:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e63 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527490:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e63 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527496:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e63 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527624:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e5c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527632:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e5c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527639:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527645:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.527650:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527659:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e5c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527678:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.527682:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.527688:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e5c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527694:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8498e5c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527710:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e63 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527715:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e63 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527721:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e63 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527725:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.527728:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e63 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527733:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e63 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527739:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334960.527741:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.527744:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e63 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527748:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498e63 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.527797:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498e55 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af12c expref: 172 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.527808:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.527811:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.527815:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498e55 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af12c expref: 172 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.527825:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067a00, rc 0) 00000100:00100000:2.0:1763334960.527916:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52962:x1848989694321664:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 797us (2428us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334960.527925:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4308 00000100:00100000:3.0:1763334960.532263:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.533500:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.538107:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694322048 00000100:00100000:2.0:1763334960.538131:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694322048 00000100:00100000:2.0:1763334960.538222:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694321920 00000100:00100000:2.0:1763334960.538225:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694321920 00000100:00100000:2.0:1763334960.538265:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4309 00000100:00100000:2.0:1763334960.538278:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52962:x1848989694322048:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334960.538307:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334960.538349:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498e6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af13a expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.538458:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e71 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.538478:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.538491:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334960.538606:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:2.0:1763334960.538613:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334960.538645:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.538681:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8498e6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af13a expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.538705:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e71 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af13a expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.538716:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.538720:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334960.538724:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:2.0:1763334960.538813:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52962:x1848989694322048:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 538us (6584us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334960.538821:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4309 00000100:00100000:2.0:1763334960.538843:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4310 00000100:00100000:2.0:1763334960.538850:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52963:x1848989694321920:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334960.538859:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334960.538866:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e78 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af133 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.538921:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498e7f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.538930:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498e7f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.538938:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498e7f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.538960:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498e86 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.538967:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498e86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.538974:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498e86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539028:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498e7f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539036:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498e7f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539042:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498e7f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539048:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.539052:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498e7f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539060:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498e7f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539070:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.539073:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.539076:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498e7f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539082:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8498e7f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539090:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498e86 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539097:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498e86 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539102:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498e86 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539106:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334960.539109:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498e86 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539114:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498e86 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539120:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab200) 00010000:00010000:2.0:1763334960.539122:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334960.539125:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498e86 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539130:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498e86 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.539160:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e78 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af133 expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.539171:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334960.539173:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334960.539177:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498e78 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af133 expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.539186:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:2.0:1763334960.539211:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52963:x1848989694321920:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 362us (5724us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334960.539219:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4310 00000100:00100000:3.0:1763334960.550216:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.550368:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694322304 00000100:00100000:1.0:1763334960.550383:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694322304 00000100:00100000:1.0:1763334960.550475:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4311 00000100:00100000:1.0:1763334960.550487:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52962:x1848989694322304:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334960.550516:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334960.550520:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334960.550556:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8498e71 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af13a expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.550622:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334960.550629:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334960.550648:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498e8d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af141 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.550860:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498e94 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.550877:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498e94 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.550888:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498e94 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.550906:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498e9b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.550913:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498e9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.550920:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498e9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.551564:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498ea2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.551613:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.551621:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334960.551635:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17e:0x0]: returning size 0 00010000:00010000:1.0:1763334960.551670:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498e94 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.551679:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498e94 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.551687:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498e94 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.551694:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.551699:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498e94 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.551708:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498e94 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.551719:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334960.551722:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334960.551728:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498e94 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.551734:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498e94 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:1.0:1763334960.551748:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000042c34731 reply state 000000001696ba29 transno 8589938575 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498e9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334960.551757:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763334960.551794:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8498e8d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af141 expref: 174 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.551808:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af141 expref: 173 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.551815:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ad2829400) 00010000:00010000:1.0:1763334960.551818:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334960.551820:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478600, rc 0) 00000100:00100000:1.0:1763334960.554794:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52962:x1848989694322304:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4280us (4568us total) trans 8589938575 rc 0/0 00000100:00100000:1.0:1763334960.554815:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4311 00010000:00010000:1.0:1763334960.560414:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498e9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.560442:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498e9b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.560456:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498e9b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.560463:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.560470:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498e9b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.560479:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498e9b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.560508:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829c00) 00010000:00010000:1.0:1763334960.560512:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334960.560519:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498e9b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.560527:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498e9b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334960.567163:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.567253:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694322560 00000100:00100000:0.0:1763334960.567266:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694322560 00000100:00100000:0.0:1763334960.567349:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4312 00000100:00100000:0.0:1763334960.567360:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52962:x1848989694322560:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.567391:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.567421:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498eb0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af148 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.567561:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.567615:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498ea2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af141 expref: 174 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.567627:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.567674:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af141 expref: 174 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.567690:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498ea2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af141 expref: 174 pid: 30972 timeout: 1125 lvb_type: 0 00000100:00100000:0.0:1763334960.567708:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701790208:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334960.567821:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5ada480 going to sleep for 11 seconds 00000100:00100000:0.0:1763334960.570624:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.570771:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a1880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701790208:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334960.570810:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334960.571148:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694322688 00000100:00100000:3.0:1763334960.571161:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694322688 00010000:00010000:3.0:1763334960.571221:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498ea2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af141 expref: 175 pid: 30972 timeout: 1125 lvb_type: 0 00000100:00100000:3.0:1763334960.571272:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2381 00000100:00100000:3.0:1763334960.571284:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+175:2359:x1848989694322688:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334960.571308:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334960.571317:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498ea2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af141 expref: 175 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334960.571343:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af141 expref: 175 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334960.571377:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498ea2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af141 expref: 175 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334960.571399:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ad2829400) 00010000:00010000:3.0:1763334960.571406:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.571419:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.571427:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.571465:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334960.571555:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+174:2359:x1848989694322688:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 272us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334960.571564:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2381 00010000:00010000:0.0:1763334960.572492:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.572512:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334960.572543:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17e:0x0]: returning size 0 00000100:00100000:2.0:1763334960.573165:0:29653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:29653:1848989701790336:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1763334960.573242:0:29653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334960.573296:0:29653:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa806b40 going to sleep for 11 seconds 00000100:00100000:1.0:1763334960.573447:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701790336 00000100:00100000:1.0:1763334960.573458:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701790336 00000100:00100000:1.0:1763334960.573527:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4483 00000100:00100000:1.0:1763334960.573537:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:29653:x1848989701790336:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1763334960.573629:0:6519:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 546 00000004:00080000:0.0:1763334960.574697:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x212:0x0], index 1: 0 00000004:00080000:0.0:1763334960.574716:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20e:0x0], index 0: 0 00000004:00080000:0.0:1763334960.574724:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20f:0x0], index 0: 0 00000004:00080000:0.0:1763334960.574729:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x213:0x0], index 1: 0 00010000:00010000:0.0:1763334960.574958:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.574972:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.574980:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.574987:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.574993:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.575001:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.575026:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ad2829400) 00010000:00010000:0.0:1763334960.575029:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334960.575035:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.575041:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498eb7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.575140:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498eb0 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af148 expref: 174 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.575152:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.575154:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334960.575158:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498eb0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af148 expref: 174 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.575168:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334960.575279:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52962:x1848989694322560:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7920us (8132us total) trans 8589938576 rc 301/301 00000100:00100000:0.0:1763334960.575290:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4312 00000100:00100000:0.0:1763334960.581034:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.581181:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694322944 00000100:00100000:2.0:1763334960.581198:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694322944 00000100:00100000:2.0:1763334960.581302:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1595 00000100:00100000:2.0:1763334960.581315:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52962:x1848989694322944:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334960.581839:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52962:x1848989694322944:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 524us (824us total) trans 8589938577 rc 0/0 00000100:00100000:2.0:1763334960.581848:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1595 00000100:00100000:1.0:1763334960.583529:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:29653:x1848989701790336:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9980us (10273us total) trans 17179870942 rc 0/0 00000100:00100000:1.0:1763334960.583546:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4483 00000100:00100000:2.0:1763334960.584213:0:29653:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179870934 gen 2 00000004:00080000:2.0:1763334960.584224:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fc380, transno 17179870814 00000004:00080000:2.0:1763334960.585738:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6bed880, transno 17179870815 00000004:00080000:2.0:1763334960.586327:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fdf80, transno 17179870816 00000004:00080000:2.0:1763334960.586492:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fd880, transno 17179870817 00000004:00080000:2.0:1763334960.586497:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fdc00, transno 17179870819 00000004:00080000:2.0:1763334960.586500:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1ff480, transno 17179870820 00000004:00080000:2.0:1763334960.586505:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9e87b80, transno 17179870821 00000004:00080000:2.0:1763334960.586508:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9e84000, transno 17179870822 00000004:00080000:2.0:1763334960.586511:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9e86680, transno 17179870823 00000004:00080000:2.0:1763334960.586515:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9e87480, transno 17179870824 00000004:00080000:2.0:1763334960.586519:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9e85f80, transno 17179870825 00000004:00080000:2.0:1763334960.586522:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9e84a80, transno 17179870826 00000004:00080000:2.0:1763334960.586526:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab33480, transno 17179870829 00000004:00080000:2.0:1763334960.586529:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab31c00, transno 17179870830 00000004:00080000:2.0:1763334960.586533:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c6a00, transno 17179870831 00000004:00080000:2.0:1763334960.586536:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c4700, transno 17179870832 00000004:00080000:2.0:1763334960.586553:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac37cc380, transno 17179870837 00000004:00080000:2.0:1763334960.586557:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac37cc000, transno 17179870838 00000004:00080000:2.0:1763334960.586560:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac37cd180, transno 17179870839 00000004:00080000:2.0:1763334960.586563:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac37cdc00, transno 17179870840 00000004:00080000:2.0:1763334960.586566:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a20e00, transno 17179870841 00000004:00080000:2.0:1763334960.586608:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a23100, transno 17179870842 00000004:00080000:2.0:1763334960.586612:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a20380, transno 17179870843 00000004:00080000:2.0:1763334960.586616:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a23800, transno 17179870844 00000004:00080000:2.0:1763334960.586620:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5faa00, transno 17179870846 00000004:00080000:2.0:1763334960.586623:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa7ee300, transno 17179870847 00000004:00080000:2.0:1763334960.586628:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5f8e00, transno 17179870848 00000004:00080000:2.0:1763334960.586633:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8e9c00, transno 17179870849 00000004:00080000:2.0:1763334960.586636:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac8419180, transno 17179870851 00000004:00080000:2.0:1763334960.586639:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841a680, transno 17179870852 00000004:00080000:2.0:1763334960.586643:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac8418000, transno 17179870853 00000004:00080000:2.0:1763334960.586646:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841b480, transno 17179870854 00000004:00080000:2.0:1763334960.586649:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee93e680, transno 17179870857 00000004:00080000:2.0:1763334960.586652:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee93ea00, transno 17179870858 00000004:00080000:2.0:1763334960.586655:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f3800, transno 17179870859 00000004:00080000:2.0:1763334960.586658:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f3480, transno 17179870860 00000004:00080000:2.0:1763334960.586662:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af59f9180, transno 17179870864 00000004:00080000:2.0:1763334960.586665:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af59f8700, transno 17179870865 00000004:00080000:2.0:1763334960.586668:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5ac380, transno 17179870866 00000004:00080000:2.0:1763334960.586672:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af59f9f80, transno 17179870867 00000004:00080000:2.0:1763334960.586675:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841a300, transno 17179870868 00000004:00080000:2.0:1763334960.586678:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841b100, transno 17179870869 00000004:00080000:2.0:1763334960.586681:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fca80, transno 17179870871 00000004:00080000:2.0:1763334960.586684:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81ff480, transno 17179870872 00000004:00080000:2.0:1763334960.586687:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fd500, transno 17179870873 00000004:00080000:2.0:1763334960.586690:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fdc00, transno 17179870874 00000004:00080000:2.0:1763334960.586693:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fd180, transno 17179870875 00000004:00080000:2.0:1763334960.586695:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fc700, transno 17179870876 00000004:00080000:2.0:1763334960.586699:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac37cf800, transno 17179870878 00000004:00080000:2.0:1763334960.586702:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac37ce300, transno 17179870879 00000004:00080000:2.0:1763334960.586705:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac37ce680, transno 17179870880 00000100:00100000:1.0:1763334960.587919:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.588176:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694323200 00000100:00100000:0.0:1763334960.588189:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694323200 00000100:00100000:0.0:1763334960.588278:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1596 00000100:00100000:0.0:1763334960.588291:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52962:x1848989694323200:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334960.588707:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52962:x1848989694323200:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 418us (805us total) trans 8589938578 rc 0/0 00000100:00100000:0.0:1763334960.588722:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1596 00000004:00080000:2.0:1763334960.589707:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac37cf480, transno 17179870881 00000004:00080000:2.0:1763334960.589714:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fc700, transno 17179870883 00000004:00080000:2.0:1763334960.589717:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5b01f2c000, transno 17179870884 00000004:00080000:2.0:1763334960.589720:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fd880, transno 17179870885 00000004:00080000:2.0:1763334960.589723:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca872d80, transno 17179870886 00000004:00080000:2.0:1763334960.589726:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8c0700, transno 17179870888 00000004:00080000:2.0:1763334960.589729:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8c3b80, transno 17179870889 00000004:00080000:2.0:1763334960.589732:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8c0000, transno 17179870890 00000004:00080000:2.0:1763334960.589735:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8c2680, transno 17179870891 00000004:00080000:2.0:1763334960.589737:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77d180, transno 17179870894 00000004:00080000:2.0:1763334960.589740:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77f800, transno 17179870895 00000004:00080000:2.0:1763334960.589743:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c39e6d80, transno 17179870896 00000004:00080000:2.0:1763334960.589745:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c39e6300, transno 17179870897 00000004:00080000:2.0:1763334960.589748:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5f9880, transno 17179870901 00000004:00080000:2.0:1763334960.589751:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5fb100, transno 17179870902 00000004:00080000:2.0:1763334960.589753:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5fb480, transno 17179870903 00000004:00080000:2.0:1763334960.589755:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77d500, transno 17179870904 00000004:00080000:2.0:1763334960.589758:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeefe7800, transno 17179870905 00000004:00080000:2.0:1763334960.589761:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeefe4000, transno 17179870906 00000004:00080000:2.0:1763334960.589764:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa44ea00, transno 17179870908 00000004:00080000:2.0:1763334960.589767:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa44c380, transno 17179870909 00000004:00080000:2.0:1763334960.589770:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa44df80, transno 17179870910 00000004:00080000:2.0:1763334960.589773:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77f100, transno 17179870911 00000004:00080000:2.0:1763334960.589775:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8c1180, transno 17179870912 00000004:00080000:2.0:1763334960.589778:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8c3100, transno 17179870913 00000004:00080000:2.0:1763334960.589782:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4c000, transno 17179870915 00000004:00080000:2.0:1763334960.589785:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4ea00, transno 17179870916 00000004:00080000:2.0:1763334960.589789:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4d880, transno 17179870917 00000004:00080000:2.0:1763334960.589792:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4e680, transno 17179870918 00000004:00080000:2.0:1763334960.589795:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6452680, transno 17179870921 00000004:00080000:2.0:1763334960.589798:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6450e00, transno 17179870922 00000004:00080000:2.0:1763334960.589801:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c7800, transno 17179870923 00000004:00080000:2.0:1763334960.589804:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c5f80, transno 17179870924 00000004:00080000:2.0:1763334960.589806:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa3aed80, transno 17179870928 00000004:00080000:2.0:1763334960.589809:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa3ace00, transno 17179870929 00000004:00080000:2.0:1763334960.589812:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa3adc00, transno 17179870930 00000004:00080000:2.0:1763334960.589814:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa3ac380, transno 17179870931 00000004:00080000:2.0:1763334960.589817:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a83100, transno 17179870933 00000004:00080000:2.0:1763334960.589820:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a23b80, transno 17179870934 00000100:00100000:2.0:1763334960.589834:0:29653:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5afa3ae300 x1848989701788032/t17179870935(17179870935) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334976 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1763334960.589853:0:29653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:29653:1848989701790336:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1763334960.589873:0:29653:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x213:0x0]-[0x280000400:0x241:0x0] 00000004:00080000:3.0:1763334960.590869:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 6 in progress, 0 in flight, 87 done 00000100:00100000:1.0:1763334960.591170:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.591463:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694323456 00000100:00100000:0.0:1763334960.591480:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694323456 00000100:00100000:0.0:1763334960.591567:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4313 00000100:00100000:0.0:1763334960.591605:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52963:x1848989694323456:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.591635:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.591671:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ec5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af14f expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.591837:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498ecc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.591857:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498ecc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.591871:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498ecc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.591887:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498ed3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.591895:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.591902:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592062:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498eda lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592072:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498eda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592080:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498eda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334960.592092:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17e:0x0]: returning size 0 00010000:00010000:0.0:1763334960.592214:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498ecc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592224:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498ecc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592232:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498ecc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592239:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.592244:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498ecc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592254:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498ecc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592270:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.592274:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.592281:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498ecc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592288:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8498ecc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592303:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592308:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498ed3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592318:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592322:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.592325:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592344:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498ed3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592351:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd900) 00010000:00010000:0.0:1763334960.592354:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.592357:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498ed3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592363:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498ed3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.592412:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ec5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af14f expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.592426:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498eda lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af14f expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.592433:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bdc00) 00010000:00010000:0.0:1763334960.592435:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334960.592437:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334960.592529:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52963:x1848989694323456:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 925us (1364us total) trans 8589938579 rc 0/0 00000100:00100000:0.0:1763334960.592538:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4313 00000100:00100000:0.0:1763334960.599851:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.600480:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.600724:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694323840 00000100:00100000:2.0:1763334960.600740:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694323840 00000100:00100000:2.0:1763334960.600836:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4314 00000100:00100000:2.0:1763334960.600848:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52274:x1848989694323840:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:2.0:1763334960.600938:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334960.600975:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8498eda lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af14f expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.600998:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bdc00) 00010000:00010000:2.0:1763334960.601013:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334960.601374:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498ee8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.601392:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334960.601402:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:2.0:1763334960.601465:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938580 00000004:00010000:2.0:1763334960.601492:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005754227a reply state 00000000c8bf28f5 transno 8589938581 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334960.601502:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334960.601664:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52274:x1848989694323840:12345-192.168.201.60@tcp:36:bash.0 Request processed in 816us (1829us total) trans 8589938581 rc 0/0 00000100:00100000:2.0:1763334960.601673:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4314 00000020:00080000:2.0:1763334960.601679:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763334960.603081:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694323584 00000100:00100000:1.0:1763334960.603100:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694323584 00000100:00100000:1.0:1763334960.603174:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4484 00000100:00100000:1.0:1763334960.603185:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694323584:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334960.603208:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334960.603238:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479200/0xcedf0054f8498eef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af156 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334960.603274:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x212:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334960.603299:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.603302:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.603315:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479200/0xcedf0054f8498eef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af156 expref: 20 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334960.603348:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479200/0xcedf0054f8498eef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af156 expref: 20 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334960.603368:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479200, rc 0) 00000100:00100000:1.0:1763334960.603447:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694323584:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 263us (2970us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.603455:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4484 00000100:00100000:1.0:1763334960.607404:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.607476:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694323968 00000100:00100000:0.0:1763334960.607492:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694323968 00010000:00010000:3.0:1763334960.607514:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498ee8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.607528:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498ee8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.607538:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498ee8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.607545:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334960.607551:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498ee8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.607560:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498ee8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.607611:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:3.0:1763334960.607615:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334960.607622:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498ee8 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.607629:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8498ee8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334960.607798:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4315 00000100:00100000:0.0:1763334960.607813:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52274:x1848989694323968:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334960.607845:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.607874:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ef6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af15d expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.608280:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ef6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af15d expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.608300:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ef6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af15d expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.608324:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:0.0:1763334960.608327:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334960.608341:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792c00, rc 0) 00000100:00100000:0.0:1763334960.608764:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52274:x1848989694323968:12345-192.168.201.60@tcp:101:bash.0 Request processed in 951us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.608775:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4315 00000100:00100000:3.0:1763334960.612455:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.613010:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.613837:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694324096 00000100:00100000:0.0:1763334960.613856:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694324096 00000100:00100000:0.0:1763334960.613940:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694324352 00000100:00100000:0.0:1763334960.613943:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694324352 00000100:00100000:0.0:1763334960.613979:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4316 00000100:00100000:0.0:1763334960.613993:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52963:x1848989694324096:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.614033:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.614063:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498efd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af164 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.614158:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498efd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af164 expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.614178:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498efd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af164 expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.614208:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:0.0:1763334960.614211:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334960.614217:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334960.614319:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52963:x1848989694324096:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 329us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.614337:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4316 00000100:00100000:0.0:1763334960.614491:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4317 00000100:00100000:0.0:1763334960.614500:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52274:x1848989694324352:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334960.614510:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.614513:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334960.614536:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ef6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af15d expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.614554:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:0.0:1763334960.614559:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334960.614567:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498f04 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af16b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.614642:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.614654:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498efd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af164 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.614664:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.614711:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498efd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af164 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.614728:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498efd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af164 expref: 180 pid: 30972 timeout: 1125 lvb_type: 0 00000100:00100000:0.0:1763334960.614746:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701790464:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334960.614852:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0ad180 going to sleep for 11 seconds 00000100:00100000:3.0:1763334960.620108:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.620952:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701790464:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334960.620994:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334960.621213:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694324480 00000100:00100000:2.0:1763334960.621229:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694324480 00000100:00100000:2.0:1763334960.621321:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4318 00000100:00100000:2.0:1763334960.621343:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52963:x1848989694324480:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334960.621383:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334960.621418:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498f12 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af172 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334960.621428:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334960.621520:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.621533:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498f12 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af172 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.621560:0:32232:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.621609:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498f12 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af172 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.621627:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:2.0:1763334960.621630:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334960.621634:0:32232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.621642:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067a00, rc 0) 00000100:00100000:2.0:1763334960.621726:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52963:x1848989694324480:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 395us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334960.621735:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4318 00000100:00100000:1.0:1763334960.622614:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694324608 00000100:00100000:1.0:1763334960.622627:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694324608 00010000:00010000:1.0:1763334960.622677:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498efd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af164 expref: 182 pid: 30972 timeout: 1125 lvb_type: 0 00000100:00100000:1.0:1763334960.622723:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2382 00000100:00100000:1.0:1763334960.622734:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2360:x1848989694324608:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334960.622752:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334960.622759:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498efd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af164 expref: 182 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.622775:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498efd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af164 expref: 182 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.622803:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8498efd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af164 expref: 182 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.622826:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:1.0:1763334960.622831:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.622842:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.622850:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.622861:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498f12 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af172 expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.622898:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334960.622922:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334960.622932:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334960.622953:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:2360:x1848989694324608:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 220us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.622962:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2382 00000040:00080000:2.0:1763334960.624189:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1000, 88 off86576 00000004:00080000:2.0:1763334960.624204:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1025257631064ns, next at 1025532430821ns, rc = 0 00000040:00080000:2.0:1763334960.624255:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].989, 88 off85512 00000004:00080000:2.0:1763334960.624259:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1025257687490ns, next at 1025532371403ns, rc = 0 00000040:00080000:2.0:1763334960.625347:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].990, 88 off85600 00000004:00080000:2.0:1763334960.625361:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1025258788733ns, next at 1025532371403ns, rc = 0 00000040:00080000:2.0:1763334960.626047:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1001, 88 off86664 00000004:00080000:2.0:1763334960.626055:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1025259482633ns, next at 1025532430821ns, rc = 0 00000001:00080000:1.0:1763334960.677139:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938579 is committed 00000001:00080000:1.0:1763334960.677184:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938582 is committed 00000004:00080000:1.0:1763334960.677190:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 660 committed 00000004:00080000:1.0:1763334960.677203:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 648 committed 00000004:00080000:1.0:1763334960.677212:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 647 committed 00000004:00080000:1.0:1763334960.677215:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 659 committed 00000100:00100000:0.0:1763334960.677618:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701790976:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334960.677706:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334960.677751:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701791488:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334960.677769:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334960.677793:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1763334960.677798:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701790592:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334960.677811:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334960.677824:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701791104:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334960.677841:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334960.677872:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701790976 00000100:00100000:0.0:1763334960.677881:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701790976 00000100:00100000:0.0:1763334960.677927:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701791488 00000100:00100000:0.0:1763334960.677929:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701791488 00000100:00100000:0.0:1763334960.677943:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701790592 00000100:00100000:0.0:1763334960.677945:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701790592 00000100:00100000:0.0:1763334960.677957:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701791104 00000100:00100000:0.0:1763334960.677960:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701791104 00000100:00100000:0.0:1763334960.677978:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4485 00000100:00100000:0.0:1763334960.677987:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701790976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334960.678269:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3289:x1848989701790976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 282us (562us total) trans 21474838225 rc 0/0 00000100:00100000:0.0:1763334960.678279:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4485 00000100:00100000:0.0:1763334960.678300:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4486 00000100:00100000:0.0:1763334960.678307:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701791488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334960.678461:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3289:x1848989701791488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (690us total) trans 17179870943 rc 0/0 00000100:00100000:0.0:1763334960.678467:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4486 00000100:00100000:0.0:1763334960.678480:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4487 00000100:00100000:0.0:1763334960.678486:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701790592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334960.678500:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:524 count 1 00010000:00010000:0.0:1763334960.678528:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.678562:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8498dc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af102 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.678593:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334960.678596:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334960.678600:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.678635:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8498dc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af102 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.678652:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8498dc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af102 expref: 12 pid: 32241 timeout: 1125 lvb_type: 0 00000100:00100000:0.0:1763334960.678669:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701791616:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334960.678753:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334960.678778:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4488 00000100:00100000:0.0:1763334960.678784:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701791104:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334960.678798:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:528 count 1 00010000:00010000:0.0:1763334960.678812:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.678824:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f8498df3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af110 expref: 19 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.678831:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334960.678833:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334960.678836:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.678853:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f8498df3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af110 expref: 19 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.678861:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f8498df3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af110 expref: 19 pid: 32241 timeout: 1125 lvb_type: 0 00000100:00100000:0.0:1763334960.678871:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701791744:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334960.678890:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0ad000 going to sleep for 11 seconds 00000004:00080000:0.0:1763334960.678970:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d73800/2, rc 0, transno 21474838225 00000100:00100000:0.0:1763334960.678977:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701790976:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334960.678987:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aef0a0000/2, rc 0, transno 17179870943 00000100:00100000:0.0:1763334960.678991:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701791488:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763334960.679153:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af16b expref: 168 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.679168:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:3.0:1763334960.679172:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334960.679177:0:30972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498f12 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af172 expref: 168 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.679190:0:30972:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498f12 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af172 expref: 168 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.679197:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498f12 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af172 expref: 168 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.679227:0:30972:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498f12 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af172 expref: 168 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334960.679238:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701791872:192.168.201.60@tcp:105: 00000100:00100000:3.0:1763334960.679274:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa65e180 going to sleep for 11 seconds 00000100:00100000:3.0:1763334960.679301:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701790848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334960.679345:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334960.679374:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701791360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.679395:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334960.679419:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1763334960.679425:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701790720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334960.679443:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334960.679457:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701791232:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334960.679474:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334960.679501:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701790848 00000100:00100000:3.0:1763334960.679508:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701790848 00000100:00100000:3.0:1763334960.679544:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701791360 00000100:00100000:3.0:1763334960.679547:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701791360 00000100:00100000:3.0:1763334960.679563:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701790720 00000100:00100000:3.0:1763334960.679567:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701790720 00000100:00100000:3.0:1763334960.679605:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701791232 00000100:00100000:3.0:1763334960.679609:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701791232 00000100:00100000:3.0:1763334960.679623:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4489 00000100:00100000:3.0:1763334960.679630:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3292:x1848989701790848:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334960.679859:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3292:x1848989701790848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (513us total) trans 21474838226 rc 0/0 00000100:00100000:3.0:1763334960.679867:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4489 00000100:00100000:3.0:1763334960.679885:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4490 00000100:00100000:3.0:1763334960.679892:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3292:x1848989701791360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334960.680012:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334960.680017:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763334960.680020:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334960.680022:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763334960.680025:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334960.680051:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3292:x1848989701791360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 160us (655us total) trans 17179870944 rc 0/0 00000100:00100000:3.0:1763334960.680058:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4490 00000100:00100000:3.0:1763334960.680070:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4491 00000100:00100000:3.0:1763334960.680077:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3292:x1848989701790720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334960.680090:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:525 count 1 00002000:00010000:3.0:1763334960.680118:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x20d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334960.680125:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8498f27 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680136:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.680138:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.680144:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8498f27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680158:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8498f27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680169:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8498f27 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680177:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8498f27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680200:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334960.680476:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3292:x1848989701790720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 399us (1031us total) trans 21474838227 rc 0/0 00000100:00100000:3.0:1763334960.680484:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4491 00000100:00100000:3.0:1763334960.680500:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4492 00000100:00100000:3.0:1763334960.680507:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3292:x1848989701791232:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334960.680520:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:529 count 1 00002000:00010000:3.0:1763334960.680540:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x211:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334960.680546:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abe800/0xcedf0054f8498f2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680554:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.680556:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.680560:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abe800/0xcedf0054f8498f2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680617:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abe800/0xcedf0054f8498f2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680628:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abe800/0xcedf0054f8498f2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680636:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abe800/0xcedf0054f8498f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680650:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763334960.680803:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3292:x1848989701791232:12345-0@lo:6:osp-syn-1-0.0 Request processed in 296us (1327us total) trans 17179870945 rc 0/0 00000100:00100000:3.0:1763334960.680810:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4492 00010000:00010000:3.0:1763334960.680849:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763334960.680857:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8498f27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680868:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abf000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334960.680873:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8498f27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680885:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8498f27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680906:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8498f27 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680915:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8498f27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680941:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334960.680945:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abe800/0xcedf0054f8498f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680951:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abe800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334960.680954:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abe800/0xcedf0054f8498f2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680961:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abe800/0xcedf0054f8498f2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680970:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abe800/0xcedf0054f8498f2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680976:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abe800/0xcedf0054f8498f2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.680989:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334960.680991:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334960.680993:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334960.681017:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334960.681083:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d73100/2, rc 0, transno 21474838227 00000100:00100000:3.0:1763334960.681092:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701790720:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763334960.681106:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aef0a3480/2, rc 0, transno 17179870945 00000100:00100000:3.0:1763334960.681111:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701791232:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763334960.681120:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d70e00/2, rc 0, transno 21474838226 00000100:00100000:3.0:1763334960.681124:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701790848:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334960.681133:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aef0a0a80/2, rc 0, transno 17179870944 00000100:00100000:3.0:1763334960.681136:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701791360:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334960.695413:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.695460:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701791616:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334960.695486:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334960.695502:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334960.695512:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.695544:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701791744:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334960.695558:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334960.695606:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694324864 00000100:00100000:0.0:1763334960.695606:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694324736 00000100:00100000:1.0:1763334960.695615:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694324864 00000100:00100000:0.0:1763334960.695615:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694324736 00010000:00010000:0.0:1763334960.695665:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8498dc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af102 expref: 13 pid: 32241 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.695666:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f8498df3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af110 expref: 20 pid: 32241 timeout: 1125 lvb_type: 0 00000100:00100000:3.0:1763334960.695833:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701791872:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334960.695882:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8498f04 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af16b expref: 168 pid: 30972 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763334960.695910:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af16b expref: 167 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.695958:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:3.0:1763334960.696038:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52274:x1848989694324352:12345-192.168.201.60@tcp:101:bash.0 Request processed in 81538us (83028us total) trans 8589938582 rc 0/0 00000100:00100000:3.0:1763334960.696049:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4317 00000100:00100000:1.0:1763334960.696972:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2383 00000100:00100000:0.0:1763334960.696981:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2384 00000100:00100000:1.0:1763334960.696992:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694324864:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1763334960.696992:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694324736:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334960.697017:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334960.697017:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334960.697025:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f8498df3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af110 expref: 20 pid: 32241 timeout: 1125 lvb_type: 0 00010000:00010000:0.0:1763334960.697025:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8498dc9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af102 expref: 13 pid: 32241 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.697040:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f8498df3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af110 expref: 20 pid: 32241 timeout: 1125 lvb_type: 0 00010000:00010000:0.0:1763334960.697041:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8498dc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af102 expref: 13 pid: 32241 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.697068:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf400/0xcedf0054f8498df3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af110 expref: 20 pid: 32241 timeout: 1125 lvb_type: 0 00010000:00010000:0.0:1763334960.697068:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8498dc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af102 expref: 13 pid: 32241 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.697088:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.697088:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.697091:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.697091:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.697097:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.697097:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.697111:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.697111:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.697142:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334960.697151:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334960.697185:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694324864:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 200us (1696us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.697193:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2383 00000100:00100000:0.0:1763334960.697251:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694324736:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 261us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.697255:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694324992 00000100:00100000:0.0:1763334960.697258:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2384 00000100:00100000:1.0:1763334960.697263:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694324992 00010000:00010000:0.0:1763334960.697280:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.697294:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334960.697298:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1597 00000100:00100000:1.0:1763334960.697304:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52963:x1848989694324992:12345-192.168.201.60@tcp:49:lfs.0 00010000:00010000:0.0:1763334960.697308:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.697315:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.697345:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334960.697436:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52963:x1848989694324992:12345-192.168.201.60@tcp:49:lfs.0 Request processed in 131us (1921us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.697452:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1597 00010000:00010000:1.0:1763334960.697501:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.697510:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.697518:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.697525:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.697550:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1763334960.697692:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763334960.697705:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.697716:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334960.697723:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.697735:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.697753:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.697762:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f8498f20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334960.697769:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3289:x1848989701791104:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18981us (19923us total) trans 17179870946 rc 0/0 00000100:00100000:0.0:1763334960.697780:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4488 00010000:00010000:3.0:1763334960.697792:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334960.697798:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334960.697804:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3289:x1848989701790592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19316us (19988us total) trans 21474838228 rc 0/0 00010000:00010000:3.0:1763334960.697810:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792c00 already unused, calling callback (ffffffffc16f8b40) 00000100:00100000:1.0:1763334960.697815:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4487 00010000:00010000:3.0:1763334960.697816:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.697826:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763334960.697837:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d72d80/2, rc 0, transno 21474838228 00010000:00010000:3.0:1763334960.697838:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.697846:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334960.697848:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701790592:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1763334960.697849:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498f19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763334960.697865:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aef0a3800/2, rc 0, transno 17179870946 00010000:00010000:3.0:1763334960.697869:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334960.697873:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334960.697873:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701791104:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763334960.697877:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334960.701427:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.702323:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.702489:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694325248 00000100:00100000:3.0:1763334960.702505:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694325248 00000100:00100000:3.0:1763334960.702650:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4319 00000100:00100000:0.0:1763334960.702717:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+167:52963:x1848989694325248:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.702752:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.702782:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8498f35 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af179 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.702873:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498f3c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.702893:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498f3c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.702906:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498f3c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.702924:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f43 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.702932:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.702938:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703088:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498f4a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703097:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498f4a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703103:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498f4a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334960.703150:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17e:0x0]: returning size 2 00000004:00200000:0.0:1763334960.703156:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334960.703180:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498f4a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703193:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498f4a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703202:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498f3c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703213:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498f3c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703220:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498f3c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703226:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.703231:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498f3c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703239:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498f3c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703273:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.703277:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.703282:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498f3c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703288:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498f3c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703304:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703309:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f43 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703314:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703318:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.703321:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703339:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f43 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703346:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd200) 00010000:00010000:0.0:1763334960.703348:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.703351:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f43 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703356:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f43 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.703392:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8498f35 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af179 expref: 169 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.703406:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498f4a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af179 expref: 168 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.703412:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:0.0:1763334960.703415:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334960.703417:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334960.703522:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52963:x1848989694325248:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 861us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.703532:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4319 00000100:00100000:1.0:1763334960.706787:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694325120 00000100:00100000:1.0:1763334960.706811:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694325120 00000100:00100000:1.0:1763334960.707497:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1598 00000100:00100000:1.0:1763334960.707513:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52274:x1848989694325120:12345-192.168.201.60@tcp:49:bash.0 00000100:00100000:1.0:1763334960.709826:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52274:x1848989694325120:12345-192.168.201.60@tcp:49:bash.0 Request processed in 2296us (8393us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.709847:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1598 00000100:00100000:0.0:1763334960.709965:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.712902:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694325504 00000100:00100000:1.0:1763334960.712926:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694325504 00000100:00100000:1.0:1763334960.713000:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4320 00000100:00100000:1.0:1763334960.713009:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+168:52963:x1848989694325504:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334960.713036:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334960.715468:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498f51 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af180 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.715729:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8498f58 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.715750:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8498f58 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.715767:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8498f58 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334960.715783:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17e:0x0]: returning size 2 00010000:00010000:1.0:1763334960.716069:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8498f51 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af180 expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.716095:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8498f58 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af180 expref: 170 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.716114:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:1.0:1763334960.716119:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763334960.716123:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334960.716261:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52963:x1848989694325504:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3240us (6286us total) trans 8589938583 rc 0/0 00000100:00100000:1.0:1763334960.716274:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4320 00000100:00100000:0.0:1763334960.718462:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.718526:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694325632 00000100:00100000:1.0:1763334960.718547:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694325632 00000100:00100000:0.0:1763334960.718712:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4493 00000100:00100000:0.0:1763334960.718725:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+19:52274:x1848989694325632:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334960.718749:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.718778:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af187 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.718817:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479200/0xcedf0054f8498eef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af156 expref: 20 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334960.718825:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.718828:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.718832:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.718874:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479200/0xcedf0054f8498eef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af156 expref: 20 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334960.718890:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479200/0xcedf0054f8498eef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af156 expref: 20 pid: 6519 timeout: 1125 lvb_type: 1 00000100:00100000:0.0:1763334960.718905:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701792000:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334960.719138:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0adf00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334960.723022:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.723194:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694325760 00000100:00100000:1.0:1763334960.723209:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694325760 00000100:00100000:1.0:1763334960.723291:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1599 00000100:00100000:1.0:1763334960.723305:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52963:x1848989694325760:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:1.0:1763334960.723566:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52963:x1848989694325760:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 263us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.723605:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1599 00000100:00100000:2.0:1763334960.725216:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.732163:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694325888 00000100:00100000:1.0:1763334960.732188:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694325888 00010000:00010000:1.0:1763334960.732283:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479200/0xcedf0054f8498eef lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af156 expref: 21 pid: 6519 timeout: 1125 lvb_type: 1 00000100:00100000:1.0:1763334960.732342:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2385 00000100:00100000:1.0:1763334960.732353:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694325888:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334960.732373:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334960.732378:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479200/0xcedf0054f8498eef lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af156 expref: 21 pid: 6519 timeout: 1125 lvb_type: 1 00010000:00010000:1.0:1763334960.732400:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479200/0xcedf0054f8498eef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af156 expref: 21 pid: 6519 timeout: 1125 lvb_type: 1 00010000:00010000:1.0:1763334960.732432:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.732434:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334960.732443:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.732453:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.732507:0:6532:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334960.732525:0:6532:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6532:1848989701792128:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334960.732667:0:6532:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e70240 going to sleep for 11 seconds 00010000:00010000:0.0:1763334960.736455:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479200/0xcedf0054f8498eef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af156 expref: 21 pid: 6519 timeout: 1125 lvb_type: 1 00000100:00100000:0.0:1763334960.736493:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e85880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701792000:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334960.736540:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.736561:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334960.738562:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+20:52274:x1848989694325632:12345-192.168.201.60@tcp:101:bash.0 Request processed in 19815us (20096us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.738626:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4493 00000100:00100000:2.0:1763334960.745361:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.745435:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694326016 00000100:00100000:0.0:1763334960.745450:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694326016 00000100:00100000:0.0:1763334960.745541:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4494 00000100:00100000:0.0:1763334960.745555:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+12:52274:x1848989694326016:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334960.745658:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763334960.745826:0:6532:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d70700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6532:1848989701792128:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334960.745856:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334960.746356:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f6d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af18e expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334960.746392:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x20e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334960.746421:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.746424:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.746437:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af18e expref: 13 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.746457:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af18e expref: 13 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.746470:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792200, rc 0) 00000100:00100000:1.0:1763334960.747995:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694325888:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 15628us (22773us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.748012:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2385 00000100:00100000:0.0:1763334960.748146:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+13:52274:x1848989694326016:12345-192.168.201.60@tcp:101:bash.0 Request processed in 2591us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.748155:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4494 00000100:00100000:2.0:1763334960.750117:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.763785:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.764420:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694326144 00000100:00100000:0.0:1763334960.764438:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694326144 00000100:00100000:3.0:1763334960.764493:0:21633:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694326272 00000100:00100000:3.0:1763334960.764500:0:21633:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694326272 00002000:00010000:1.0:1763334960.764626:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/530 (0->18446744073709551615) 00002000:00100000:1.0:1763334960.764633:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ae8d4ea00 with x1848989694326144 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334960.764651:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ae8d4ea00. 00000100:00100000:1.0:1763334960.764702:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1676 00000100:00100000:1.0:1763334960.764715:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694326144:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334960.765119:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334960.765124:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb mtime from disk: 0 -> 1763334961 00002000:00010000:1.0:1763334960.765128:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334960.765130:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb ctime from disk: 0 -> 1763334961 00002000:00010000:1.0:1763334960.765151:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334960.765241:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694326144:12345-192.168.201.60@tcp:10:bash.0 Request processed in 526us (15133us total) trans 17179870947 rc 0/0 00000100:00100000:1.0:1763334960.765251:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1676 00002000:00010000:1.0:1763334960.765257:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/530 (0->18446744073709551615) 00002000:00100000:1.0:1763334960.765260:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ae8d4ea00 with x1848989694326144 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334960.765265:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ae8d4ea00. 00002000:00010000:0.0:1763334960.765374:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/526 (0->18446744073709551615) 00002000:00100000:0.0:1763334960.765379:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ae8d4d880 with x1848989694326272 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334960.765388:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ae8d4d880. 00000100:00100000:0.0:1763334960.765413:0:21633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1677 00000100:00100000:0.0:1763334960.765420:0:21633:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694326272:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:0.0:1763334960.765677:0:21633:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334960.765680:0:21633:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb mtime from disk: 0 -> 1763334961 00002000:00010000:0.0:1763334960.765682:0:21633:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334960.765685:0:21633:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb ctime from disk: 0 -> 1763334961 00002000:00010000:0.0:1763334960.765687:0:21633:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334960.765722:0:21633:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694326272:12345-192.168.201.60@tcp:10:bash.0 Request processed in 303us (1963us total) trans 21474838229 rc 0/0 00000100:00100000:0.0:1763334960.765731:0:21633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1677 00002000:00010000:0.0:1763334960.765734:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/526 (0->18446744073709551615) 00002000:00100000:0.0:1763334960.765737:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ae8d4d880 with x1848989694326272 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334960.765741:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ae8d4d880. 00000100:00100000:2.0:1763334960.768892:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.768995:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694326528 00000100:00100000:1.0:1763334960.769011:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694326528 00000100:00100000:1.0:1763334960.769100:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1600 00000100:00100000:1.0:1763334960.769113:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52274:x1848989694326528:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:1.0:1763334960.769988:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52274:x1848989694326528:12345-192.168.201.60@tcp:35:bash.0 Request processed in 867us (1105us total) trans 8589938584 rc 0/0 00000100:00100000:1.0:1763334960.770000:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1600 00000100:00100000:3.0:1763334960.779729:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.779784:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.779845:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694327040 00000100:00100000:0.0:1763334960.779861:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694327040 00000100:00100000:0.0:1763334960.779949:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1601 00000100:00100000:0.0:1763334960.779963:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52966:x1848989694327040:12345-192.168.201.60@tcp:35:rm.0 00000100:00100000:0.0:1763334960.780338:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52966:x1848989694327040:12345-192.168.201.60@tcp:35:rm.0 Request processed in 367us (540us total) trans 8589938585 rc 0/0 00000100:00100000:0.0:1763334960.780348:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1601 00000100:00100000:1.0:1763334960.780439:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694326784 00000100:00100000:1.0:1763334960.780445:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694326784 00000100:00100000:1.0:1763334960.780480:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4321 00000100:00100000:1.0:1763334960.780488:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52965:x1848989694326784:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334960.780501:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334960.780531:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498f74 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af195 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.780660:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.780679:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498f4a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af179 expref: 173 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.780690:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.780732:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498f4a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af179 expref: 173 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.780746:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498f4a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af179 expref: 173 pid: 30972 timeout: 1125 lvb_type: 0 00000100:00100000:1.0:1763334960.780762:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d70700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701792256:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334960.780839:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e70240 going to sleep for 11 seconds 00010000:00010000:1.0:1763334960.783226:0:30972:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.60@tcp) returned -22 from blocking AST (req@000000004577cbbd x1848989701792256) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498f4a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af179 expref: 173 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.783265:0:30972:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498f4a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af179 expref: 173 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.783298:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8498f4a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af179 expref: 173 pid: 30972 timeout: 1125 lvb_type: 0 00000100:00100000:1.0:1763334960.783319:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d70700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701792256:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334960.783366:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:1.0:1763334960.783374:0:30972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.783387:0:30972:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.783396:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.783424:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.783435:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.783441:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334960.783471:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17e:0x0]: returning size 5 00010000:00010000:1.0:1763334960.785562:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8498f74 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af195 expref: 174 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.785899:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af195 expref: 173 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.785910:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:1.0:1763334960.785914:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334960.785918:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478600, rc 0) 00000100:00100000:1.0:1763334960.786037:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52965:x1848989694326784:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5548us (6325us total) trans 8589938586 rc 0/0 00000100:00100000:1.0:1763334960.786049:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4321 00000100:00100000:3.0:1763334960.789977:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.790029:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.790134:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694327296 00000100:00100000:2.0:1763334960.790153:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694327296 00000100:00100000:2.0:1763334960.790245:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694327424 00000100:00100000:2.0:1763334960.790249:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694327424 00000100:00100000:2.0:1763334960.790289:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4322 00000100:00100000:2.0:1763334960.790303:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52966:x1848989694327296:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:2.0:1763334960.790398:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1763334960.790404:0:29627:0:(ldlm_lockd.c:1753:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie cedf0054f8498f4a) 00010000:00010000:2.0:1763334960.790440:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8498f58 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af180 expref: 174 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.790477:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8498f0b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af16b expref: 173 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.790492:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498f12 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af172 expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.790507:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:2.0:1763334960.790515:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334960.790555:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498f89 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.790615:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498f89 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.790629:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498f89 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.790651:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498f90 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.790658:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498f90 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.790665:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498f90 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.790864:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.790876:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af195 expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.790891:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.790939:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af195 expref: 171 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.790957:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af195 expref: 171 pid: 30972 timeout: 1125 lvb_type: 0 00000100:00100000:2.0:1763334960.790977:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701792384:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334960.791091:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334960.791334:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4323 00000100:00100000:0.0:1763334960.791349:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52965:x1848989694327424:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.791370:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.791384:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498f9e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af19c expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.791469:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.791479:0:29629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.791486:0:29629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.791501:0:29629:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.791512:0:29629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334960.794148:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701792384:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334960.794193:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334960.794949:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.795032:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694327552 00000100:00100000:2.0:1763334960.795043:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694327552 00010000:00010000:2.0:1763334960.795095:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af195 expref: 173 pid: 30972 timeout: 1125 lvb_type: 0 00000100:00100000:2.0:1763334960.795149:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2386 00000100:00100000:2.0:1763334960.795161:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+173:2359:x1848989694327552:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334960.795180:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334960.795190:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af195 expref: 173 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:2.0:1763334960.795203:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af195 expref: 173 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:2.0:1763334960.795235:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8498f7b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x17e:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af195 expref: 173 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:2.0:1763334960.795264:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:2.0:1763334960.795271:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.795283:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.795291:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334960.795300:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334960.795308:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334960.795314:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334960.795355:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334960.795442:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d3a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:2359:x1848989694327552:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 281us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334960.795452:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2386 00010000:00010000:0.0:1763334960.795610:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.795619:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00000004:00080000:0.0:1763334960.796308:0:29627:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x17e:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763334960.796531:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.796540:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.796548:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.796555:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.796560:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.796617:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.796635:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:0.0:1763334960.796638:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763334960.796642:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.796652:0:29627:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.796661:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.796698:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.796707:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8498f97 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.796731:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498f89 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.796738:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498f89 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.796744:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498f89 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.796750:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.796753:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498f89 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.796759:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498f89 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.796769:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.796771:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.796775:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498f89 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.796781:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8498f89 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:0.0:1763334960.796792:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000044976ce4 reply state 000000000021da47 transno 8589938587 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498f90 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334960.796803:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334960.796899:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52966:x1848989694327296:12345-192.168.201.60@tcp:36:rm.0 Request processed in 6597us (6942us total) trans 8589938587 rc 0/0 00000100:00100000:0.0:1763334960.796909:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4322 00010000:00010000:2.0:1763334960.797017:0:29629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334960.797025:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:2.0:1763334960.797056:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17e:0x0]: returning size 5 00000004:00200000:2.0:1763334960.797061:0:29629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334960.797077:0:29629:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334960.797112:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8498f9e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af19c expref: 173 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.797130:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af19c expref: 172 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.797138:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:2.0:1763334960.797140:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334960.797143:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:2.0:1763334960.797184:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52965:x1848989694327424:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5841us (7155us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334960.797191:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4323 00000100:00100000:0.0:1763334960.805005:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.805117:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694327808 00000100:00100000:2.0:1763334960.805132:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694327808 00000100:00100000:2.0:1763334960.805208:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4324 00000100:00100000:2.0:1763334960.805219:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52965:x1848989694327808:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334960.805245:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334960.805275:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498fac lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1a3 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.805417:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498fb3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334960.805437:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334960.805452:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498fb3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:2.0:1763334960.805470:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17e:0x0]: returning size 5 00010000:00010000:2.0:1763334960.805685:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8498fac lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1a3 expref: 175 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.805706:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1a3 expref: 174 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.805719:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:2.0:1763334960.805722:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334960.805727:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:2.0:1763334960.805809:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52965:x1848989694327808:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 591us (821us total) trans 8589938588 rc 0/0 00000100:00100000:2.0:1763334960.805817:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4324 00010000:00010000:1.0:1763334960.807439:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498f90 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.807464:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498f90 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.807473:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498f90 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.807481:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.807487:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498f90 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.807498:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498f90 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.807520:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:1.0:1763334960.807523:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334960.807528:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498f90 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334960.807535:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8498f90 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334960.812771:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.813081:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694327936 00000100:00100000:2.0:1763334960.813101:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694327936 00000100:00100000:2.0:1763334960.813199:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4495 00000100:00100000:2.0:1763334960.813214:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694327936:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334960.813292:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.813332:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.813343:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334960.813345:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334960.813350:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.813407:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.813426:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 20 pid: 26564 timeout: 1125 lvb_type: 0 00000100:00100000:2.0:1763334960.813450:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701792512:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334960.813608:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b540 going to sleep for 11 seconds 00000100:00100000:3.0:1763334960.824117:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.824164:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701792512:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334960.824207:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334960.824212:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694328064 00000100:00100000:1.0:1763334960.824222:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694328064 00002000:00100000:1.0:1763334960.824298:0:6522:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x212:0x0] (0->4) req@ffff9a5aeeceb800 x1848989694328064/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:6/0 lens 496/0 e 0 to 0 dl 1763334971 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334960.824309:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeeceb800 with x1848989694328064 ext(0->4) 00010000:00010000:1.0:1763334960.824317:0:6522:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 21 pid: 26564 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.824346:0:6522:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 21 pid: 26564 timeout: 1125 lvb_type: 0 00002000:00010000:1.0:1763334960.824356:0:6522:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a5aeeceb800 00000100:00100000:1.0:1763334960.824398:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 64 00000100:00100000:1.0:1763334960.824410:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694328064:12345-192.168.201.60@tcp:4:bash.0 00000100:00100000:1.0:1763334960.825000:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694328064:12345-192.168.201.60@tcp:4:bash.0 Request processed in 587us (899us total) trans 17179870948 rc 0/0 00000100:00100000:1.0:1763334960.825010:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 64 00002000:00100000:1.0:1763334960.825017:0:6522:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x212:0x0] (0->4) req@ffff9a5aeeceb800 x1848989694328064/t17179870948(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:6/0 lens 496/448 e 0 to 0 dl 1763334971 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334960.825025:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeeceb800 with x1848989694328064 ext(0->4) 00010000:00010000:1.0:1763334960.825031:0:6522:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 23 pid: 26564 timeout: 1125 lvb_type: 0 00010000:00010000:1.0:1763334960.825042:0:6522:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 23 pid: 26564 timeout: 1125 lvb_type: 0 00002000:00010000:1.0:1763334960.825048:0:6522:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a5aeeceb800 00000100:00100000:1.0:1763334960.837630:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.837688:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.837840:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694328192 00000100:00100000:0.0:1763334960.837854:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694328192 00000100:00100000:0.0:1763334960.837931:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4325 00000100:00100000:0.0:1763334960.837944:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52967:x1848989694328192:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.837976:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.838004:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498fc8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1aa expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.838124:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498fcf lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838159:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498fcf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838176:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498fcf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838194:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498fd6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838201:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838208:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838298:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498fcf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838306:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498fcf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838313:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498fcf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838320:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.838339:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498fcf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838348:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498fcf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838361:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.838365:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.838372:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498fcf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838378:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498fcf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838394:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838400:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498fd6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838406:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838411:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.838414:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838420:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838427:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd700) 00010000:00010000:0.0:1763334960.838430:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.838433:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498fd6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838438:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498fd6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.838477:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498fc8 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1aa expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.838489:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.838491:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.838495:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498fc8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1aa expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.838511:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793800, rc 0) 00000100:00100000:0.0:1763334960.838650:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52967:x1848989694328192:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 707us (1035us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334960.838658:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4325 00000100:00100000:3.0:1763334960.845028:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694328320 00000100:00100000:3.0:1763334960.845050:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694328320 00010000:00010000:3.0:1763334960.845118:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 23 pid: 26564 timeout: 1125 lvb_type: 0 00000100:00100000:3.0:1763334960.845171:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2387 00000100:00100000:3.0:1763334960.845182:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694328320:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334960.845204:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1763334960.845230:0:11727:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb size from disk: 0 -> 5 00010000:00010000:3.0:1763334960.845238:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 23 pid: 26564 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334960.845253:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 23 pid: 26564 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334960.845283:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8498f66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af187 expref: 23 pid: 26564 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334960.845310:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.845313:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334960.845319:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.845340:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.845386:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334960.845427:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.845437:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334960.845460:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694328320:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 279us (7771us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334960.845468:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2387 00010000:00010000:0.0:1763334960.845468:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.845475:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.845483:0:26564:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.845490:0:26564:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334960.845495:0:26564:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.845504:0:26564:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.845523:0:26564:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.845529:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066200/0xcedf0054f8498fc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334960.846521:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694327936:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 33303us (33765us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.846534:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4495 00000100:00100000:1.0:1763334960.856904:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.856963:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.857063:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694328448 00000100:00100000:0.0:1763334960.857067:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694328704 00000100:00100000:2.0:1763334960.857078:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694328448 00000100:00100000:0.0:1763334960.857078:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694328704 00000100:00100000:2.0:1763334960.857155:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4326 00000100:00100000:2.0:1763334960.857167:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52965:x1848989694328704:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334960.857243:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334960.857282:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8498fa5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af19c expref: 174 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334960.857307:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:2.0:1763334960.857313:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334960.857367:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498fdd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334960.857389:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498fdd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334960.857400:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498fdd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:0.0:1763334960.857449:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4327 00000100:00100000:0.0:1763334960.857458:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52967:x1848989694328448:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.857468:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.857482:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498fe4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1b1 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.857537:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498feb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857547:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498feb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857555:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498feb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857569:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ff2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857615:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857622:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857680:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498feb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857689:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498feb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857696:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498feb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857703:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.857709:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498feb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857718:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498feb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857727:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.857731:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.857735:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498feb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857740:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8498feb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857748:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857753:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ff2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857759:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857764:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.857766:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857771:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ff2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857778:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd700) 00010000:00010000:0.0:1763334960.857780:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.857783:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ff2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857788:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8498ff2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334960.857820:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498fe4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1b1 expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.857828:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.857830:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.857833:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8498fe4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1b1 expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.857841:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793800, rc 0) 00000100:00100000:0.0:1763334960.857914:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52967:x1848989694328448:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 458us (1029us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334960.857923:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4327 00000040:00080000:2.0:1763334960.857958:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1002, 88 off86752 00000004:00080000:2.0:1763334960.857967:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1025491394021ns, next at 1025532430821ns, rc = 0 00000040:00080000:2.0:1763334960.858044:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].991, 88 off85688 00000004:00080000:2.0:1763334960.858050:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1025491478463ns, next at 1025532371403ns, rc = 0 00000040:00080000:2.0:1763334960.858082:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].992, 88 off85776 00000004:00080000:2.0:1763334960.858087:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1025491514833ns, next at 1025532371403ns, rc = 0 00000040:00080000:2.0:1763334960.858104:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1003, 88 off86840 00000004:00080000:2.0:1763334960.858107:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1025491535333ns, next at 1025532430821ns, rc = 0 00000100:00100000:1.0:1763334960.866485:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.866549:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694328832 00000100:00100000:1.0:1763334960.866568:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694328832 00000100:00100000:1.0:1763334960.866664:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4328 00000100:00100000:1.0:1763334960.866676:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c300bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52967:x1848989694328832:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334960.866707:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334960.866736:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498ff9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1b8 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.866845:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499000 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.866865:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499000 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.866881:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499000 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334960.866975:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:1.0:1763334960.866981:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334960.867011:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499000 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334960.867050:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8498ff9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1b8 expref: 176 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.867072:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499000 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1b8 expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.867083:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334960.867086:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763334960.867092:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334960.867193:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c300bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52967:x1848989694328832:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 519us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.867203:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4328 00000100:00100000:3.0:1763334960.871812:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334960.871920:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694328960 00000100:00100000:2.0:1763334960.871934:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694328960 00000100:00100000:3.0:1763334960.873263:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4329 00000100:00100000:3.0:1763334960.873293:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52967:x1848989694328960:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334960.873338:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334960.873370:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499007 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1bf expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.873480:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849900e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873502:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849900e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873515:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849900e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873538:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499015 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873545:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499015 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873550:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499015 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873678:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849900e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873687:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849900e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873694:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849900e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873701:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334960.873706:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849900e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873714:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849900e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873728:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334960.873731:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334960.873737:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849900e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873744:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849900e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873762:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499015 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873769:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499015 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873775:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499015 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873780:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334960.873783:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499015 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873789:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499015 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873795:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32700) 00010000:00010000:3.0:1763334960.873797:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334960.873800:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499015 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873805:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499015 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.873846:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499007 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1bf expref: 176 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.873857:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334960.873860:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334960.873863:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499007 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1bf expref: 176 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334960.873873:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fc00, rc 0) 00000100:00100000:3.0:1763334960.873973:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52967:x1848989694328960:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 693us (2177us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334960.873984:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4329 00000100:00100000:1.0:1763334960.881386:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.881451:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694329216 00000100:00100000:0.0:1763334960.881467:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694329216 00000100:00100000:0.0:1763334960.881556:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4330 00000100:00100000:0.0:1763334960.881591:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52967:x1848989694329216:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.881626:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.881631:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334960.881672:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499000 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1b8 expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.881696:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.881702:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334960.881723:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849901c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1c6 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.881888:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499023 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.881904:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499023 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.881916:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499023 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.881931:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849902a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.881938:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849902a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.881945:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849902a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.882771:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499031 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.882786:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499031 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.882795:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499031 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334960.882806:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17f:0x0]: returning size 0 00010000:00010000:0.0:1763334960.882835:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499023 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.882843:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499023 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.882851:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499023 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.882857:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.882861:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499023 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.882868:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499023 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.882876:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.882879:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.882883:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499023 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334960.882889:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499023 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334960.882906:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003ad77ba2 reply state 00000000a332413d transno 8589938590 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849902a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334960.882915:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763334960.882949:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849901c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1c6 expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.882963:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499031 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1c6 expref: 176 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.882972:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334960.882974:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334960.882976:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334960.883077:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52967:x1848989694329216:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1511us (1708us total) trans 8589938590 rc 0/0 00000100:00100000:0.0:1763334960.883087:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4330 00010000:00010000:3.0:1763334960.905760:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849902a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.905789:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849902a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.905799:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849902a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.905808:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334960.905816:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849902a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.905828:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849902a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.905861:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd700) 00010000:00010000:3.0:1763334960.905865:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334960.905872:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849902a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334960.905879:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849902a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334960.917633:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.917946:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694329472 00000100:00100000:0.0:1763334960.917962:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694329472 00000100:00100000:0.0:1763334960.918034:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4331 00000100:00100000:0.0:1763334960.918046:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52967:x1848989694329472:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.918073:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.918102:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849903f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1cd expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.918265:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.918283:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499031 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1c6 expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.918293:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.918348:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499031 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1c6 expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.918364:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499031 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1c6 expref: 177 pid: 30972 timeout: 1125 lvb_type: 0 00000100:00100000:0.0:1763334960.918381:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701792640:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334960.918492:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5ada480 going to sleep for 11 seconds 00000100:00100000:2.0:1763334960.922974:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.923079:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e87b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701792640:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334960.923118:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334960.923185:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694329600 00000100:00100000:3.0:1763334960.923197:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694329600 00010000:00010000:3.0:1763334960.923253:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499031 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1c6 expref: 178 pid: 30972 timeout: 1125 lvb_type: 0 00000100:00100000:3.0:1763334960.923311:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2388 00000100:00100000:3.0:1763334960.923335:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2359:x1848989694329600:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334960.923358:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334960.923366:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499031 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1c6 expref: 178 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334960.923382:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499031 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1c6 expref: 178 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334960.923415:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499031 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1c6 expref: 178 pid: 30972 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334960.923436:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:3.0:1763334960.923442:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.923453:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.923462:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334960.923501:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334960.923617:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:2359:x1848989694329600:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 294us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334960.923626:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2388 00010000:00010000:0.0:1763334960.923796:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.923804:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334960.923830:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17f:0x0]: returning size 0 00000004:00080000:0.0:1763334960.924284:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x210:0x0], index 0: 0 00000004:00080000:0.0:1763334960.924299:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x214:0x0], index 1: 0 00000004:00080000:0.0:1763334960.924306:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x215:0x0], index 1: 0 00000004:00080000:0.0:1763334960.924312:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x211:0x0], index 0: 0 00010000:00010000:0.0:1763334960.924532:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.924547:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.924555:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.924562:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.924567:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.924621:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.924636:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334960.924639:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334960.924644:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.924650:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499046 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334960.924720:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849903f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1cd expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.924731:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.924733:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334960.924737:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849903f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1cd expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.924747:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793800, rc 0) 00000100:00100000:0.0:1763334960.924816:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52967:x1848989694329472:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6773us (7202us total) trans 8589938591 rc 301/301 00000100:00100000:0.0:1763334960.924825:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4331 00000100:00100000:2.0:1763334960.927806:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334960.928133:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694329856 00000100:00100000:3.0:1763334960.928150:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694329856 00000100:00100000:3.0:1763334960.928234:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1602 00000100:00100000:3.0:1763334960.928248:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52967:x1848989694329856:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334960.928784:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52967:x1848989694329856:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 537us (992us total) trans 8589938592 rc 0/0 00000100:00100000:3.0:1763334960.928794:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1602 00000001:00080000:3.0:1763334960.937150:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938587 is committed 00000004:00010000:0.0:1763334960.937312:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000075d33421 reply state 000000009f7ac507 transno 8589938589 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498fdd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:0.0:1763334960.937339:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334960.937518:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52965:x1848989694328704:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 80346us (80547us total) trans 8589938589 rc 0/0 00000100:00100000:0.0:1763334960.937529:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4326 00000001:00080000:1.0:1763334960.938880:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938589 is committed 00000004:00080000:1.0:1763334960.938891:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 662 committed 00000004:00080000:1.0:1763334960.938903:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 650 committed 00000004:00080000:1.0:1763334960.938911:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 649 committed 00000004:00080000:1.0:1763334960.938913:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 661 committed 00010000:00010000:1.0:1763334960.938945:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498fdd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334960.938958:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498fdd lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334960.938967:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498fdd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334960.938973:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.938979:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498fdd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334960.938988:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498fdd lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334960.939009:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:1.0:1763334960.939013:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334960.939018:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498fdd lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334960.939025:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8498fdd lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:1.0:1763334960.939263:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701792768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334960.939341:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334960.939385:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763334960.939391:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701793152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334960.939410:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334960.939441:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701792896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334960.939462:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334960.939483:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763334960.939488:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701793024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334960.939510:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334960.939541:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701792768 00000100:00100000:1.0:1763334960.939550:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701792768 00000100:00100000:1.0:1763334960.939640:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701793152 00000100:00100000:1.0:1763334960.939644:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701793152 00000100:00100000:1.0:1763334960.939663:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701792896 00000100:00100000:1.0:1763334960.939666:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701792896 00000100:00100000:1.0:1763334960.939680:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701793024 00000100:00100000:1.0:1763334960.939683:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701793024 00000100:00100000:1.0:1763334960.939702:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4496 00000100:00100000:1.0:1763334960.939712:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701792768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334960.940009:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3290:x1848989701792768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 297us (667us total) trans 17179870949 rc 0/0 00000100:00100000:1.0:1763334960.940017:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4496 00000100:00100000:1.0:1763334960.940035:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4497 00000100:00100000:1.0:1763334960.940041:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3290:x1848989701793152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334960.940165:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3290:x1848989701793152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (753us total) trans 21474838230 rc 0/0 00000100:00100000:1.0:1763334960.940173:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4497 00000100:00100000:1.0:1763334960.940185:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4498 00000100:00100000:1.0:1763334960.940192:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701792896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334960.940282:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701792896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (818us total) trans 17179870950 rc 0/0 00000100:00100000:1.0:1763334960.940288:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4498 00000100:00100000:1.0:1763334960.940301:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4499 00000100:00100000:1.0:1763334960.940308:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3291:x1848989701793024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334960.940409:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334960.940413:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb mtime from disk: 1763334961 -> 1763334961 00002000:00010000:1.0:1763334960.940415:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334960.940417:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb ctime from disk: 1763334961 -> 1763334961 00002000:00010000:1.0:1763334960.940420:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334960.940445:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+23:3291:x1848989701793024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 138us (934us total) trans 21474838231 rc 0/0 00000100:00100000:1.0:1763334960.940450:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4499 00000004:00080000:1.0:1763334960.940503:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aef0a3100/2, rc 0, transno 21474838231 00000100:00100000:1.0:1763334960.940510:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701793024:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334960.940520:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aef0a1880/2, rc 0, transno 17179870950 00000100:00100000:1.0:1763334960.940525:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701792896:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334960.940543:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aef0a0e00/2, rc 0, transno 21474838230 00000100:00100000:1.0:1763334960.940547:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701793152:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334960.940554:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aef0a0380/2, rc 0, transno 17179870949 00000100:00100000:1.0:1763334960.940557:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701792768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334960.940645:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.940811:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694330112 00000100:00100000:1.0:1763334960.940817:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694330112 00000100:00100000:1.0:1763334960.940851:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1603 00000100:00100000:1.0:1763334960.940858:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52967:x1848989694330112:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334960.941067:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52967:x1848989694330112:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 209us (423us total) trans 8589938593 rc 0/0 00000100:00100000:1.0:1763334960.941074:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1603 00000100:00100000:1.0:1763334960.946038:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.948063:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694330240 00000100:00100000:0.0:1763334960.948091:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694330240 00000100:00100000:0.0:1763334960.948199:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4332 00000100:00100000:0.0:1763334960.948211:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52965:x1848989694330240:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.948251:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.948283:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499054 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1d4 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.948387:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499054 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1d4 expref: 171 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.948408:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499054 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1d4 expref: 171 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.948433:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:0.0:1763334960.948437:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334960.948441:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334960.948543:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52965:x1848989694330240:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 334us (2521us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.948557:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4332 00000100:00100000:3.0:1763334960.954191:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.954266:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694330368 00000100:00100000:1.0:1763334960.954282:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694330368 00000100:00100000:1.0:1763334960.954369:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4333 00000100:00100000:1.0:1763334960.954380:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52965:x1848989694330368:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334960.954410:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334960.954439:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849905b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1db expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.954530:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499062 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.954548:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499062 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.954561:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499062 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334960.954687:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17e:0x0]: returning size 5 00000004:00200000:1.0:1763334960.954694:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334960.954715:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499062 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.954746:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849905b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1db expref: 173 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.954769:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499062 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1db expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.954781:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:1.0:1763334960.954785:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763334960.954791:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334960.954880:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52965:x1848989694330368:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 501us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334960.954888:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4333 00000100:00100000:3.0:1763334960.957095:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.961444:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694330624 00000100:00100000:0.0:1763334960.961471:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694330624 00000100:00100000:0.0:1763334960.961613:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4334 00000100:00100000:0.0:1763334960.961627:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52274:x1848989694330624:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334960.961658:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.961687:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499069 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1e2 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.961918:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499070 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.961935:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499070 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.961949:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499070 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.961967:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499077 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.961974:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499077 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.961981:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499077 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962067:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849907e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962076:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849907e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962085:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849907e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:0.0:1763334960.962097:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17f:0x0]: returning size 0 00010000:00010000:0.0:1763334960.962229:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499070 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962237:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499070 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962245:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499070 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962251:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.962255:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499070 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962262:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499070 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962275:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334960.962279:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.962285:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499070 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962292:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f8499070 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962308:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499077 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962313:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499077 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962454:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499077 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962460:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334960.962463:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499077 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962469:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499077 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962476:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334960.962479:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334960.962482:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499077 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962488:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499077 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334960.962545:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499069 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1e2 expref: 175 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.962560:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849907e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1e2 expref: 174 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.962568:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ac51bd000) 00010000:00010000:0.0:1763334960.962606:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334960.962609:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334960.962725:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52274:x1848989694330624:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1100us (5644us total) trans 8589938594 rc 0/0 00000100:00100000:0.0:1763334960.962735:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4334 00000100:00100000:3.0:1763334960.965916:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.965989:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694330752 00000100:00100000:0.0:1763334960.966001:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694330752 00000100:00100000:0.0:1763334960.966073:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4500 00000100:00100000:0.0:1763334960.966084:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694330752:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334960.966109:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.966141:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849908c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1e9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334960.966174:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x212:0x0] initial LVB size: 5, mtime: 0x691a5b31, atime: 0x0, ctime: 0x691a5b31, blocks: 0x1 00010000:00010000:0.0:1763334960.966199:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.966201:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334960.966215:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849908c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1e9 expref: 22 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334960.966235:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849908c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1e9 expref: 22 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334960.966250:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334960.966334:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694330752:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 242us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.966342:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4500 00000100:00100000:3.0:1763334960.972462:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.973517:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694331008 00000100:00100000:1.0:1763334960.973537:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694331008 00000100:00100000:1.0:1763334960.973640:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4335 00000100:00100000:1.0:1763334960.973653:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52274:x1848989694331008:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1763334960.973731:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334960.973764:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849907e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1e2 expref: 174 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.973786:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ac51bd000) 00010000:00010000:1.0:1763334960.973797:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334960.974126:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499093 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.974143:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499093 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.974160:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499093 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:1.0:1763334960.974221:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938595 00000004:00010000:1.0:1763334960.974243:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000efeac721 reply state 00000000b9732f45 transno 8589938596 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499093 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334960.974252:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334960.974398:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52274:x1848989694331008:12345-192.168.201.60@tcp:36:bash.0 Request processed in 746us (1950us total) trans 8589938596 rc 0/0 00000100:00100000:1.0:1763334960.974407:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4335 00000020:00080000:1.0:1763334960.974414:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763334960.977017:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499093 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.977039:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499093 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.977046:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499093 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.977052:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334960.977058:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499093 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.977067:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499093 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.977088:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ad2829300) 00010000:00010000:1.0:1763334960.977093:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334960.977097:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499093 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.978320:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499093 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334960.979763:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334960.979962:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694331136 00000100:00100000:0.0:1763334960.979978:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694331136 00000100:00100000:0.0:1763334960.980055:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4336 00000100:00100000:0.0:1763334960.980068:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52274:x1848989694331136:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334960.980101:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334960.980135:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849909a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1f0 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.980228:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849909a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1f0 expref: 176 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.980248:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849909a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1f0 expref: 176 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334960.980274:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334960.980278:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334960.980283:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793800, rc 0) 00000100:00100000:0.0:1763334960.980379:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52274:x1848989694331136:12345-192.168.201.60@tcp:101:bash.0 Request processed in 315us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334960.980387:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4336 00000100:00100000:3.0:1763334960.982515:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334960.987555:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694331392 00000100:00100000:1.0:1763334960.987596:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694331392 00000100:00100000:1.0:1763334960.987695:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4337 00000100:00100000:1.0:1763334960.987709:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52274:x1848989694331392:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334960.987739:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334960.987743:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334960.987781:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849909a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1f0 expref: 176 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.987806:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:1.0:1763334960.987820:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334960.987841:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84990a1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1f7 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334960.987916:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84990a8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.987935:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84990a8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334960.987946:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84990a8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:1.0:1763334960.988504:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].993, 88 off85864 00000004:00080000:1.0:1763334960.988517:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1025621943927ns, next at 1025532371403ns, rc = 0 00000040:00080000:1.0:1763334960.988655:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1004, 88 off86928 00000004:00080000:1.0:1763334960.988662:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1025622089785ns, next at 1025532430821ns, rc = 0 00000040:00080000:1.0:1763334960.988746:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1005, 88 off87016 00000004:00080000:1.0:1763334960.988751:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1025622178775ns, next at 1025532430821ns, rc = 0 00000040:00080000:1.0:1763334960.988779:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].994, 88 off85952 00000004:00080000:1.0:1763334960.988787:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1025622215445ns, next at 1025532371403ns, rc = 0 00010000:00010000:0.0:1763334961.000626:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334961.008026:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.008897:0:21633:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694331520 00000100:00100000:0.0:1763334961.008916:0:21633:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694331520 00000100:00100000:0.0:1763334961.009019:0:21633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1678 00000100:00100000:0.0:1763334961.009032:0:21633:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694331520:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334961.009085:0:21633:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84990af lrc: 3/1,0 mode: --/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.009104:0:21633:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.009107:0:21633:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.009114:0:21633:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84990af lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.009130:0:21633:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84990af lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.009297:0:21633:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84990af lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.009307:0:21633:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84990af lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.009316:0:21633:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84990af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.009334:0:21633:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334961.009340:0:21633:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84990af lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.009350:0:21633:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84990af lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.009370:0:21633:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84990af lrc: 2/0,0 mode: --/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.009379:0:21633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f84990af lrc: 0/0,0 mode: --/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334961.009469:0:21633:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694331520:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 439us (1458us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334961.009479:0:21633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1678 00000100:00100000:3.0:1763334961.018303:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.019042:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694331648 00000100:00100000:0.0:1763334961.019058:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694331648 00000100:00100000:0.0:1763334961.019141:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4338 00000100:00100000:0.0:1763334961.019155:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52965:x1848989694331648:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.019185:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.019217:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84990b6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af1fe expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.019267:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f84990bd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.019287:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f84990bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.019303:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f84990bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.019451:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84990b6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1fe expref: 180 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.019474:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792c00/0xcedf0054f84990bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1fe expref: 179 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.019485:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:0.0:1763334961.019489:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763334961.019493:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792c00, rc 0) 00000100:00100000:0.0:1763334961.019617:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52965:x1848989694331648:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 464us (1328us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334961.019627:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4338 00000100:00100000:1.0:1763334961.038069:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.039473:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694331776 00000100:00100000:3.0:1763334961.039493:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694331776 00000100:00100000:3.0:1763334961.039598:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1679 00000100:00100000:3.0:1763334961.039610:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2362:x1848989694331776:12345-192.168.201.60@tcp:4:lfs.0 00002000:00010000:3.0:1763334961.039675:0:6522:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x20f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334961.039687:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84990c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.039707:0:6522:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334961.039710:0:6522:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334961.039717:0:6522:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84990c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.039733:0:6522:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84990c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1763334961.051517:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938594 is committed 00000001:00080000:3.0:1763334961.051550:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938597 is committed 00000004:00080000:3.0:1763334961.051555:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 652 committed 00000004:00080000:3.0:1763334961.051586:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 664 committed 00000004:00080000:3.0:1763334961.051596:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 663 committed 00000004:00080000:3.0:1763334961.051598:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 651 committed 00000100:00100000:3.0:1763334961.051819:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701793280:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334961.051912:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334961.052003:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701793408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334961.052030:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334961.052071:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701793280 00000100:00100000:3.0:1763334961.052079:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701793280 00000100:00100000:3.0:1763334961.052129:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701793408 00000100:00100000:3.0:1763334961.052132:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701793408 00000100:00100000:3.0:1763334961.052154:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4501 00000100:00100000:3.0:1763334961.052164:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3290:x1848989701793280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334961.052466:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3290:x1848989701793280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 302us (552us total) trans 17179870951 rc 0/0 00000100:00100000:3.0:1763334961.052476:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4501 00000100:00100000:3.0:1763334961.052496:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4502 00000100:00100000:3.0:1763334961.052503:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3291:x1848989701793408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334961.052639:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3291:x1848989701793408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (607us total) trans 17179870952 rc 0/0 00000100:00100000:3.0:1763334961.052646:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4502 00000004:00080000:3.0:1763334961.052705:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab32300/2, rc 0, transno 17179870951 00000100:00100000:3.0:1763334961.052712:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701793280:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334961.052730:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab31500/2, rc 0, transno 17179870952 00000100:00100000:3.0:1763334961.052733:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701793408:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763334961.052784:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84990a8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1f7 expref: 171 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.052801:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ad2829300) 00010000:00010000:3.0:1763334961.052804:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334961.052825:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84990a1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1f7 expref: 171 pid: 32232 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763334961.052845:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84990a8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17f:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1f7 expref: 170 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.052880:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ad2829300) 00010000:00010000:3.0:1763334961.052883:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334961.052886:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:3.0:1763334961.052943:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52274:x1848989694331392:12345-192.168.201.60@tcp:101:bash.0 Request processed in 65237us (70443us total) trans 8589938597 rc 0/0 00000100:00100000:3.0:1763334961.052951:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4337 00000100:00100000:0.0:1763334961.055367:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701793536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334961.055460:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334961.059546:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701793536 00000100:00100000:2.0:1763334961.059567:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701793536 00000100:00100000:2.0:1763334961.059649:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4503 00000100:00100000:2.0:1763334961.059662:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3292:x1848989701793536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334961.060073:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3292:x1848989701793536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 413us (4611us total) trans 21474838233 rc 0/0 00000100:00100000:2.0:1763334961.060082:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4503 00000004:00080000:2.0:1763334961.060149:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c39e7800/2, rc 0, transno 21474838233 00000100:00100000:2.0:1763334961.060157:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701793536:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334961.060506:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac721a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701793664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334961.060558:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334961.060900:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.060929:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701793664 00000100:00100000:3.0:1763334961.060934:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701793664 00000100:00100000:3.0:1763334961.060967:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694331904 00000100:00100000:3.0:1763334961.060970:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694331904 00000100:00100000:3.0:1763334961.060995:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4504 00000100:00100000:3.0:1763334961.061002:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3289:x1848989701793664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334961.061188:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3289:x1848989701793664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 185us (629us total) trans 21474838234 rc 0/0 00000100:00100000:3.0:1763334961.061196:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4504 00000100:00100000:3.0:1763334961.061214:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4505 00000100:00100000:3.0:1763334961.061222:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+17:52274:x1848989694331904:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334961.061234:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334961.061259:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84990cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af205 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334961.061283:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x210:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334961.061305:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334961.061308:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334961.061333:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84990cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af205 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.061356:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84990cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af205 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.064366:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f800, rc 0) 00000004:00080000:1.0:1763334961.064686:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac721a680/2, rc 0, transno 21474838234 00000100:00100000:1.0:1763334961.064705:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac721a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701793664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334961.065452:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+18:52274:x1848989694331904:12345-192.168.201.60@tcp:101:bash.0 Request processed in 4226us (4549us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334961.065464:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4505 00000100:00100000:1.0:1763334961.072644:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.072730:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694332032 00000100:00100000:3.0:1763334961.072744:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694332032 00000100:00100000:1.0:1763334961.073246:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4506 00000100:00100000:1.0:1763334961.073259:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef84a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:52274:x1848989694332032:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334961.073282:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.073311:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f84990d2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af20c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334961.073355:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x214:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334961.073393:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334961.073396:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334961.073408:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f84990d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af20c expref: 23 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.073427:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f84990d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af20c expref: 23 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.073442:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478000, rc 0) 00000100:00100000:1.0:1763334961.073521:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef84a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:52274:x1848989694332032:12345-192.168.201.60@tcp:101:bash.0 Request processed in 265us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334961.073533:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4506 00000100:00100000:1.0:1763334961.080453:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.080519:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.080612:0:21633:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694332160 00000100:00100000:3.0:1763334961.080628:0:21633:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694332160 00002000:00010000:3.0:1763334961.080688:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/528 (0->18446744073709551615) 00002000:00100000:3.0:1763334961.080695:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeefe6300 with x1848989694332160 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334961.080713:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeefe6300. 00000100:00100000:3.0:1763334961.080748:0:21633:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694332288 00000100:00100000:3.0:1763334961.080752:0:21633:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694332288 00002000:00010000:3.0:1763334961.080766:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/532 (0->18446744073709551615) 00002000:00100000:3.0:1763334961.080770:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeefe5c00 with x1848989694332288 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334961.080777:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeefe5c00. 00000100:00100000:3.0:1763334961.080801:0:21633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1680 00000100:00100000:3.0:1763334961.080812:0:21633:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694332160:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334961.081242:0:21633:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x210:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334961.081247:0:21633:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x210:0x0] updating lvb mtime from disk: 0 -> 1763334961 00002000:00010000:3.0:1763334961.081249:0:21633:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x210:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334961.081252:0:21633:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x210:0x0] updating lvb ctime from disk: 0 -> 1763334961 00002000:00010000:3.0:1763334961.081254:0:21633:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x210:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334961.081348:0:21633:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694332160:12345-192.168.201.60@tcp:10:bash.0 Request processed in 535us (914us total) trans 21474838235 rc 0/0 00000100:00100000:3.0:1763334961.081358:0:21633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1680 00002000:00010000:3.0:1763334961.081363:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/528 (0->18446744073709551615) 00002000:00100000:3.0:1763334961.081365:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeefe6300 with x1848989694332160 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334961.081370:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeefe6300. 00000100:00100000:3.0:1763334961.081399:0:21633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1681 00000100:00100000:3.0:1763334961.081407:0:21633:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694332288:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334961.081651:0:21633:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x214:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334961.081655:0:21633:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x214:0x0] updating lvb mtime from disk: 0 -> 1763334961 00002000:00010000:3.0:1763334961.081658:0:21633:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x214:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334961.081659:0:21633:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x214:0x0] updating lvb ctime from disk: 0 -> 1763334961 00002000:00010000:3.0:1763334961.081661:0:21633:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x214:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334961.081686:0:21633:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694332288:12345-192.168.201.60@tcp:10:bash.0 Request processed in 280us (1166us total) trans 17179870953 rc 0/0 00000100:00100000:3.0:1763334961.081692:0:21633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1681 00002000:00010000:3.0:1763334961.081695:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/532 (0->18446744073709551615) 00002000:00100000:3.0:1763334961.081698:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeefe5c00 with x1848989694332288 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334961.081703:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeefe5c00. 00000100:00100000:0.0:1763334961.085685:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.085790:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694332544 00000100:00100000:1.0:1763334961.085804:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694332544 00000100:00100000:1.0:1763334961.085877:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1604 00000100:00100000:1.0:1763334961.085889:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+170:52274:x1848989694332544:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:1.0:1763334961.086454:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52274:x1848989694332544:12345-192.168.201.60@tcp:35:bash.0 Request processed in 562us (775us total) trans 8589938598 rc 0/0 00000100:00100000:1.0:1763334961.086465:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1604 00000100:00100000:3.0:1763334961.101736:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.101833:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694332672 00000100:00100000:1.0:1763334961.101851:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694332672 00000100:00100000:1.0:1763334961.101939:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4339 00000100:00100000:1.0:1763334961.101951:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52968:x1848989694332672:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:1.0:1763334961.101986:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.102014:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84990d9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af213 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.102105:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84990e0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102124:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84990e0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102150:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84990e0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102166:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84990e7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102174:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84990e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102181:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84990e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102353:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f84990ee lrc: 3/1,0 mode: --/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102363:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f84990ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102369:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f84990ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334961.102413:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x17f:0x0]: returning size 5 00000004:00200000:1.0:1763334961.102419:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334961.102441:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f84990ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102454:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f84990ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102464:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84990e0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102471:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84990e0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102478:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84990e0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102485:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.102490:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84990e0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102499:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84990e0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102513:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334961.102516:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.102522:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84990e0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102529:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84990e0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102544:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84990e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102551:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84990e7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102556:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84990e7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102561:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.102564:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84990e7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102626:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84990e7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102635:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829b00) 00010000:00010000:1.0:1763334961.102638:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.102641:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84990e7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102647:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84990e7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.102686:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84990d9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af213 expref: 173 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.102702:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f84990ee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af213 expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.102710:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ad2829300) 00010000:00010000:1.0:1763334961.102713:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334961.102716:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334961.102801:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52968:x1848989694332672:12345-192.168.201.60@tcp:101:rm.0 Request processed in 851us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334961.102810:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4339 00000100:00100000:2.0:1763334961.109796:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000001:00080000:3.0:1763334961.117633:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838229 is committed 00000001:00080000:3.0:1763334961.117654:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838225 is committed 00000001:00080000:3.0:1763334961.117673:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838231 is committed 00000001:00080000:3.0:1763334961.117735:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838232 is committed 00002000:00010000:3.0:1763334961.117803:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1763334961.117807:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb mtime from disk: 0 -> 1763334961 00002000:00010000:3.0:1763334961.117810:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb ctime from disk: 0 -> 1763334961 00002000:00010000:3.0:1763334961.117812:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1763334961.117828:0:6522:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84990c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.117840:0:6522:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84990c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.117849:0:6522:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84990c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.117856:0:6522:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fc00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334961.117862:0:6522:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84990c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.117871:0:6522:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84990c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.117895:0:6522:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84990c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.117902:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84990c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334961.118014:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2362:x1848989694331776:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 78399us (79955us total) trans 21474838232 rc 0/0 00000100:00100000:3.0:1763334961.118024:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1679 00000100:00100000:0.0:1763334961.118499:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694332928 00000100:00100000:0.0:1763334961.118512:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694332928 00000100:00100000:0.0:1763334961.118586:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4340 00000100:00100000:0.0:1763334961.118596:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52968:x1848989694332928:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:0.0:1763334961.118664:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1763334961.118689:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f84990ee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af213 expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.118708:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84990a8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17f:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1f7 expref: 171 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.118718:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ad2829300) 00010000:00010000:0.0:1763334961.118729:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334961.118757:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84990f5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.118771:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84990f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.118781:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84990f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.118795:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84990fc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.118801:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84990fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.118807:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84990fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.118950:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499103 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.118959:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499103 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.118966:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499103 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:0.0:1763334961.119535:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].995, 64 off86016 00000004:00080000:0.0:1763334961.119550:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1025752977304ns, next at 1026752974522ns, rc = 0 00000040:00080000:0.0:1763334961.119631:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1006, 64 off87080 00000004:00080000:0.0:1763334961.119640:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1025753068052ns, next at 1026753065722ns, rc = 0 00000040:00080000:0.0:1763334961.119658:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1007, 64 off87144 00000040:00080000:0.0:1763334961.119672:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].996, 64 off86080 00010000:00010000:0.0:1763334961.119748:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849910a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119759:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849910a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119768:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849910a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119776:0:30972:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849910a lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119783:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849910a lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119789:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849910a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119813:0:30972:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763334961.119837:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499103 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119844:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499103 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119849:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499103 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119855:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.119860:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499103 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119867:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499103 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119877:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334961.119880:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763334961.119884:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499103 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119889:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499103 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119956:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84990f5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119963:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84990f5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119968:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84990f5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119973:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.119976:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84990f5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119985:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84990f5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.119993:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.119995:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.119998:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84990f5 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.120003:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84990f5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334961.120012:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000009a27c9 reply state 00000000cfaf04d5 transno 8589938599 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84990fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334961.120021:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334961.120130:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52968:x1848989694332928:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1532us (10346us total) trans 8589938599 rc 0/0 00000100:00100000:0.0:1763334961.120139:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4340 00010000:00010000:2.0:1763334961.120599:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334961.120609:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849910a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334961.120617:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334961.120621:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849910a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334961.120627:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849910a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334961.120637:0:5736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17f:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:2.0:1763334961.120640:0:5736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763334961.120643:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849910a lrc: 1/0,0 mode: --/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334961.120648:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849910a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x17f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334961.120666:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334961.120668:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334961.120669:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334961.123192:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84990fc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334961.123217:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84990fc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334961.123225:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84990fc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334961.123232:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334961.123238:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84990fc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334961.123248:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84990fc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334961.123355:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd000) 00010000:00010000:3.0:1763334961.123360:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334961.123366:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84990fc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334961.123373:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84990fc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334961.167646:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.167852:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.168076:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694333056 00000100:00100000:0.0:1763334961.168092:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694333056 00000100:00100000:0.0:1763334961.168167:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694333312 00000100:00100000:0.0:1763334961.168171:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694333312 00000100:00100000:0.0:1763334961.168207:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4341 00000100:00100000:0.0:1763334961.168218:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52969:x1848989694333056:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.168253:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.168285:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499111 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af21a expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.168387:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499118 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168409:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499118 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168421:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499118 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168437:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849911f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168444:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849911f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168450:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849911f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168535:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499118 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168544:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499118 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168551:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499118 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168558:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.168563:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499118 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168604:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499118 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168619:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.168623:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.168629:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499118 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168635:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499118 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168651:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849911f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168657:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849911f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168663:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849911f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168667:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.168670:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849911f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168675:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849911f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168682:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd000) 00010000:00010000:0.0:1763334961.168685:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.168688:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849911f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168694:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849911f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.168733:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499111 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af21a expref: 173 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.168744:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.168747:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.168750:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499111 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af21a expref: 173 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.168760:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:0.0:1763334961.168843:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52969:x1848989694333056:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 626us (4640us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334961.168853:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4341 00000100:00100000:0.0:1763334961.168878:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4342 00000100:00100000:0.0:1763334961.168886:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52965:x1848989694333312:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334961.168921:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334961.168935:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499062 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x17e:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1db expref: 171 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.168946:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:0.0:1763334961.168949:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334961.169010:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499126 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.169020:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499126 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.169025:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499126 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334961.169227:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ff1d9a2f reply state 00000000261aed5b transno 8589938600 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499126 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334961.169238:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334961.169297:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52965:x1848989694333312:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 412us (1445us total) trans 8589938600 rc 0/0 00000100:00100000:0.0:1763334961.169305:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4342 00010000:00010000:1.0:1763334961.170603:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499126 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334961.170620:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499126 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334961.170628:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499126 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334961.170634:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.170639:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499126 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334961.170647:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499126 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334961.170664:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:1.0:1763334961.170667:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.170673:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499126 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334961.170680:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499126 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334961.171428:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.171948:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.172282:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694333440 00000100:00100000:0.0:1763334961.172297:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694333440 00000100:00100000:0.0:1763334961.172381:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4343 00000100:00100000:0.0:1763334961.172393:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52969:x1848989694333440:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.172422:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.172449:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849912d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af221 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.172535:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499134 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172551:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499134 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172564:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499134 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172607:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849913b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172614:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849913b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172620:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849913b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172709:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499134 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172715:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499134 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172723:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499134 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172729:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.172733:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499134 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172741:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499134 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172753:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.172755:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.172760:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499134 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172766:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499134 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172782:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849913b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172787:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849913b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172793:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849913b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172798:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.172801:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849913b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172807:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849913b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172814:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334961.172817:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.172820:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849913b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172825:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849913b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.172861:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849912d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af221 expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.172871:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.172874:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.172877:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849912d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af221 expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.172888:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334961.172968:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52969:x1848989694333440:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 577us (1547us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334961.172976:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4343 00000100:00100000:3.0:1763334961.177331:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.177535:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694333568 00000100:00100000:2.0:1763334961.177552:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694333568 00000100:00100000:2.0:1763334961.177649:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4507 00000100:00100000:2.0:1763334961.177662:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+12:52965:x1848989694333568:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334961.177689:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.177719:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499142 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af228 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334961.177757:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x20f:0x0] initial LVB size: 4096, mtime: 0x691a5b31, atime: 0x0, ctime: 0x691a5b31, blocks: 0xb 00010000:00010000:2.0:1763334961.177785:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.177788:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.177797:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499142 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af228 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.177815:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499142 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af228 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.177829:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:2.0:1763334961.177897:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+13:52965:x1848989694333568:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 238us (5951us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.177905:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4507 00000100:00100000:0.0:1763334961.178070:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694333696 00000100:00100000:0.0:1763334961.178075:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694333696 00000100:00100000:2.0:1763334961.179780:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4344 00000100:00100000:2.0:1763334961.179803:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52969:x1848989694333696:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334961.179831:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.179858:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af22f expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.179953:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499150 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.179970:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499150 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.179984:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499150 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334961.180074:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:2.0:1763334961.180079:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334961.180105:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499150 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.180138:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af22f expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.180157:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499150 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af22f expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.180167:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334961.180171:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334961.180175:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066c00, rc 0) 00000100:00100000:2.0:1763334961.180257:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52969:x1848989694333696:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 463us (2953us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.180265:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4344 00000100:00100000:3.0:1763334961.181176:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.183081:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694333824 00000100:00100000:1.0:1763334961.183098:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694333824 00000100:00100000:1.0:1763334961.183173:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4508 00000100:00100000:1.0:1763334961.183184:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:52965:x1848989694333824:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.183208:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.183240:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499157 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af236 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334961.183270:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x213:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334961.183298:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334961.183301:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334961.183311:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af236 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.183340:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af236 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.183355:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334961.184930:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:52965:x1848989694333824:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1732us (3747us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334961.184946:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4508 00000100:00100000:2.0:1763334961.187740:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.188124:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694333952 00000100:00100000:0.0:1763334961.188153:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694333952 00000100:00100000:0.0:1763334961.188234:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4345 00000100:00100000:0.0:1763334961.188246:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52969:x1848989694333952:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.188276:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.188310:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849915e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af23d expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.188429:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499165 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188446:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499165 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188459:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499165 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188473:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849916c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188479:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849916c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188485:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849916c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188610:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499165 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188618:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499165 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188625:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499165 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188632:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.188636:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499165 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188645:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499165 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188664:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.188668:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.188675:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499165 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188682:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499165 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188695:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849916c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188700:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849916c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188706:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849916c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188710:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.188712:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849916c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188717:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849916c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188723:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334961.188725:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.188727:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849916c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188731:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849916c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.188765:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849915e lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af23d expref: 173 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.188776:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.188779:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.188782:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849915e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af23d expref: 173 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.188791:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334961.188867:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52969:x1848989694333952:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 623us (1144us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334961.188876:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4345 00000100:00100000:0.0:1763334961.192032:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.192075:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.192098:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.192191:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694334464 00000100:00100000:2.0:1763334961.192206:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694334464 00000100:00100000:2.0:1763334961.192281:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4346 00000100:00100000:2.0:1763334961.192294:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52969:x1848989694334464:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334961.192335:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.192339:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334961.192377:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499150 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af22f expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.192400:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334961.192407:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334961.192424:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8499173 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af244 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.192632:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849917a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.192647:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849917a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.192658:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849917a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.192675:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499181 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.192682:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499181 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.192687:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499181 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334961.193191:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694334080 00000100:00100000:1.0:1763334961.193202:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694334080 00002000:00010000:1.0:1763334961.193244:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/527 (5->18446744073709551615) 00002000:00100000:1.0:1763334961.193250:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e87480 with x1848989694334080 ext(5->18446744073709551615) 00002000:00010000:1.0:1763334961.193261:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9e87480. 00000100:00100000:1.0:1763334961.193289:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694334208 00000100:00100000:1.0:1763334961.193293:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694334208 00002000:00010000:1.0:1763334961.193307:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/531 (0->18446744073709551615) 00002000:00100000:1.0:1763334961.193311:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e85f80 with x1848989694334208 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334961.193328:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9e85f80. 00000100:00100000:1.0:1763334961.193351:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1682 00000100:00100000:1.0:1763334961.193361:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2361:x1848989694334080:12345-192.168.201.60@tcp:10:lfs.0 00000100:00100000:3.0:1763334961.193472:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1683 00000100:00100000:3.0:1763334961.193483:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2361:x1848989694334208:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:1.0:1763334961.193744:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:1.0:1763334961.193748:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb mtime from disk: 1763334961 -> 1763334961 00002000:00010000:1.0:1763334961.193751:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334961.193753:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb ctime from disk: 1763334961 -> 1763334961 00002000:00010000:1.0:1763334961.193756:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb blocks from disk: 11 -> 11 00002000:00010000:3.0:1763334961.193761:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334961.193764:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb mtime from disk: 0 -> 1763334961 00002000:00010000:3.0:1763334961.193766:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334961.193768:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb ctime from disk: 0 -> 1763334961 00002000:00010000:3.0:1763334961.193770:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334961.194269:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694334080:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 905us (2248us total) trans 21474838236 rc 0/0 00000100:00100000:1.0:1763334961.194279:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1682 00002000:00010000:1.0:1763334961.194284:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/527 (5->18446744073709551615) 00002000:00100000:1.0:1763334961.194288:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e87480 with x1848989694334080 ext(5->18446744073709551615) 00002000:00010000:1.0:1763334961.194294:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9e87480. 00010000:00010000:2.0:1763334961.195365:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499188 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334961.195449:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2361:x1848989694334208:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 1964us (3368us total) trans 17179870954 rc 0/0 00000100:00100000:3.0:1763334961.195459:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1683 00002000:00010000:3.0:1763334961.195464:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/531 (0->18446744073709551615) 00002000:00100000:3.0:1763334961.195468:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e85f80 with x1848989694334208 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334961.195475:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9e85f80. 00010000:00010000:2.0:1763334961.195817:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499188 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.195831:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499188 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334961.195847:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x181:0x0]: returning size 0 00010000:00010000:2.0:1763334961.195891:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849917a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.195902:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849917a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.195910:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849917a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.195916:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334961.195921:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849917a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.195930:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849917a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.195944:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334961.195947:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334961.195952:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849917a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.195958:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849917a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:2.0:1763334961.195974:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000049dd2025 reply state 00000000c7ce07ea transno 8589938601 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499181 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334961.195983:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334961.196030:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8499173 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af244 expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.196046:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499188 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af244 expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.196053:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334961.196057:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334961.196060:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:2.0:1763334961.196115:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52969:x1848989694334464:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3824us (4015us total) trans 8589938601 rc 0/0 00000100:00100000:2.0:1763334961.196122:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4346 00000100:00100000:1.0:1763334961.208262:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.208668:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.209100:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694334976 00000100:00100000:1.0:1763334961.209114:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694334976 00000100:00100000:1.0:1763334961.209310:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694334720 00000100:00100000:1.0:1763334961.209315:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694334720 00000100:00100000:3.0:1763334961.209370:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4347 00000100:00100000:3.0:1763334961.209383:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52965:x1848989694334976:12345-192.168.201.60@tcp:36:lfs.0 00000100:00100000:2.0:1763334961.209463:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4348 00000100:00100000:2.0:1763334961.209476:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52969:x1848989694334720:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334961.209487:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.209517:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499196 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af24b expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.209518:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849919d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.209541:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849919d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.209554:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849919d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.209630:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.209644:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499188 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af244 expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.209654:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.209699:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499188 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af244 expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.209715:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499188 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af244 expref: 176 pid: 29627 timeout: 1125 lvb_type: 0 00000100:00100000:2.0:1763334961.209732:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7218700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701793792:192.168.201.60@tcp:104: 00000004:00010000:3.0:1763334961.209777:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000021bb7b17 reply state 00000000bdd1639b transno 8589938602 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849919d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334961.209787:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334961.209863:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52965:x1848989694334976:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 483us (1618us total) trans 8589938602 rc 0/0 00000100:00100000:2.0:1763334961.209865:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1763334961.209871:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4347 00010000:00010000:0.0:1763334961.210156:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499181 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.210166:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499181 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.210174:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499181 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.210182:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.210188:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499181 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.210196:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499181 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.210213:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334961.210218:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.210224:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499181 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.210231:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499181 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.218422:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849919d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.218452:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849919d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.218460:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849919d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.218470:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fc00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334961.218476:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849919d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.218487:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849919d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.218515:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:2.0:1763334961.218518:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334961.218525:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849919d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.218534:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849919d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334961.218875:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.220176:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7218700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701793792:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334961.220216:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334961.220371:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.220475:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694335104 00000100:00100000:1.0:1763334961.220487:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694335104 00000100:00100000:1.0:1763334961.220589:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4509 00000100:00100000:1.0:1763334961.220603:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694335104:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:1.0:1763334961.220909:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763334961.220913:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb mtime from disk: 1763334961 -> 1763334961 00002000:00010000:1.0:1763334961.220916:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb atime from disk: 0 -> 1763334961 00002000:00010000:1.0:1763334961.220918:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb ctime from disk: 1763334961 -> 1763334961 00002000:00010000:1.0:1763334961.220921:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334961.221003:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694335104:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 402us (2133us total) trans 17179870955 rc 0/0 00000100:00100000:2.0:1763334961.222284:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694335232 00000100:00100000:2.0:1763334961.222301:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694335232 00010000:00010000:2.0:1763334961.222366:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499188 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af244 expref: 176 pid: 29627 timeout: 1125 lvb_type: 0 00000100:00100000:2.0:1763334961.222402:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2389 00000100:00100000:2.0:1763334961.222415:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:2359:x1848989694335232:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334961.222431:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334961.222439:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499188 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af244 expref: 176 pid: 29627 timeout: 1125 lvb_type: 0 00010000:00010000:2.0:1763334961.222451:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499188 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af244 expref: 176 pid: 29627 timeout: 1125 lvb_type: 0 00010000:00010000:2.0:1763334961.222478:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499188 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af244 expref: 176 pid: 29627 timeout: 1125 lvb_type: 0 00010000:00010000:2.0:1763334961.222500:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334961.222505:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.222515:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.222523:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.222561:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334961.222640:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:2359:x1848989694335232:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 227us (2270us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.222647:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2389 00010000:00010000:0.0:1763334961.222756:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.222764:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:0.0:1763334961.222785:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x181:0x0]: returning size 0 00000100:00100000:0.0:1763334961.223528:0:29651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e87b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:29651:1848989701793920:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1763334961.223629:0:29651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334961.223663:0:29651:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e7c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334961.223984:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4509 00000100:00100000:1.0:1763334961.224019:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701793920 00000100:00100000:1.0:1763334961.224025:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701793920 00000100:00100000:1.0:1763334961.224072:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4510 00000100:00100000:1.0:1763334961.224082:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:29651:x1848989701793920:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1763334961.224145:0:6518:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 546 00000004:00080000:0.0:1763334961.230220:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x216:0x0], index 1: 0 00000004:00080000:0.0:1763334961.230243:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x212:0x0], index 0: 0 00000004:00080000:0.0:1763334961.230251:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x213:0x0], index 0: 0 00000004:00080000:0.0:1763334961.230257:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x217:0x0], index 1: 0 00010000:00010000:0.0:1763334961.230486:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.230499:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.230506:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.230512:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.230517:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.230526:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.230546:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:0.0:1763334961.230549:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334961.230554:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.230560:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84991a4 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.230690:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499196 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af24b expref: 175 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.230702:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.230705:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334961.230709:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499196 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af24b expref: 175 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.230721:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067c00, rc 0) 00000100:00100000:0.0:1763334961.230823:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52969:x1848989694334720:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 21351us (22154us total) trans 8589938603 rc 301/301 00000100:00100000:0.0:1763334961.230834:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4348 00000100:00100000:3.0:1763334961.235778:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.241361:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.243680:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:29651:x1848989701793920:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19588us (20040us total) trans 21474838237 rc 0/0 00000100:00100000:1.0:1763334961.243699:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4510 00000100:00100000:1.0:1763334961.243794:0:29651:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838231 gen 2 00000004:00080000:1.0:1763334961.243803:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f1f80, transno 21474838211 00000004:00080000:1.0:1763334961.243819:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f1180, transno 21474838212 00000004:00080000:1.0:1763334961.243822:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f0000, transno 21474838213 00000004:00080000:1.0:1763334961.243825:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f0380, transno 21474838214 00000004:00080000:1.0:1763334961.243828:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad88be680, transno 21474838216 00000004:00080000:1.0:1763334961.243831:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841aa00, transno 21474838217 00000004:00080000:1.0:1763334961.243834:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4fb80, transno 21474838218 00000004:00080000:1.0:1763334961.243837:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4f100, transno 21474838219 00000004:00080000:1.0:1763334961.243840:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4ed80, transno 21474838220 00000004:00080000:1.0:1763334961.243843:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6bec700, transno 21474838221 00000004:00080000:1.0:1763334961.243846:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6bed500, transno 21474838222 00000004:00080000:1.0:1763334961.243848:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6bedc00, transno 21474838223 00000004:00080000:1.0:1763334961.243851:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d73800, transno 21474838225 00000004:00080000:1.0:1763334961.243854:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d70e00, transno 21474838226 00000004:00080000:1.0:1763334961.243856:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d73100, transno 21474838227 00000004:00080000:1.0:1763334961.243859:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d72d80, transno 21474838228 00000004:00080000:1.0:1763334961.243862:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aef0a0e00, transno 21474838230 00000004:00080000:1.0:1763334961.243865:0:29651:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aef0a3100, transno 21474838231 00000100:00100000:1.0:1763334961.243874:0:29651:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a59c39e7800 x1848989701793536/t21474838233(21474838233) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334977 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1763334961.243890:0:29651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e87b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:29651:1848989701793920:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1763334961.243910:0:29651:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x213:0x0]-[0x240000400:0x241:0x0] 00000004:00080000:1.0:1763334961.244226:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 2 in progress, 0 in flight, 18 done 00000100:00100000:0.0:1763334961.245038:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694335488 00000100:00100000:0.0:1763334961.245053:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694335488 00000100:00100000:0.0:1763334961.245125:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694335744 00000100:00100000:0.0:1763334961.245130:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694335744 00000100:00100000:0.0:1763334961.245164:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1605 00000100:00100000:0.0:1763334961.245176:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52965:x1848989694335488:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:0.0:1763334961.245275:0:29631:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x17e:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498fb3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1a3 expref: 175 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.245359:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334961.245376:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499054 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1d4 expref: 175 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.245388:0:29631:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334961.245436:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499054 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1d4 expref: 175 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.245455:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499054 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1d4 expref: 175 pid: 29629 timeout: 1125 lvb_type: 0 00000100:00100000:0.0:1763334961.245472:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e84a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701794048:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334961.245640:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e7c900 going to sleep for 11 seconds 00000100:00100000:3.0:1763334961.245966:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1606 00000100:00100000:3.0:1763334961.245979:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52969:x1848989694335744:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334961.246405:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52969:x1848989694335744:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 427us (5059us total) trans 8589938604 rc 0/0 00000100:00100000:3.0:1763334961.246414:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1606 00000100:00100000:3.0:1763334961.249554:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.249630:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694336000 00000100:00100000:3.0:1763334961.249643:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694336000 00000100:00100000:3.0:1763334961.249702:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1607 00000100:00100000:3.0:1763334961.249713:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52969:x1848989694336000:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334961.250027:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52969:x1848989694336000:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 314us (487us total) trans 8589938605 rc 0/0 00000100:00100000:3.0:1763334961.250036:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1607 00000100:00100000:0.0:1763334961.250188:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e84a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701794048:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334961.250221:0:29631:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:0.0:1763334961.257416:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.257615:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694336128 00000100:00100000:3.0:1763334961.257629:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694336128 00010000:00010000:3.0:1763334961.257682:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499054 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1d4 expref: 177 pid: 29629 timeout: 1125 lvb_type: 0 00000100:00100000:3.0:1763334961.257735:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2390 00000100:00100000:3.0:1763334961.257747:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:2359:x1848989694336128:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334961.257768:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334961.257775:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499054 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1d4 expref: 177 pid: 29629 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334961.257791:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499054 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1d4 expref: 177 pid: 29629 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334961.257820:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499054 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1d4 expref: 177 pid: 29629 timeout: 1125 lvb_type: 0 00010000:00010000:3.0:1763334961.257839:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:3.0:1763334961.257845:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334961.257856:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334961.257865:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334961.257892:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334961.257971:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+176:2359:x1848989694336128:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 225us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334961.257980:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2390 00010000:00010000:0.0:1763334961.258052:0:29631:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334961.258061:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000040:00080000:0.0:1763334961.258638:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1008, 88 off87232 00000004:00080000:0.0:1763334961.258648:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1025892075497ns, next at 1026753065722ns, rc = 0 00000040:00080000:0.0:1763334961.258684:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].997, 88 off86168 00000004:00080000:0.0:1763334961.258689:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1025892117603ns, next at 1026752974522ns, rc = 0 00000040:00080000:0.0:1763334961.258716:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].998, 88 off86256 00000004:00080000:0.0:1763334961.258720:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1025892148524ns, next at 1026752974522ns, rc = 0 00000040:00080000:0.0:1763334961.258737:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1009, 88 off87320 00000004:00080000:0.0:1763334961.258741:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1025892169159ns, next at 1026753065722ns, rc = 0 00000100:00100000:0.0:1763334961.266313:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.266744:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694336384 00000100:00100000:1.0:1763334961.266757:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694336384 00000100:00100000:1.0:1763334961.267202:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4349 00000100:00100000:1.0:1763334961.267216:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52274:x1848989694336384:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334961.267245:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.267274:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84991b9 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af252 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.267669:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84991c0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.267689:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84991c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.267703:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84991c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.267721:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f84991c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.267728:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f84991c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.267734:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f84991c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.267824:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f84991ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.267833:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f84991ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.267839:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f84991ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334961.267851:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x181:0x0]: returning size 0 00010000:00010000:1.0:1763334961.268117:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84991c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268125:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84991c0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268145:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84991c0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268153:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.268158:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84991c0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268167:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84991c0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268184:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334961.268187:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.268194:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84991c0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268201:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84991c0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268218:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f84991c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268225:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f84991c7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268231:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f84991c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268236:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.268239:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f84991c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268244:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f84991c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268250:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829c00) 00010000:00010000:1.0:1763334961.268253:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.268256:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f84991c7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268262:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f84991c7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.268331:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84991b9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af252 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.268347:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f84991ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af252 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.268355:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ad2829400) 00010000:00010000:1.0:1763334961.268358:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334961.268361:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:1.0:1763334961.268446:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52274:x1848989694336384:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1232us (2150us total) trans 8589938607 rc 0/0 00000100:00100000:1.0:1763334961.268456:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4349 00000100:00100000:1.0:1763334961.276517:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.277757:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694336640 00000100:00100000:3.0:1763334961.277780:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694336640 00000100:00100000:3.0:1763334961.277856:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4350 00000100:00100000:3.0:1763334961.277869:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52274:x1848989694336640:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:3.0:1763334961.277950:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334961.277988:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f84991ce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af252 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.278012:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ad2829400) 00010000:00010000:3.0:1763334961.278029:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334961.279027:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84991dc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.279053:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84991dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.279067:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84991dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:3.0:1763334961.279162:0:29627:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938608 00000004:00010000:3.0:1763334961.279945:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fab49e04 reply state 0000000054a9bad2 transno 8589938609 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84991dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334961.279966:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334961.281230:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52274:x1848989694336640:12345-192.168.201.60@tcp:36:bash.0 Request processed in 3349us (4714us total) trans 8589938609 rc 0/0 00000100:00100000:3.0:1763334961.281243:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4350 00000020:00080000:3.0:1763334961.281251:0:29627:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763334961.284836:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334961.284921:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84991dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.284937:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84991dc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.284946:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84991dc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.284952:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334961.284957:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84991dc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.284966:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84991dc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.284990:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ae1a32a00) 00010000:00010000:3.0:1763334961.284994:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334961.285000:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84991dc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.285007:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84991dc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334961.286068:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694336768 00000100:00100000:2.0:1763334961.286089:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694336768 00000100:00100000:2.0:1763334961.286749:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4351 00000100:00100000:2.0:1763334961.286765:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52274:x1848989694336768:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334961.286795:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.286828:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84991e3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af259 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.286913:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84991e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af259 expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.286930:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84991e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af259 expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.286953:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334961.286956:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334961.286961:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:2.0:1763334961.287046:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52274:x1848989694336768:12345-192.168.201.60@tcp:101:bash.0 Request processed in 285us (2225us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.287056:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4351 00000100:00100000:0.0:1763334961.299869:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.299972:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694337024 00000100:00100000:2.0:1763334961.299987:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694337024 00000100:00100000:2.0:1763334961.300061:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4352 00000100:00100000:2.0:1763334961.300072:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52274:x1848989694337024:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334961.300100:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.300104:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334961.300139:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84991e3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af259 expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.300161:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334961.300173:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334961.300191:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84991ea lrc: 2/0,0 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af260 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.300251:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84991f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.300265:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84991f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.300276:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84991f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:2.0:1763334961.300818:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1010, 88 off87408 00000004:00080000:2.0:1763334961.300832:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1025934259542ns, next at 1026753065722ns, rc = 0 00000040:00080000:2.0:1763334961.300902:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].999, 88 off86344 00000004:00080000:2.0:1763334961.300908:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1025934335837ns, next at 1026752974522ns, rc = 0 00000040:00080000:2.0:1763334961.300932:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1000, 88 off86432 00000004:00080000:2.0:1763334961.300937:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1025934365178ns, next at 1026752974522ns, rc = 0 00000040:00080000:2.0:1763334961.300952:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1011, 88 off87496 00000004:00080000:2.0:1763334961.300955:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1025934383642ns, next at 1026753065722ns, rc = 0 00000001:00080000:3.0:1763334961.326809:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938606 is committed 00000004:00080000:3.0:1763334961.326832:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 667 committed 00000004:00080000:3.0:1763334961.326843:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 655 committed 00000004:00080000:3.0:1763334961.326851:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 654 committed 00000004:00080000:3.0:1763334961.326854:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 666 committed 00000004:00080000:3.0:1763334961.326868:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 665 committed 00000004:00080000:3.0:1763334961.326870:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 653 committed 00000100:00100000:3.0:1763334961.327095:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701794176:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334961.327199:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334961.327248:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763334961.327254:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701794560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334961.327276:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334961.327307:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701794304:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334961.327343:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334961.327360:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763334961.327365:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701794432:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334961.327382:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334961.327422:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701794176 00000100:00100000:3.0:1763334961.327431:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701794176 00000100:00100000:3.0:1763334961.327484:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701794560 00000100:00100000:3.0:1763334961.327487:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701794560 00000100:00100000:3.0:1763334961.327504:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701794304 00000100:00100000:3.0:1763334961.327506:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701794304 00000100:00100000:3.0:1763334961.327520:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701794432 00000100:00100000:3.0:1763334961.327522:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701794432 00000100:00100000:3.0:1763334961.327542:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4511 00000100:00100000:3.0:1763334961.327551:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3290:x1848989701794176:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334961.327612:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:532 count 1 00010000:00010000:3.0:1763334961.327647:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.327674:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f84990d2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af20c expref: 26 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.327683:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334961.327686:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334961.327691:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.327724:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f84990d2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af20c expref: 26 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.327740:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f84990d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af20c expref: 26 pid: 6519 timeout: 1125 lvb_type: 0 00000100:00100000:3.0:1763334961.327754:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701794688:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334961.327826:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa806b40 going to sleep for 11 seconds 00000100:00100000:3.0:1763334961.327846:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4512 00000100:00100000:3.0:1763334961.327854:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3290:x1848989701794560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334961.328068:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334961.328072:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb mtime from disk: 1763334961 -> 1763334961 00002000:00010000:3.0:1763334961.328075:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334961.328077:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb ctime from disk: 1763334961 -> 1763334961 00002000:00010000:3.0:1763334961.328080:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x213:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334961.328129:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3290:x1848989701794560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 275us (850us total) trans 17179870956 rc 0/0 00000100:00100000:3.0:1763334961.328137:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4512 00000100:00100000:3.0:1763334961.328158:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4513 00000100:00100000:3.0:1763334961.328165:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3291:x1848989701794304:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334961.328178:0:25383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:533 count 1 00002000:00010000:3.0:1763334961.328200:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x215:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334961.328206:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f84991ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.328215:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334961.328217:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334961.328222:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f84991ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.328236:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f84991ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.328247:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f84991ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.328256:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f84991ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.328273:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334961.328493:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3291:x1848989701794304:12345-0@lo:6:osp-syn-1-0.0 Request processed in 328us (1149us total) trans 17179870957 rc 0/0 00000100:00100000:3.0:1763334961.328500:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4513 00000100:00100000:3.0:1763334961.328513:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4514 00000100:00100000:3.0:1763334961.328521:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3291:x1848989701794432:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334961.328651:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763334961.328654:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb mtime from disk: 1763334961 -> 1763334961 00002000:00010000:3.0:1763334961.328656:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb atime from disk: 1763334961 -> 1763334961 00002000:00010000:3.0:1763334961.328659:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb ctime from disk: 1763334961 -> 1763334961 00002000:00010000:3.0:1763334961.328661:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x212:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334961.328688:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3291:x1848989701794432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 168us (1304us total) trans 17179870958 rc 0/0 00000100:00100000:3.0:1763334961.328695:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4514 00000004:00080000:3.0:1763334961.328762:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c5500/2, rc 0, transno 17179870958 00000100:00100000:3.0:1763334961.328777:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701794432:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334961.328791:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c6680/2, rc 0, transno 17179870957 00000100:00100000:3.0:1763334961.328795:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701794304:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763334961.328819:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c7480/2, rc 0, transno 17179870956 00000100:00100000:3.0:1763334961.328824:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701794560:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1763334961.329043:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334961.329052:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f84991ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.329063:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334961.329068:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f84991ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.329078:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f84991ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.329099:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f84991ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.329112:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f84991ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.329130:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334961.329132:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334961.329134:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1763334961.329248:0:29631:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e59b735f reply state 00000000be544cb3 transno 8589938606 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:2.0:1763334961.329260:0:29631:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334961.329270:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:2.0:1763334961.329273:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334961.329281:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8498fb3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1a3 expref: 173 pid: 29629 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1763334961.329410:0:29631:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1763334961.329438:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52965:x1848989694335488:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 84263us (93677us total) trans 8589938606 rc 0/0 00000100:00100000:2.0:1763334961.329448:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1605 00000100:00100000:0.0:1763334961.329924:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701795072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334961.329972:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334961.329998:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763334961.330004:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701794944:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334961.330020:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334961.330040:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701795072 00000100:00100000:0.0:1763334961.330046:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701795072 00000100:00100000:0.0:1763334961.330076:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701794944 00000100:00100000:0.0:1763334961.330078:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701794944 00000100:00100000:0.0:1763334961.330090:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4515 00000100:00100000:0.0:1763334961.330096:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701795072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334961.330330:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334961.330333:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb mtime from disk: 1763334961 -> 1763334961 00002000:00010000:0.0:1763334961.330336:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334961.330338:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb ctime from disk: 1763334961 -> 1763334961 00002000:00010000:0.0:1763334961.330341:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x20e:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:0.0:1763334961.330375:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701795072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 278us (402us total) trans 21474838238 rc 0/0 00000100:00100000:0.0:1763334961.330382:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4515 00000100:00100000:0.0:1763334961.330397:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4516 00000100:00100000:0.0:1763334961.330404:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701794944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334961.330421:0:6517:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:529 count 1 00002000:00010000:0.0:1763334961.330450:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x211:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334961.330458:0:6517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499206 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.330473:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.330475:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.330480:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499206 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.330493:0:6517:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499206 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.330504:0:6517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499206 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.330513:0:6517:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499206 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.330532:0:6517:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334961.330736:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701794944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 332us (713us total) trans 21474838239 rc 0/0 00000100:00100000:0.0:1763334961.330745:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4516 00010000:00010000:0.0:1763334961.330765:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334961.330771:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499206 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.330778:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334961.330782:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499206 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.330790:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499206 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.330803:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499206 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.330810:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499206 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.330823:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334961.330825:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334961.330827:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334961.330862:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d5180/2, rc 0, transno 21474838239 00000100:00100000:0.0:1763334961.330874:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701794944:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1763334961.330883:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d4e00/2, rc 0, transno 21474838238 00000100:00100000:0.0:1763334961.330886:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701795072:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763334961.331726:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334961.331741:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334961.331750:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334961.331756:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.331761:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334961.331768:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334961.331783:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:1.0:1763334961.331787:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334961.331791:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334961.331798:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84991b2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00000100:00100000:0.0:1763334961.338443:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701795200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334961.338565:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334961.338654:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763334961.338662:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701794816:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334961.338686:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334961.340485:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701795200 00000100:00100000:1.0:1763334961.340507:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701795200 00000100:00100000:1.0:1763334961.340610:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701794816 00000100:00100000:1.0:1763334961.340614:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701794816 00000100:00100000:1.0:1763334961.340647:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4517 00000100:00100000:1.0:1763334961.340660:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701795200:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334961.340935:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763334961.340940:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb mtime from disk: 1763334961 -> 1763334961 00002000:00010000:1.0:1763334961.340943:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334961.340946:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb ctime from disk: 1763334961 -> 1763334961 00002000:00010000:1.0:1763334961.340948:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x20f:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1763334961.341049:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701795200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 391us (2483us total) trans 21474838240 rc 0/0 00000100:00100000:1.0:1763334961.341058:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4517 00000100:00100000:1.0:1763334961.341080:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4518 00000100:00100000:1.0:1763334961.341087:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701794816:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763334961.341105:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:528 count 1 00010000:00010000:1.0:1763334961.341130:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.341155:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84990cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af205 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.341163:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334961.341166:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334961.341171:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.341211:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84990cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af205 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.341226:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84990cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af205 expref: 13 pid: 6517 timeout: 1125 lvb_type: 0 00000100:00100000:1.0:1763334961.341242:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701795328:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334961.341346:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa65e840 going to sleep for 11 seconds 00000004:00080000:1.0:1763334961.341439:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d6680/2, rc 0, transno 21474838240 00000100:00100000:1.0:1763334961.341453:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701795200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334961.342601:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.342670:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.342702:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694337152 00000100:00100000:0.0:1763334961.342712:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694337152 00010000:00010000:0.0:1763334961.342752:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f84990d2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af20c expref: 27 pid: 6519 timeout: 1125 lvb_type: 0 00000100:00100000:0.0:1763334961.342790:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2391 00000100:00100000:0.0:1763334961.342800:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694337152:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334961.342817:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334961.342823:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f84990d2 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af20c expref: 27 pid: 6519 timeout: 1125 lvb_type: 0 00010000:00010000:0.0:1763334961.342836:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f84990d2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af20c expref: 27 pid: 6519 timeout: 1125 lvb_type: 0 00010000:00010000:0.0:1763334961.342866:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.342868:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.342874:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.342884:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.342913:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334961.342955:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694337152:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 156us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334961.342963:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2391 00010000:00010000:0.0:1763334961.343015:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f84990d2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af20c expref: 26 pid: 6519 timeout: 1125 lvb_type: 0 00000100:00100000:0.0:1763334961.343031:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701794688:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334961.343053:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.343064:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.343071:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.343082:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.343091:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.343110:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334961.343459:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3290:x1848989701794176:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15906us (16259us total) trans 17179870959 rc 0/0 00000100:00100000:0.0:1763334961.343469:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4511 00010000:00010000:0.0:1763334961.343502:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334961.343510:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.343519:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334961.343525:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.343535:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.343549:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.343557:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f84991f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.343603:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334961.343605:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334961.343607:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334961.345963:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694337280 00000100:00100000:1.0:1763334961.345984:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694337280 00000100:00100000:1.0:1763334961.346059:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4353 00000100:00100000:1.0:1763334961.346068:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52965:x1848989694337280:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.346100:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.346127:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f8499214 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af267 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.346208:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f8499214 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af267 expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.346223:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479200/0xcedf0054f8499214 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x17e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af267 expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.346246:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:1.0:1763334961.346250:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334961.346254:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479200, rc 0) 00000100:00100000:1.0:1763334961.346356:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52965:x1848989694337280:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 287us (3684us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334961.346365:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4353 00000004:00080000:1.0:1763334961.346444:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c4a80/2, rc 0, transno 17179870959 00000100:00100000:1.0:1763334961.346462:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701794176:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334961.349870:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.351528:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694337408 00000100:00100000:1.0:1763334961.351550:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694337408 00010000:00010000:1.0:1763334961.351925:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84990cb lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af205 expref: 14 pid: 6517 timeout: 1125 lvb_type: 0 00000100:00100000:0.0:1763334961.352464:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701795328:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334961.352501:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334961.353098:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2392 00000100:00100000:2.0:1763334961.353120:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694337408:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334961.353154:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334961.353165:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84990cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af205 expref: 14 pid: 6517 timeout: 1125 lvb_type: 0 00010000:00010000:2.0:1763334961.353183:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84990cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af205 expref: 14 pid: 6517 timeout: 1125 lvb_type: 0 00010000:00010000:2.0:1763334961.353217:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84990cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x210:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af205 expref: 14 pid: 6517 timeout: 1125 lvb_type: 0 00010000:00010000:2.0:1763334961.353237:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.353239:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.353245:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.353256:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.353285:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334961.353380:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2359:x1848989694337408:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 268us (3524us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.353388:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2392 00010000:00010000:3.0:1763334961.354747:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.354769:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.354781:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.354788:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.354818:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334961.355192:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701794816:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14102us (16501us total) trans 21474838241 rc 0/0 00000100:00100000:3.0:1763334961.355205:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4518 00000004:00080000:3.0:1763334961.355375:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d4a80/2, rc 0, transno 21474838241 00000100:00100000:3.0:1763334961.355394:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701794816:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763334961.356091:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334961.356102:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.356115:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334961.356120:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.356140:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.356165:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.356173:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478600/0xcedf0054f849920d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.356201:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334961.356203:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334961.356205:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334961.357729:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.357828:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694337664 00000100:00100000:2.0:1763334961.357844:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694337664 00000100:00100000:2.0:1763334961.357925:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1608 00000100:00100000:2.0:1763334961.357939:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52965:x1848989694337664:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:3.0:1763334961.358822:0:29631:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x17e:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763334961.359001:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1012, 64 off87560 00000040:00080000:3.0:1763334961.359057:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1001, 64 off86496 00000040:00080000:3.0:1763334961.359074:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1002, 64 off86560 00000040:00080000:3.0:1763334961.359088:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1013, 64 off87624 00010000:00010000:3.0:1763334961.359198:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849921b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334961.359222:0:29631:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849921b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334961.359241:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849921b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334961.359279:0:29631:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849921b lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334961.359287:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849921b lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334961.359295:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849921b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334961.359325:0:29631:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334961.359523:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52965:x1848989694337664:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1584us (1805us total) trans 8589938611 rc 0/0 00000100:00100000:3.0:1763334961.359534:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1608 00010000:00010000:1.0:1763334961.359777:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334961.359787:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849921b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334961.359796:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334961.359801:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849921b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334961.359810:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849921b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334961.359827:0:8206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x17e:0x0].0x0 (ffff9a5ac51bd900) 00010000:00010000:1.0:1763334961.359831:0:8206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763334961.359837:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849921b lrc: 1/0,0 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334961.359842:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849921b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x17e:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334961.359855:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334961.359857:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334961.359859:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334961.369735:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.369785:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694337920 00000100:00100000:0.0:1763334961.369797:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694337920 00000100:00100000:0.0:1763334961.369860:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4354 00000100:00100000:0.0:1763334961.369870:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52965:x1848989694337920:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.369900:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.369930:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499222 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af26e expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.370035:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499229 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370054:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499229 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370070:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499229 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370085:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499230 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370091:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499230 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370097:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499230 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370443:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499237 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370454:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499237 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370462:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499237 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:0.0:1763334961.370476:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x181:0x0]: returning size 2 00010000:00010000:0.0:1763334961.370644:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499237 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370653:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499237 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370662:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499237 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370668:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.370674:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499237 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370682:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499237 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370698:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334961.370701:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1763334961.370708:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499237 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370715:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499237 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370733:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499229 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370740:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499229 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370746:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499229 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370756:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.370759:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499229 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370765:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499229 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370773:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.370775:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.370779:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499229 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370784:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499229 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370794:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499230 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370800:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499230 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370807:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499230 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370812:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.370816:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499230 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370822:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499230 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370829:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad29c0b00) 00010000:00010000:0.0:1763334961.370832:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.370835:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499230 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370840:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499230 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.370892:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499222 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af26e expref: 176 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.370904:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.370908:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334961.370912:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499222 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af26e expref: 176 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.370923:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334961.371021:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52965:x1848989694337920:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1151us (1300us total) trans 8589938612 rc 301/301 00000100:00100000:0.0:1763334961.371033:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4354 00000100:00100000:2.0:1763334961.382258:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.382791:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694338048 00000100:00100000:1.0:1763334961.382808:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694338048 00000100:00100000:1.0:1763334961.382914:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4355 00000100:00100000:1.0:1763334961.382928:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52965:x1848989694338048:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.382963:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.382999:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8499245 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af275 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.383129:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849924c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.383148:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84991f1 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.383159:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849924c lrc: 4/1,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.383186:0:29627:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84991f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.383199:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849924c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:0.0:1763334961.387261:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938610 is committed 00000004:00080000:0.0:1763334961.387283:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 669 committed 00000004:00080000:0.0:1763334961.387297:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 657 committed 00000004:00080000:0.0:1763334961.387306:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 656 committed 00000004:00080000:0.0:1763334961.387309:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 668 committed 00010000:00010000:2.0:1763334961.387544:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84991f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x181:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af260 expref: 174 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334961.387556:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701795584:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763334961.387563:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:2.0:1763334961.387566:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334961.387585:0:32232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849924c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.387596:0:32232:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849924c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.387602:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849924c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.387652:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84991ea lrc: 0/0,0 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af260 expref: 174 pid: 32232 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1763334961.387677:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334961.387745:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701795456:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334961.387771:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334961.387811:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701795584 00010000:00010000:2.0:1763334961.387825:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84991f1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x181:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af260 expref: 173 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334961.387826:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701795584 00010000:00010000:2.0:1763334961.387873:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066c00, rc 0) 00000100:00100000:0.0:1763334961.387889:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701795456 00000100:00100000:0.0:1763334961.387893:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701795456 00000100:00100000:0.0:1763334961.387919:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4519 00000100:00100000:1.0:1763334961.387927:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4520 00000100:00100000:0.0:1763334961.387931:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3291:x1848989701795584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334961.387940:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3290:x1848989701795456:12345-0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1763334961.388028:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938607 is committed 00000100:00100000:3.0:1763334961.388129:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701795840:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334961.388163:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334961.388197:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701795840 00000100:00100000:3.0:1763334961.388201:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701795840 00000100:00100000:3.0:1763334961.388228:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4521 00000100:00100000:3.0:1763334961.388234:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701795840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334961.388410:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701795840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 176us (245us total) trans 21474838242 rc 0/0 00000100:00100000:0.0:1763334961.388410:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3291:x1848989701795584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 480us (731us total) trans 17179870960 rc 0/0 00000100:00100000:0.0:1763334961.388418:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4519 00000100:00100000:0.0:1763334961.388475:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701795712:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334961.388488:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52274:x1848989694337024:12345-192.168.201.60@tcp:101:bash.0 Request processed in 88416us (88630us total) trans 8589938610 rc 0/0 00000100:00100000:2.0:1763334961.388496:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4352 00000100:00100000:0.0:1763334961.388499:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763334961.388527:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849924c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.388540:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849924c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334961.388604:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x181:0x0]: returning size 2 00000004:00200000:2.0:1763334961.388610:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334961.388633:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849924c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.388667:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8499245 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x181:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af275 expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.388681:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849924c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af275 expref: 171 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.388689:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:2.0:1763334961.388692:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334961.388695:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:2.0:1763334961.388727:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52965:x1848989694338048:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5803us (6487us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.388734:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4355 00000100:00100000:1.0:1763334961.389017:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3290:x1848989701795456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1081us (1244us total) trans 17179870961 rc 0/0 00000100:00100000:3.0:1763334961.390169:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4521 00000100:00100000:1.0:1763334961.390194:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4520 00000100:00100000:1.0:1763334961.390235:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701795712 00000100:00100000:1.0:1763334961.390246:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701795712 00000100:00100000:1.0:1763334961.390308:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4522 00000100:00100000:1.0:1763334961.390326:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3292:x1848989701795712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334961.390621:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3292:x1848989701795712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 304us (2120us total) trans 21474838243 rc 0/0 00000100:00100000:1.0:1763334961.390627:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4522 00000004:00080000:3.0:1763334961.391164:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c4000/2, rc 0, transno 21474838242 00000100:00100000:3.0:1763334961.391188:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701795840:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334961.391290:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c5f80/2, rc 0, transno 21474838243 00000100:00100000:0.0:1763334961.391296:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701795712:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334961.391340:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa746a00/2, rc 0, transno 17179870960 00000004:00080000:1.0:1763334961.391525:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa745c00/2, rc 0, transno 17179870961 00000100:00100000:0.0:1763334961.391540:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701795584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334961.391896:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa745c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701795456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334961.397011:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.397058:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.397094:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694338176 00000100:00100000:0.0:1763334961.397108:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694338176 00000100:00100000:3.0:1763334961.397191:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694338304 00000100:00100000:3.0:1763334961.397197:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694338304 00000100:00100000:3.0:1763334961.397267:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4523 00000100:00100000:3.0:1763334961.397278:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694338304:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334961.397301:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334961.397336:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499253 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af283 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334961.397369:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x216:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334961.397396:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334961.397398:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334961.397410:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499253 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af283 expref: 28 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334961.397430:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499253 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af283 expref: 28 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334961.397451:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fe00, rc 0) 00000100:00100000:3.0:1763334961.397535:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694338304:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 259us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334961.397543:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4523 00000100:00100000:0.0:1763334961.397660:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4524 00000100:00100000:0.0:1763334961.397678:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:52274:x1848989694338176:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334961.397685:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.397695:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849925a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af27c expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.397715:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499253 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af283 expref: 28 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334961.397722:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.397725:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.397728:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849925a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af27c expref: 28 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.397767:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499253 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af283 expref: 28 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334961.397782:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499253 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af283 expref: 28 pid: 26564 timeout: 1126 lvb_type: 1 00000100:00100000:0.0:1763334961.397798:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701795968:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334961.397885:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afad85c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334961.402976:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.403999:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694338560 00000100:00100000:3.0:1763334961.404016:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694338560 00000100:00100000:3.0:1763334961.404101:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1609 00000100:00100000:3.0:1763334961.404114:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52965:x1848989694338560:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334961.404502:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52965:x1848989694338560:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 389us (1541us total) trans 8589938613 rc 0/0 00000100:00100000:3.0:1763334961.404511:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1609 00000100:00100000:0.0:1763334961.407283:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701795968:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334961.407342:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849925a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af27c expref: 28 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.407368:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334961.407452:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+28:52274:x1848989694338176:12345-192.168.201.60@tcp:101:bash.0 Request processed in 9774us (10456us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334961.407463:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4524 00000100:00100000:2.0:1763334961.408039:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.409474:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694338688 00000100:00100000:0.0:1763334961.409494:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694338688 00010000:00010000:0.0:1763334961.409551:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499253 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af283 expref: 28 pid: 26564 timeout: 1126 lvb_type: 1 00000100:00100000:0.0:1763334961.409653:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2393 00000100:00100000:0.0:1763334961.409675:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694338688:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334961.409700:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334961.409707:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499253 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af283 expref: 28 pid: 26564 timeout: 1126 lvb_type: 1 00010000:00010000:0.0:1763334961.409721:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499253 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af283 expref: 28 pid: 26564 timeout: 1126 lvb_type: 1 00010000:00010000:0.0:1763334961.409753:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499253 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af283 expref: 28 pid: 26564 timeout: 1126 lvb_type: 1 00010000:00010000:0.0:1763334961.409773:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.409775:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.409784:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849925a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af27c expref: 27 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.409796:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849925a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af27c expref: 27 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.409853:0:6532:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849925a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af27c expref: 27 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334961.409872:0:6532:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6532:1848989701796096:192.168.201.60@tcp:105: 00000100:00100000:0.0:1763334961.410001:0:6532:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afad85c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334961.415730:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.415979:0:6532:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6532:1848989701796096:192.168.201.60@tcp:105: 00010000:00010000:0.0:1763334961.416012:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334961.416096:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694338688:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 6431us (8059us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334961.416116:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2393 00000100:00100000:1.0:1763334961.417888:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694338944 00000100:00100000:1.0:1763334961.417912:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694338944 00000100:00100000:1.0:1763334961.418004:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4356 00000100:00100000:1.0:1763334961.418018:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52965:x1848989694338944:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.418060:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.418093:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8499261 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af28a expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.418205:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499268 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418226:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499268 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418241:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499268 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418260:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849926f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418267:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849926f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418274:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849926f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418474:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499276 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418485:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499276 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418492:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499276 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334961.418505:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x181:0x0]: returning size 2 00010000:00010000:1.0:1763334961.418670:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499268 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418679:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499268 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418689:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499268 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418695:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.418700:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499268 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418709:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499268 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418723:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334961.418726:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.418731:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499268 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418738:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499268 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418755:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849926f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418762:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849926f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418769:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849926f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418773:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.418776:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849926f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418784:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849926f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418791:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829400) 00010000:00010000:1.0:1763334961.418794:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.418797:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849926f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418803:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849926f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.418855:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f8499261 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af28a expref: 175 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.418870:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499276 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af28a expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.418879:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:1.0:1763334961.418881:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334961.418884:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:1.0:1763334961.418991:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52965:x1848989694338944:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 976us (3278us total) trans 8589938614 rc 0/0 00000100:00100000:1.0:1763334961.419000:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4356 00000100:00100000:3.0:1763334961.419103:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.419216:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694339072 00000100:00100000:0.0:1763334961.419223:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694339072 00000100:00100000:0.0:1763334961.419274:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4525 00000100:00100000:0.0:1763334961.419285:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+13:52274:x1848989694339072:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334961.419297:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.419326:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499284 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af291 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334961.419357:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x212:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334961.419375:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.419378:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.419389:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499284 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af291 expref: 14 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.419406:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499284 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af291 expref: 14 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.419419:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793800, rc 0) 00000100:00100000:0.0:1763334961.419452:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+14:52274:x1848989694339072:12345-192.168.201.60@tcp:101:bash.0 Request processed in 170us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334961.419460:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4525 00000100:00100000:0.0:1763334961.424566:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.424649:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.424724:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694339200 00000100:00100000:1.0:1763334961.424739:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694339328 00000100:00100000:3.0:1763334961.424740:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694339200 00000100:00100000:1.0:1763334961.424747:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694339328 00002000:00010000:3.0:1763334961.424802:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/534 (0->18446744073709551615) 00002000:00010000:1.0:1763334961.424802:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/530 (0->18446744073709551615) 00002000:00100000:3.0:1763334961.424811:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809ce00 with x1848989694339200 ext(0->18446744073709551615) 00002000:00100000:1.0:1763334961.424812:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809fb80 with x1848989694339328 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334961.424830:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad809ce00. 00002000:00010000:1.0:1763334961.424830:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ad809fb80. 00000100:00100000:1.0:1763334961.424874:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1684 00000100:00100000:1.0:1763334961.424892:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694339328:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334961.425456:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x212:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334961.425462:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x212:0x0] updating lvb mtime from disk: 0 -> 1763334961 00002000:00010000:1.0:1763334961.425466:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x212:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334961.425469:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x212:0x0] updating lvb ctime from disk: 0 -> 1763334961 00002000:00010000:1.0:1763334961.425471:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x212:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334961.426434:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.426467:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694339328:12345-192.168.201.60@tcp:10:bash.0 Request processed in 1574us (1812us total) trans 21474838244 rc 0/0 00000100:00100000:1.0:1763334961.426480:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1684 00002000:00010000:1.0:1763334961.426488:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/530 (0->18446744073709551615) 00002000:00100000:1.0:1763334961.426492:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809fb80 with x1848989694339328 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334961.426500:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ad809fb80. 00000100:00100000:1.0:1763334961.426536:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1685 00000100:00100000:1.0:1763334961.426548:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694339200:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:2.0:1763334961.426626:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694339584 00000100:00100000:2.0:1763334961.426635:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694339584 00000100:00100000:2.0:1763334961.426682:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1610 00000100:00100000:2.0:1763334961.426691:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52965:x1848989694339584:12345-192.168.201.60@tcp:35:lfs.0 00002000:00010000:1.0:1763334961.426881:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x216:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334961.426885:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x216:0x0] updating lvb mtime from disk: 0 -> 1763334961 00002000:00010000:1.0:1763334961.426888:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x216:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334961.426890:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x216:0x0] updating lvb ctime from disk: 0 -> 1763334961 00002000:00010000:1.0:1763334961.426894:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x216:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334961.426941:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694339200:12345-192.168.201.60@tcp:10:bash.0 Request processed in 397us (2393us total) trans 17179870962 rc 0/0 00000100:00100000:1.0:1763334961.426948:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1685 00002000:00010000:1.0:1763334961.426951:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/534 (0->18446744073709551615) 00002000:00100000:1.0:1763334961.426954:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809ce00 with x1848989694339200 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334961.426959:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad809ce00. 00000100:00100000:2.0:1763334961.428803:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52965:x1848989694339584:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 2092us (2357us total) trans 8589938615 rc 0/0 00000100:00100000:2.0:1763334961.428821:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1610 00000100:00100000:2.0:1763334961.438850:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.439495:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694339712 00000100:00100000:3.0:1763334961.439511:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694339712 00000100:00100000:2.0:1763334961.439681:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1611 00000100:00100000:2.0:1763334961.439697:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52965:x1848989694339712:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:2.0:1763334961.440332:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52965:x1848989694339712:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 637us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.440341:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1611 00000100:00100000:3.0:1763334961.447653:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.447704:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.447896:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694339968 00000100:00100000:0.0:1763334961.447913:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694339968 00000100:00100000:0.0:1763334961.447987:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694340224 00000100:00100000:0.0:1763334961.447991:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694340224 00000100:00100000:0.0:1763334961.448023:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4357 00000100:00100000:0.0:1763334961.448034:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52965:x1848989694339968:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.448068:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.448100:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849928b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af298 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.448245:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499292 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.448278:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499292 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.448292:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499292 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334961.448308:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x181:0x0]: returning size 2 00010000:00010000:0.0:1763334961.448519:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849928b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x181:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af298 expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.448564:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499292 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af298 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.448630:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334961.448634:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334961.448638:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:0.0:1763334961.448714:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52965:x1848989694339968:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 681us (1081us total) trans 8589938616 rc 0/0 00000100:00100000:0.0:1763334961.448722:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4357 00000100:00100000:0.0:1763334961.448748:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4358 00000100:00100000:0.0:1763334961.448757:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52970:x1848989694340224:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:0.0:1763334961.448786:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763334961.448803:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499276 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af28a expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.448820:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849924c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x181:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af275 expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.448834:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84991f1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x181:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af260 expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.448843:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334961.448847:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334961.448869:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84992a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.448877:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84992a0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.448885:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84992a0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.448898:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84992a7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.448905:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84992a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.448912:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84992a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449036:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992ae lrc: 3/0,1 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449045:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449053:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00080000:0.0:1763334961.449505:0:32232:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x181:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1763334961.449697:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992ae lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449708:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992ae lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449716:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992ae lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449723:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.449729:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992ae lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449738:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992ae lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449748:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334961.449751:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763334961.449756:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992ae lrc: 2/0,0 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449762:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992ae lrc: 0/0,0 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449777:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84992a0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449787:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84992a0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449793:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84992a0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449798:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.449801:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84992a0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449807:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84992a0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449814:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.449816:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.449819:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84992a0 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.449826:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84992a0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:0.0:1763334961.449835:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002a651781 reply state 00000000d4284418 transno 8589938617 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84992a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334961.449844:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334961.449930:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52970:x1848989694340224:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1171us (2222us total) trans 8589938617 rc 0/0 00000100:00100000:0.0:1763334961.449940:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4358 00000100:00100000:0.0:1763334961.462666:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.462789:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694340480 00000100:00100000:1.0:1763334961.462805:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694340480 00000100:00100000:1.0:1763334961.462890:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1612 00000100:00100000:1.0:1763334961.462904:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52965:x1848989694340480:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:1.0:1763334961.463020:0:29630:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x181:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499292 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af298 expref: 176 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.463071:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84992b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334961.463086:0:29630:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84992b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334961.463096:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84992b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000004:00020000:1.0:1763334961.463464:0:29630:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000404:0x181:0x0]: rc = -1 00010000:00010000:1.0:1763334961.463536:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84992b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334961.463545:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84992b5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334961.463552:0:29630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84992b5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334961.463559:0:29630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.463563:0:29630:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84992b5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334961.463614:0:29630:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84992b5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x181:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334961.463634:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:1.0:1763334961.463638:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1763334961.463646:0:29630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84992b5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334961.463653:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84992b5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x181:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334961.463666:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:1.0:1763334961.463669:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334961.463674:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499292 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x181:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af298 expref: 176 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.463698:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84992a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.463706:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84992a7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.463716:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84992a7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.463720:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334961.463723:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84992a7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.463728:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84992a7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.463737:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad29c0200) 00010000:00010000:3.0:1763334961.463740:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334961.463742:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84992a7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.463748:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84992a7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334961.463919:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52965:x1848989694340480:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1017us (1269us total) trans 8589938618 rc -1/-1 00000100:00100000:1.0:1763334961.463930:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1612 00000100:00100000:2.0:1763334961.481356:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.481492:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694340608 00000100:00100000:1.0:1763334961.481507:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694340608 00000100:00100000:1.0:1763334961.487515:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4359 00000100:00100000:1.0:1763334961.487554:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52965:x1848989694340608:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.487611:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.487650:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84992bc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af29f expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.487741:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84992bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af29f expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.487757:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478600/0xcedf0054f84992bc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x181:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af29f expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.487781:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ad2829400) 00010000:00010000:1.0:1763334961.487785:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334961.487790:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478600, rc 0) 00000100:00100000:1.0:1763334961.487878:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52965:x1848989694340608:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 345us (6570us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334961.487886:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4359 00000100:00100000:3.0:1763334961.494802:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.495116:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694340864 00000100:00100000:0.0:1763334961.495131:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694340864 00000100:00100000:0.0:1763334961.495212:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1613 00000100:00100000:0.0:1763334961.495224:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52965:x1848989694340864:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:0.0:1763334961.496033:0:29631:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x181:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763334961.496144:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1014, 64 off87688 00000040:00080000:0.0:1763334961.496172:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1003, 64 off86624 00000040:00080000:0.0:1763334961.496187:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1004, 64 off86688 00000040:00080000:0.0:1763334961.496202:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1015, 64 off87752 00010000:00010000:2.0:1763334961.497716:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992c3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x181:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334961.497749:0:29631:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992c3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334961.497767:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992c3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334961.497779:0:29631:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992c3 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334961.497786:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992c3 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334961.497793:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992c3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334961.497824:0:29631:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763334961.497854:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334961.497864:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992c3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334961.497873:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334961.497878:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992c3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334961.497887:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992c3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x181:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334961.497904:0:5737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x181:0x0].0x0 (ffff9a5ad2829400) 00010000:00010000:0.0:1763334961.497907:0:5737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763334961.497912:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992c3 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x181:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334961.497918:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84992c3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x181:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334961.497931:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334961.497933:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334961.497934:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334961.499969:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52965:x1848989694340864:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 4725us (5159us total) trans 8589938619 rc 0/0 00000100:00100000:2.0:1763334961.499989:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1613 00000100:00100000:0.0:1763334961.501000:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.501080:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694340992 00000100:00100000:1.0:1763334961.501095:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694340992 00000100:00100000:1.0:1763334961.501167:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4360 00000100:00100000:1.0:1763334961.501180:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52971:x1848989694340992:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.501209:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.501243:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f84992ca lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af2a6 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.501369:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992d1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501388:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501402:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501422:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501430:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501443:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501537:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501545:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992d1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501552:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992d1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501559:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.501564:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992d1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501618:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992d1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501634:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334961.501638:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.501645:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992d1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501651:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992d1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501666:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501672:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992d8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501677:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501683:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.501685:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501691:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501697:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829c00) 00010000:00010000:1.0:1763334961.501699:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.501701:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992d8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501707:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992d8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.501746:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f84992ca lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2a6 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.501756:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334961.501758:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.501762:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f84992ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2a6 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.501770:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:1.0:1763334961.501836:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52971:x1848989694340992:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 659us (844us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334961.501843:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4360 00000100:00100000:0.0:1763334961.524248:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.524462:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694341120 00000100:00100000:1.0:1763334961.524480:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694341120 00000100:00100000:1.0:1763334961.524595:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4361 00000100:00100000:1.0:1763334961.524610:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52971:x1848989694341120:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.524650:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.524687:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f84992df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af2ad expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.524792:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992e6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.524814:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992e6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.524830:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992e6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.524848:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.524855:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.524861:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.524955:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992e6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.524964:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992e6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.524971:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.524978:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.524983:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.524992:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992e6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.525008:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334961.525012:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.525018:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992e6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.525025:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84992e6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.525039:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.525045:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992ed lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.525049:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.525054:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.525057:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.525062:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992ed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.525070:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829c00) 00010000:00010000:1.0:1763334961.525072:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.525075:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992ed lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.525086:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84992ed lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.525127:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f84992df lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2ad expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.525139:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334961.525141:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.525146:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f84992df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2ad expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.525155:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:1.0:1763334961.525452:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52971:x1848989694341120:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 845us (1220us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334961.525462:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4361 00000100:00100000:3.0:1763334961.527728:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.527929:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694341248 00000100:00100000:1.0:1763334961.527944:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694341248 00000100:00100000:1.0:1763334961.528032:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4362 00000100:00100000:1.0:1763334961.528047:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52971:x1848989694341248:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.528080:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.528114:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84992f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af2b4 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.528237:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84992fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.528458:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84992fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.528481:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84992fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334961.528605:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:1.0:1763334961.528611:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334961.528646:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84992fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.528691:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84992f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2b4 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.528722:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84992fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2b4 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.528732:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334961.528736:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763334961.528741:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334961.530448:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52971:x1848989694341248:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2383us (2712us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334961.530466:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4362 00000100:00100000:0.0:1763334961.535333:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.535461:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694341376 00000100:00100000:1.0:1763334961.535475:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694341376 00000100:00100000:1.0:1763334961.535558:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4363 00000100:00100000:1.0:1763334961.535596:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52971:x1848989694341376:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.535624:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.535655:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499302 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af2bb expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.535756:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499309 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535774:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499309 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535787:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499309 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535803:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499310 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535810:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499310 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535816:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499310 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535908:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499309 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535916:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499309 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535924:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499309 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535931:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.535936:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499309 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535944:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499309 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535963:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334961.535966:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.535972:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499309 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535978:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499309 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535993:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499310 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.535999:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499310 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.536005:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499310 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.536010:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.536013:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499310 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.536020:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499310 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.536027:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829e00) 00010000:00010000:1.0:1763334961.536029:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.536032:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499310 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.536037:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499310 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.536074:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499302 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2bb expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.536086:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334961.536089:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.536092:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499302 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2bb expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.536102:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334961.536184:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52971:x1848989694341376:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 615us (874us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334961.536194:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4363 00000100:00100000:0.0:1763334961.540387:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.540612:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694341632 00000100:00100000:3.0:1763334961.540627:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694341632 00000100:00100000:3.0:1763334961.540703:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4364 00000100:00100000:3.0:1763334961.540715:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52971:x1848989694341632:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334961.540745:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334961.540749:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334961.540789:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84992fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2b4 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.540810:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334961.540817:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334961.540835:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499317 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af2c2 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.541025:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849931e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541042:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849931e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541053:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849931e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541073:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499325 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541079:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499325 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541085:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499325 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541790:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849932c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541802:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849932c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541811:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849932c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334961.541824:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 0 00010000:00010000:3.0:1763334961.541858:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849931e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541870:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849931e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541877:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849931e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541883:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334961.541888:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849931e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541897:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849931e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541907:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334961.541910:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334961.541914:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849931e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334961.541920:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849931e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000004:00010000:3.0:1763334961.541933:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001a6cc527 reply state 000000003d156f4a transno 8589938620 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499325 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334961.541944:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763334961.541985:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499317 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2c2 expref: 180 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.542000:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849932c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2c2 expref: 179 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.542007:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ae1a32100) 00010000:00010000:3.0:1763334961.542010:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334961.542013:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f600, rc 0) 00000100:00100000:3.0:1763334961.542121:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52971:x1848989694341632:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1408us (1748us total) trans 8589938620 rc 0/0 00000100:00100000:3.0:1763334961.542131:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4364 00000100:00100000:1.0:1763334961.549249:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334961.549905:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499325 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.549921:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499325 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.549930:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499325 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.549936:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334961.549941:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499325 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.549950:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499325 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.549971:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32c00) 00010000:00010000:2.0:1763334961.549975:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334961.549981:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499325 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.549987:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499325 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334961.550124:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694341888 00000100:00100000:3.0:1763334961.550138:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694341888 00000100:00100000:3.0:1763334961.554518:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4365 00000100:00100000:3.0:1763334961.554550:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52971:x1848989694341888:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334961.554597:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334961.554626:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849933a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af2c9 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.554764:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.554782:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849932c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2c2 expref: 180 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.554791:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.554839:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849932c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2c2 expref: 180 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.554857:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849932c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2c2 expref: 180 pid: 29629 timeout: 1126 lvb_type: 0 00000100:00100000:3.0:1763334961.554873:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa744700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701796224:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334961.556252:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa8069c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334961.558551:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.558959:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694342144 00000100:00100000:2.0:1763334961.558973:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694342144 00000100:00100000:2.0:1763334961.559040:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4366 00000100:00100000:2.0:1763334961.559053:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52972:x1848989694342144:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334961.559080:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.559109:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499348 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af2d0 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.559234:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849934f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.559251:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849934f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.559264:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849934f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:2.0:1763334961.559278:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 0 00010000:00010000:2.0:1763334961.559426:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849934f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.559436:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849934f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.559444:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849934f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.559451:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334961.559455:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849934f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.559465:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849934f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.559478:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ae1a32100) 00010000:00010000:2.0:1763334961.559482:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334961.559488:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849934f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.559494:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849934f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.559547:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499348 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2d0 expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.559560:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334961.559563:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334961.559567:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499348 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2d0 expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.559616:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:2.0:1763334961.559698:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52972:x1848989694342144:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 647us (1158us total) trans 8589938621 rc 301/301 00000100:00100000:2.0:1763334961.559707:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4366 00000100:00100000:3.0:1763334961.560215:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa744700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701796224:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334961.560241:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334961.561560:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.562518:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.563045:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694342272 00000100:00100000:2.0:1763334961.563058:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694342272 00010000:00010000:2.0:1763334961.563109:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849932c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2c2 expref: 182 pid: 29629 timeout: 1126 lvb_type: 0 00000100:00100000:3.0:1763334961.563211:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694342528 00000100:00100000:3.0:1763334961.563217:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694342528 00000100:00100000:2.0:1763334961.563379:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2394 00000100:00100000:2.0:1763334961.563390:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:2360:x1848989694342272:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334961.563409:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334961.563417:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849932c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2c2 expref: 183 pid: 29629 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.563430:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849932c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2c2 expref: 183 pid: 29629 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.563455:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849932c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2c2 expref: 183 pid: 29629 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.563474:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ae1a32100) 00010000:00010000:2.0:1763334961.563479:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.563488:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.563494:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.563521:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334961.563599:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2360:x1848989694342272:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 211us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.563604:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2394 00000100:00100000:0.0:1763334961.563843:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1614 00000100:00100000:0.0:1763334961.563855:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52972:x1848989694342528:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334961.564117:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52972:x1848989694342528:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 264us (1603us total) trans 8589938622 rc 0/0 00000100:00100000:0.0:1763334961.564124:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1614 00010000:00010000:2.0:1763334961.564487:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.564499:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334961.564517:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 0 00000004:00080000:2.0:1763334961.566995:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x214:0x0], index 0: 0 00000004:00080000:2.0:1763334961.567013:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x218:0x0], index 1: 0 00000004:00080000:2.0:1763334961.567019:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x219:0x0], index 1: 0 00000004:00080000:2.0:1763334961.567024:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x215:0x0], index 0: 0 00010000:00010000:2.0:1763334961.567242:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.567257:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.567266:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.567272:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334961.567278:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.567286:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.567306:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ae1a32100) 00010000:00010000:2.0:1763334961.567309:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334961.567325:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.567332:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499341 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.567426:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849933a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2c9 expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.567438:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334961.567440:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334961.567445:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849933a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2c9 expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.567455:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fc00, rc 0) 00000100:00100000:2.0:1763334961.567545:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52971:x1848989694341888:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 13009us (18312us total) trans 8589938623 rc 301/301 00000100:00100000:2.0:1763334961.567555:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4365 00000100:00100000:0.0:1763334961.568199:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.568419:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694342784 00000100:00100000:3.0:1763334961.568433:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694342784 00000100:00100000:0.0:1763334961.569042:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4367 00000100:00100000:0.0:1763334961.569061:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52972:x1848989694342784:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.569088:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.569115:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499364 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af2d7 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.569216:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849936b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569236:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849936b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569516:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849936b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569542:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499372 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569549:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499372 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569561:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499372 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569763:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499379 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569772:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499379 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569779:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499379 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569922:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849936b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569931:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849936b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569938:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849936b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569944:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.569949:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849936b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569957:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849936b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569969:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.569972:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.569976:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849936b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569982:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849936b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.569997:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499372 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.570004:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499372 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.570010:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499372 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.570016:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.570019:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499372 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.570023:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499372 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.570029:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad29c0500) 00010000:00010000:0.0:1763334961.570031:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.570034:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499372 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.570039:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499372 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.570092:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499364 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2d7 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.570108:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499379 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2d7 expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.570115:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:0.0:1763334961.570119:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334961.570121:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:0.0:1763334961.570218:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52972:x1848989694342784:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1164us (2023us total) trans 8589938624 rc 0/0 00000100:00100000:0.0:1763334961.570228:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4367 00000100:00100000:0.0:1763334961.572057:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.572858:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694343040 00000100:00100000:2.0:1763334961.572875:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694343040 00000100:00100000:2.0:1763334961.572956:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1615 00000100:00100000:2.0:1763334961.572967:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52971:x1848989694343040:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334961.573451:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52971:x1848989694343040:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 484us (1401us total) trans 8589938625 rc 0/0 00000100:00100000:2.0:1763334961.573458:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1615 00000100:00100000:2.0:1763334961.577822:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.577936:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.578095:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694343424 00000100:00100000:3.0:1763334961.578116:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694343424 00000100:00100000:3.0:1763334961.578223:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1616 00000100:00100000:3.0:1763334961.578241:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52971:x1848989694343424:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334961.579153:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52971:x1848989694343424:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 914us (1212us total) trans 8589938626 rc 0/0 00000100:00100000:3.0:1763334961.579162:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1616 00000100:00100000:1.0:1763334961.579871:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694343168 00000100:00100000:1.0:1763334961.579881:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694343168 00000100:00100000:1.0:1763334961.579945:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4526 00000100:00100000:1.0:1763334961.579955:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694343168:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.579971:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.580000:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499387 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af2de expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334961.580034:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x214:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334961.580057:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334961.580059:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334961.580072:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499387 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2de expref: 16 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334961.580092:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499387 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2de expref: 16 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334961.580108:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334961.580164:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694343168:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 211us (4594us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334961.580170:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4526 00000100:00100000:2.0:1763334961.584106:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.584162:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694343680 00000100:00100000:0.0:1763334961.584177:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694343680 00000100:00100000:0.0:1763334961.584256:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1617 00000100:00100000:0.0:1763334961.584267:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52972:x1848989694343680:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334961.586753:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52972:x1848989694343680:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 2465us (2638us total) trans 8589938627 rc 0/0 00000100:00100000:0.0:1763334961.586775:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1617 00000100:00100000:2.0:1763334961.588175:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.589325:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.590326:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694343936 00000100:00100000:1.0:1763334961.590344:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694343936 00000100:00100000:0.0:1763334961.590460:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694344192 00000100:00100000:0.0:1763334961.590465:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694344192 00000100:00100000:1.0:1763334961.590716:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4368 00000100:00100000:1.0:1763334961.590730:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694343936:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334961.590760:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.590791:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849938e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af2e5 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.590941:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499395 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334961.591353:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4369 00000100:00100000:2.0:1763334961.591371:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52972:x1848989694344192:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334961.591387:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.591399:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849939c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af2ec expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.591454:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.591470:0:29629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499379 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2d7 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.591480:0:29629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.591527:0:29629:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499379 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2d7 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.591807:0:29629:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499379 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2d7 expref: 189 pid: 30972 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.591826:0:29629:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7219f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701796352:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334961.591962:0:29629:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b780 going to sleep for 11 seconds 00010000:00010000:1.0:1763334961.592531:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499395 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.592545:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499395 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334961.596683:0:29629:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7219f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701796352:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334961.596736:0:29629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:2.0:1763334961.596873:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.597061:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694344320 00000100:00100000:0.0:1763334961.597072:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694344320 00010000:00010000:0.0:1763334961.597119:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499379 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2d7 expref: 190 pid: 30972 timeout: 1126 lvb_type: 0 00000100:00100000:0.0:1763334961.597166:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2395 00000100:00100000:0.0:1763334961.597177:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:2360:x1848989694344320:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334961.597197:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334961.597205:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499379 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2d7 expref: 190 pid: 30972 timeout: 1126 lvb_type: 0 00010000:00010000:0.0:1763334961.597218:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499379 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2d7 expref: 190 pid: 30972 timeout: 1126 lvb_type: 0 00010000:00010000:0.0:1763334961.597249:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499379 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2d7 expref: 190 pid: 30972 timeout: 1126 lvb_type: 0 00010000:00010000:0.0:1763334961.597266:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:0.0:1763334961.597272:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.597283:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.597291:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.597298:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499395 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.597305:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499395 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.597319:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499395 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.597361:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334961.597445:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2360:x1848989694344320:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 266us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334961.597454:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2395 00010000:00010000:1.0:1763334961.597477:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499395 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.597486:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499395 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.597517:0:29629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:1.0:1763334961.597517:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 0 00010000:00010000:3.0:1763334961.597523:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334961.597536:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 0 00010000:00010000:3.0:1763334961.597736:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849939c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2ec expref: 190 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.597760:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2ec expref: 189 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.597767:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:3.0:1763334961.597770:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763334961.597819:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066c00, rc 0) 00000100:00100000:3.0:1763334961.597865:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+189:52972:x1848989694344192:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6501us (8557us total) trans 8589938628 rc 0/0 00000100:00100000:3.0:1763334961.597872:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4369 00010000:00010000:1.0:1763334961.597977:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849938e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2e5 expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.597993:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499395 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2e5 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.598000:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:1.0:1763334961.598003:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334961.598005:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:1.0:1763334961.598038:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:52274:x1848989694343936:12345-192.168.201.60@tcp:101:bash.0 Request processed in 7311us (9876us total) trans 8589938629 rc 0/0 00000100:00100000:1.0:1763334961.598046:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4368 00000100:00100000:2.0:1763334961.601065:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.601112:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.601302:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694344576 00000100:00100000:0.0:1763334961.601326:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694344576 00000100:00100000:0.0:1763334961.601420:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694344704 00000100:00100000:0.0:1763334961.601424:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694344704 00000100:00100000:0.0:1763334961.601444:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1618 00000100:00100000:2.0:1763334961.601754:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.601892:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1619 00000100:00100000:0.0:1763334961.601900:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694344832 00000100:00100000:3.0:1763334961.601904:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52972:x1848989694344704:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:0.0:1763334961.601904:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694344832 00000100:00100000:0.0:1763334961.601937:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 381 00000100:00100000:0.0:1763334961.601944:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:2362:x1848989694344832:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334961.601963:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334961.601993:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499395 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2e5 expref: 191 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.602014:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:0.0:1763334961.602019:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334961.602079:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52972:x1848989694344704:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 180us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334961.602079:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:2362:x1848989694344832:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 135us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334961.602088:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1619 00000100:00100000:0.0:1763334961.602088:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 381 00000100:00100000:0.0:1763334961.602113:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694344576:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:0.0:1763334961.602336:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:52274:x1848989694344576:12345-192.168.201.60@tcp:35:bash.0 Request processed in 443us (1288us total) trans 8589938630 rc 0/0 00000100:00100000:0.0:1763334961.602343:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1618 00000100:00100000:2.0:1763334961.605331:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.605397:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694345088 00000100:00100000:1.0:1763334961.605413:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694345088 00000100:00100000:1.0:1763334961.605506:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4370 00000100:00100000:1.0:1763334961.605516:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:52274:x1848989694345088:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1763334961.605974:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84993b8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.605999:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84993b8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.606013:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84993b8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:1.0:1763334961.606076:0:29627:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938631 00000004:00010000:1.0:1763334961.606103:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007298c1d7 reply state 000000001928a149 transno 8589938632 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84993b8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334961.606114:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334961.606539:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52274:x1848989694345088:12345-192.168.201.60@tcp:36:bash.0 Request processed in 1021us (1235us total) trans 8589938632 rc 0/0 00000100:00100000:1.0:1763334961.606551:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4370 00000020:00080000:1.0:1763334961.606559:0:29627:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763334961.610501:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84993b8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.610528:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84993b8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.610539:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84993b8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.610547:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334961.610554:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84993b8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.610566:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84993b8 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334961.610776:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334961.610873:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:3.0:1763334961.610878:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334961.610885:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84993b8 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.610892:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84993b8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334961.612456:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694345216 00000100:00100000:2.0:1763334961.612482:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694345216 00000100:00100000:2.0:1763334961.612687:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4371 00000100:00100000:2.0:1763334961.612701:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52274:x1848989694345216:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334961.612742:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.612776:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84993bf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af2f3 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.612862:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84993bf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2f3 expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.612879:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84993bf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2f3 expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.612907:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:2.0:1763334961.612910:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334961.612914:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:2.0:1763334961.614462:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52274:x1848989694345216:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1240us (3169us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.614477:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4371 00000100:00100000:1.0:1763334961.626891:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.626980:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.627131:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694345472 00000100:00100000:3.0:1763334961.627147:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694345472 00000100:00100000:3.0:1763334961.627229:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694345728 00000100:00100000:3.0:1763334961.627233:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694345728 00000100:00100000:3.0:1763334961.627263:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4372 00000100:00100000:3.0:1763334961.627276:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52274:x1848989694345472:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334961.627307:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334961.627319:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334961.627367:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84993bf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2f3 expref: 193 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.627393:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:3.0:1763334961.627401:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334961.627420:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84993c6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af2fa expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.627495:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84993cd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.627512:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84993cd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334961.627526:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84993cd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000040:00080000:3.0:1763334961.628026:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1005, 88 off86776 00000004:00080000:3.0:1763334961.628037:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1026261464077ns, next at 1026752974522ns, rc = 0 00000040:00080000:3.0:1763334961.628068:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1016, 88 off87840 00000004:00080000:3.0:1763334961.628075:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1026261502507ns, next at 1026753065722ns, rc = 0 00000040:00080000:3.0:1763334961.628094:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1017, 88 off87928 00000004:00080000:3.0:1763334961.628098:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1026261526608ns, next at 1026753065722ns, rc = 0 00000040:00080000:3.0:1763334961.628113:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1006, 88 off86864 00000004:00080000:3.0:1763334961.628117:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1026261545071ns, next at 1026752974522ns, rc = 0 00000100:00100000:0.0:1763334961.628501:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4373 00000100:00100000:0.0:1763334961.628517:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:52973:x1848989694345728:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.628534:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.628555:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84993d4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af301 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.628681:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84993db lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.628694:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84993db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.628706:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84993db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.628720:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84993e2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.628726:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84993e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.628731:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84993e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.628867:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84993e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.628878:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84993e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.628885:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84993e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334961.628898:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 2 00010000:00010000:0.0:1763334961.629043:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84993e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629051:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84993e9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629058:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84993e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629064:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.629069:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84993e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629078:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84993e9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629091:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:0.0:1763334961.629093:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1763334961.629098:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84993e9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629104:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84993e9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629119:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84993db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629124:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84993db lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629129:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84993db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629133:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.629135:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84993db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629141:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84993db lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629148:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.629150:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.629153:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84993db lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629158:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f84993db lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629167:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84993e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629172:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84993e2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629177:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84993e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629181:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.629184:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84993e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629190:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84993e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629197:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad29c0500) 00010000:00010000:0.0:1763334961.629199:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.629201:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84993e2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629206:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f84993e2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334961.629252:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84993d4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af301 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.629263:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.629265:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334961.629268:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84993d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af301 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.629282:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334961.629402:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52973:x1848989694345728:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 888us (2419us total) trans 8589938634 rc 301/301 00000100:00100000:0.0:1763334961.629411:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4373 00000100:00100000:3.0:1763334961.641421:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.642297:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694345856 00000100:00100000:1.0:1763334961.644637:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694345856 00000100:00100000:1.0:1763334961.644789:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4374 00000100:00100000:1.0:1763334961.645393:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52973:x1848989694345856:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.645429:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.645465:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84993f7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af308 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.645623:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.645643:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2ec expref: 196 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.645653:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84993cd lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.645661:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 5/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.645687:0:32232:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84993cd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.645728:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2ec expref: 196 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.645752:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2ec expref: 196 pid: 29629 timeout: 1126 lvb_type: 0 00000100:00100000:1.0:1763334961.645770:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701796480:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334961.645921:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e7c240 going to sleep for 11 seconds 00000100:00100000:2.0:1763334961.652432:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.653064:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694345984 00000100:00100000:3.0:1763334961.653078:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694345984 00000100:00100000:1.0:1763334961.653097:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701796480:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334961.653126:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2ec expref: 197 pid: 29629 timeout: 1126 lvb_type: 0 00010000:00010000:1.0:1763334961.653133:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334961.653189:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2396 00000100:00100000:3.0:1763334961.653200:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694345984:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334961.653219:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334961.653227:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2ec expref: 197 pid: 29629 timeout: 1126 lvb_type: 0 00010000:00010000:3.0:1763334961.653240:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2ec expref: 197 pid: 29629 timeout: 1126 lvb_type: 0 00010000:00010000:3.0:1763334961.653282:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84993a3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2ec expref: 197 pid: 29629 timeout: 1126 lvb_type: 0 00010000:00010000:3.0:1763334961.653302:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:3.0:1763334961.653308:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.653328:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.653333:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.653339:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334961.653405:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694345984:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 206us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334961.653414:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2396 00010000:00010000:3.0:1763334961.694640:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84993cd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2fa expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.694667:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:3.0:1763334961.694671:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334961.694676:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.694688:0:29627:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.694694:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.694747:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84993c6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2fa expref: 196 pid: 29627 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763334961.694776:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84993cd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2fa expref: 195 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.694832:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168ee00, rc 0) 00000100:00100000:3.0:1763334961.694935:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52274:x1848989694345472:12345-192.168.201.60@tcp:101:bash.0 Request processed in 67658us (68063us total) trans 8589938633 rc 0/0 00000100:00100000:3.0:1763334961.694948:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4372 00000001:00080000:3.0:1763334961.695017:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938630 is committed 00000001:00080000:3.0:1763334961.695063:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938632 is committed 00000001:00080000:3.0:1763334961.695103:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938633 is committed 00000004:00080000:3.0:1763334961.695109:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 659 committed 00000004:00080000:3.0:1763334961.695119:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 671 committed 00000004:00080000:3.0:1763334961.695127:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 670 committed 00000004:00080000:3.0:1763334961.695130:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 658 committed 00010000:00010000:3.0:1763334961.695160:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.695169:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334961.695213:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 2 00000004:00200000:3.0:1763334961.695220:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334961.695246:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.695281:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84993f7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af308 expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.695299:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af308 expref: 171 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.695307:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:3.0:1763334961.695424:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334961.695428:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478800, rc 0) 00000100:00100000:3.0:1763334961.695465:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52973:x1848989694345856:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 50080us (54066us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334961.695473:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4374 00000100:00100000:2.0:1763334961.696364:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701796992:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334961.696436:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334961.696479:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701797504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334961.696875:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701796736:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334961.696911:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334961.696935:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701797248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334961.696956:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334961.696973:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701797760:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334961.696993:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334961.697019:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1763334961.697025:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701796864:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334961.697044:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334961.697061:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701797376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334961.697080:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334961.697095:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701797888:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334961.697112:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334961.697154:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701796992 00000100:00100000:0.0:1763334961.697165:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701796992 00000100:00100000:0.0:1763334961.697218:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701796736 00000100:00100000:0.0:1763334961.697221:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701796736 00000100:00100000:0.0:1763334961.697239:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701797248 00000100:00100000:0.0:1763334961.697241:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701797248 00000100:00100000:0.0:1763334961.697254:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701797760 00000100:00100000:0.0:1763334961.697256:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701797760 00000100:00100000:0.0:1763334961.697271:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701796864 00000100:00100000:0.0:1763334961.697273:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701796864 00000100:00100000:0.0:1763334961.697283:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701797376 00000100:00100000:0.0:1763334961.697286:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701797376 00000100:00100000:0.0:1763334961.697294:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701797888 00000100:00100000:0.0:1763334961.697296:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701797888 00000100:00100000:0.0:1763334961.697324:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4527 00000100:00100000:0.0:1763334961.697334:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701796992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334961.697370:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:531 count 1 00002000:00010000:0.0:1763334961.697421:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x213:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334961.697432:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499405 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.697453:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.697455:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.697463:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.697480:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334961.697752:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701796608:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334961.697795:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334961.697810:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701797120:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334961.697829:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334961.697838:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701797632:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334961.697858:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334961.697885:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701796608 00000100:00100000:3.0:1763334961.697890:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701796608 00000100:00100000:3.0:1763334961.698002:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701797120 00000100:00100000:3.0:1763334961.698006:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701797120 00000100:00100000:3.0:1763334961.698016:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701797632 00000100:00100000:3.0:1763334961.698018:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701797632 00000100:00100000:3.0:1763334961.698030:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4528 00000100:00100000:3.0:1763334961.698038:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3291:x1848989701796736:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334961.698053:0:25383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:527 count 1 00010000:00010000:3.0:1763334961.698070:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.698090:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499142 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af228 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.698105:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334961.698108:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334961.698111:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.698151:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499142 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af228 expref: 15 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.698169:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499142 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af228 expref: 15 pid: 6517 timeout: 1126 lvb_type: 0 00000100:00100000:3.0:1763334961.698186:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701798144:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334961.698269:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa8066c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334961.698291:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4529 00000100:00100000:3.0:1763334961.698299:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3291:x1848989701797248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334961.698641:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334961.698662:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701798016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334961.698680:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334961.698712:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701797504 00000100:00100000:2.0:1763334961.698716:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701797504 00000100:00100000:2.0:1763334961.698739:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701798016 00000100:00100000:2.0:1763334961.698741:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701798016 00000100:00100000:2.0:1763334961.698749:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4530 00000100:00100000:2.0:1763334961.698754:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3291:x1848989701797760:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763334961.698769:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:535 count 1 00002000:00010000:2.0:1763334961.698802:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x217:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334961.698808:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f8499413 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.698819:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.698822:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.698826:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f8499413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.698841:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f8499413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.698851:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f8499413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.698860:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f8499413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.698883:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334961.699166:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+32:3291:x1848989701797760:12345-0@lo:6:osp-syn-1-0.0 Request processed in 410us (2170us total) trans 17179870963 rc 0/0 00000100:00100000:2.0:1763334961.699174:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4530 00000100:00100000:2.0:1763334961.699198:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4531 00000100:00100000:2.0:1763334961.699204:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3291:x1848989701796864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334961.699216:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:530 count 1 00010000:00010000:2.0:1763334961.699233:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.699248:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499284 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af291 expref: 15 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.699255:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334961.699257:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334961.699260:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.699286:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499284 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af291 expref: 15 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.699298:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499284 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af291 expref: 15 pid: 26216 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.699330:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701798272:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334961.699373:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334961.699401:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4532 00000100:00100000:2.0:1763334961.699412:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3291:x1848989701797376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763334961.699426:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:530 count 1 00010000:00010000:2.0:1763334961.699441:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.699455:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849908c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1e9 expref: 27 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334961.699461:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.699462:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.699465:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.699617:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499405 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.699628:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.699648:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763334961.699896:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3289:x1848989701796992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2562us (3459us total) trans 21474838245 rc 0/0 00000100:00100000:0.0:1763334961.699909:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4527 00000100:00100000:0.0:1763334961.699933:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4533 00000100:00100000:0.0:1763334961.699942:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+31:3291:x1848989701797888:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334961.700121:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+32:3291:x1848989701797888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (3006us total) trans 17179870964 rc 0/0 00000100:00100000:0.0:1763334961.700128:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4533 00000100:00100000:0.0:1763334961.700146:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4534 00000100:00100000:0.0:1763334961.700154:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3290:x1848989701796608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334961.700169:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:526 count 1 00010000:00010000:0.0:1763334961.700185:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.700201:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af18e expref: 15 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.700209:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334961.700211:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334961.700214:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.700239:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af18e expref: 15 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.700250:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af18e expref: 15 pid: 26564 timeout: 1126 lvb_type: 0 00000100:00100000:0.0:1763334961.700262:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5575f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701798528:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334961.700304:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afad853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334961.700344:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4535 00000100:00100000:0.0:1763334961.700353:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3290:x1848989701797120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334961.700471:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334961.700474:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763334961.700477:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334961.700479:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763334961.700482:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334961.701228:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4536 00000100:00100000:1.0:1763334961.701247:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3290:x1848989701797632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763334961.701270:0:6518:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:534 count 1 00010000:00010000:1.0:1763334961.701290:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.701307:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849925a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af27c expref: 27 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.701328:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334961.701330:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334961.701334:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.701366:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849925a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af27c expref: 27 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.701383:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849925a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af27c expref: 27 pid: 26216 timeout: 1126 lvb_type: 0 00000100:00100000:1.0:1763334961.701398:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701798656:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334961.701481:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c58aac00 going to sleep for 11 seconds 00000100:00100000:3.0:1763334961.701956:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3291:x1848989701797248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3655us (4996us total) trans 21474838247 rc 0/0 00000100:00100000:3.0:1763334961.701966:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4529 00000100:00100000:3.0:1763334961.701998:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4537 00000100:00100000:3.0:1763334961.702007:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3289:x1848989701797504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334961.702021:0:32239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:531 count 1 00010000:00010000:3.0:1763334961.702039:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.702053:0:32239:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af236 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.702063:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334961.702065:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334961.702067:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.702088:0:32239:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af236 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.702098:0:32239:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499157 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af236 expref: 27 pid: 6519 timeout: 1126 lvb_type: 0 00000100:00100000:3.0:1763334961.702109:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:32239:1848989701798784:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334961.702140:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa806b40 going to sleep for 11 seconds 00010000:00010000:2.0:1763334961.702201:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849908c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1e9 expref: 27 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334961.702218:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849908c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1e9 expref: 27 pid: 6518 timeout: 1126 lvb_type: 1 00000100:00100000:2.0:1763334961.702230:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701798400:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334961.702263:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1763334961.702365:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3290:x1848989701797120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2011us (4532us total) trans 21474838246 rc 0/0 00000100:00100000:0.0:1763334961.702374:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4535 00000100:00100000:0.0:1763334961.702396:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4538 00000100:00100000:0.0:1763334961.702404:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3289:x1848989701798016:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1763334961.703433:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763334961.703451:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f8499413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.703467:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334961.703473:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f8499413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.703485:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f8499413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.703713:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f8499413 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.703722:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f8499413 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.703754:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334961.703761:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.703776:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334961.703780:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499405 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.703787:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499405 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.703798:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499405 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.703805:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499405 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.703825:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334961.703827:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334961.703829:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334961.703945:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334961.705376:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81fea00/2, rc 0, transno 21474838246 00000004:00080000:2.0:1763334961.705869:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81fdc00/2, rc 0, transno 17179870964 00000100:00100000:2.0:1763334961.705878:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701797888:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763334961.705894:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81ff800/2, rc 0, transno 21474838247 00000100:00100000:2.0:1763334961.705898:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701797248:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334961.705910:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81fd500/2, rc 0, transno 17179870963 00000100:00100000:2.0:1763334961.705914:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701797760:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1763334961.705941:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab37480/2, rc 0, transno 21474838245 00000100:00100000:2.0:1763334961.705947:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701796992:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334961.706029:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3289:x1848989701798016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3622us (7343us total) trans 17179870965 rc 0/0 00000100:00100000:0.0:1763334961.706043:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4538 00000004:00080000:2.0:1763334961.706333:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81fd180/2, rc 0, transno 17179870965 00000100:00100000:2.0:1763334961.706339:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701798016:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334961.706484:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701797120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334961.706794:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.706882:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694346112 00000100:00100000:3.0:1763334961.706892:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694346112 00000100:00100000:3.0:1763334961.706997:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4375 00000100:00100000:3.0:1763334961.707008:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52973:x1848989694346112:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334961.707037:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334961.707064:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849943d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af30f expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.707148:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849943d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af30f expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.707170:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849943d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af30f expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.707193:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:3.0:1763334961.707197:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334961.707201:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fe00, rc 0) 00000100:00100000:3.0:1763334961.707944:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52973:x1848989694346112:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 929us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334961.707956:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4375 00000100:00100000:2.0:1763334961.715807:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.715935:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.715962:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.715989:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.716061:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.716086:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.716135:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.716177:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694346368 00000100:00100000:2.0:1763334961.716190:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694346368 00010000:00010000:2.0:1763334961.716254:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499142 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af228 expref: 16 pid: 6517 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.716289:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694346624 00000100:00100000:2.0:1763334961.716292:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694346624 00010000:00010000:2.0:1763334961.716306:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f6d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af18e expref: 17 pid: 26564 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.716329:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694346496 00000100:00100000:2.0:1763334961.716332:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694346496 00010000:00010000:2.0:1763334961.716345:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499284 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af291 expref: 18 pid: 26216 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.716356:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694346880 00000100:00100000:2.0:1763334961.716359:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694346880 00010000:00010000:2.0:1763334961.716376:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499157 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af236 expref: 28 pid: 6519 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.716388:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694347392 00000100:00100000:2.0:1763334961.716391:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694347392 00000100:00100000:2.0:1763334961.716415:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2397 00000100:00100000:2.0:1763334961.716426:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2361:x1848989694346368:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334961.716448:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334961.716455:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499142 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af228 expref: 18 pid: 6517 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.716471:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499142 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af228 expref: 18 pid: 6517 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.716509:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.716513:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.716520:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.716533:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.716560:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334961.716667:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2361:x1848989694346368:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 240us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.716676:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2397 00000100:00100000:2.0:1763334961.716697:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2398 00000100:00100000:2.0:1763334961.716704:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2361:x1848989694346624:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334961.716712:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334961.716716:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f6d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af18e expref: 17 pid: 26564 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.716726:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f6d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af18e expref: 17 pid: 26564 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.716738:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.716740:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.716744:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.716752:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.716765:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334961.716783:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.716785:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2361:x1848989694346624:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 82us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.716791:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2398 00000100:00100000:2.0:1763334961.716801:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694346752 00000100:00100000:2.0:1763334961.716804:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694346752 00010000:00010000:2.0:1763334961.716818:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849925a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af27c expref: 29 pid: 26216 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.716831:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2399 00000100:00100000:2.0:1763334961.716836:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694346496:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334961.716844:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334961.716848:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499284 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af291 expref: 16 pid: 26216 timeout: 1126 lvb_type: 0 00000100:00100000:3.0:1763334961.716858:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334961.716859:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499284 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af291 expref: 16 pid: 26216 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.716871:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.716873:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.716876:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.716885:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.716895:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334961.716915:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d39c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694346496:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 78us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.716926:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2399 00010000:00010000:3.0:1763334961.716986:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499142 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af228 expref: 15 pid: 6517 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.716986:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694347008 00000100:00100000:2.0:1763334961.716990:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694347008 00010000:00010000:2.0:1763334961.717001:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849908c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1e9 expref: 30 pid: 6518 timeout: 1126 lvb_type: 1 00000100:00100000:3.0:1763334961.717006:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701798144:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334961.717012:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2400 00000100:00100000:2.0:1763334961.717017:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2361:x1848989694346880:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334961.717025:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334961.717029:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499157 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af236 expref: 30 pid: 6519 timeout: 1126 lvb_type: 0 00010000:00010000:3.0:1763334961.717033:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717038:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499157 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af236 expref: 30 pid: 6519 timeout: 1126 lvb_type: 0 00010000:00010000:3.0:1763334961.717046:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717053:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334961.717054:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717055:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.717059:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.717065:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717066:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.717076:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717078:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334961.717099:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334961.717101:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2361:x1848989694346880:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 83us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.717107:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2400 00000100:00100000:2.0:1763334961.717124:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2401 00000100:00100000:2.0:1763334961.717129:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2362:x1848989694346752:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334961.717136:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334961.717139:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849925a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af27c expref: 29 pid: 26216 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.717148:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849925a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af27c expref: 29 pid: 26216 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.717159:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.717161:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.717164:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717171:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717180:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334961.717196:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2362:x1848989694346752:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 66us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.717201:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2401 00000100:00100000:2.0:1763334961.717214:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2402 00000100:00100000:2.0:1763334961.717219:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2362:x1848989694347008:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334961.717225:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334961.717230:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849908c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1e9 expref: 28 pid: 6518 timeout: 1126 lvb_type: 1 00010000:00010000:2.0:1763334961.717243:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849908c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1e9 expref: 28 pid: 6518 timeout: 1126 lvb_type: 1 00010000:00010000:2.0:1763334961.717255:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.717257:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.717260:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717268:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717280:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334961.717297:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2362:x1848989694347008:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 77us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.717303:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2402 00000100:00100000:2.0:1763334961.717329:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 382 00000100:00100000:2.0:1763334961.717336:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+172:2361:x1848989694347392:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334961.717346:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334961.717363:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849943d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af30f expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717377:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:2.0:1763334961.717383:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334961.717400:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+171:2361:x1848989694347392:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 65us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.717406:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 382 00010000:00010000:2.0:1763334961.717457:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849925a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af27c expref: 27 pid: 26216 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.717469:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701798656:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334961.717487:0:6518:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717495:0:6518:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717502:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717510:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717517:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.717534:0:6518:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763334961.717897:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3290:x1848989701797632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16657us (20036us total) trans 17179870966 rc 0/0 00000100:00100000:2.0:1763334961.717906:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4536 00000100:00100000:2.0:1763334961.717925:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694346240 00000100:00100000:2.0:1763334961.717930:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694346240 00000100:00100000:2.0:1763334961.717961:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4539 00000100:00100000:2.0:1763334961.717969:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+15:52274:x1848989694346240:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334961.717987:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.718003:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af316 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718024:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499387 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2de expref: 16 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334961.718032:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.718034:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.718037:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718067:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499387 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2de expref: 16 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334961.718079:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499387 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2de expref: 16 pid: 26564 timeout: 1126 lvb_type: 1 00000100:00100000:2.0:1763334961.718094:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8419180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6518:1848989701798912:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334961.718157:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334961.718181:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694347264 00000100:00100000:2.0:1763334961.718185:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694347264 00000100:00100000:2.0:1763334961.718210:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1620 00000100:00100000:2.0:1763334961.718216:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+171:52973:x1848989694347264:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334961.718448:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52973:x1848989694347264:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 231us (2359us total) trans 8589938635 rc 0/0 00000100:00100000:2.0:1763334961.718454:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1620 00010000:00010000:2.0:1763334961.718510:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763334961.718518:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718527:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334961.718532:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718542:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718556:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718563:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849940c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718612:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334961.718616:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718622:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334961.718625:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718631:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718647:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718654:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849942f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718667:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334961.718669:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334961.718670:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334961.718718:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81ff480/2, rc 0, transno 17179870966 00000100:00100000:2.0:1763334961.718726:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701797632:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763334961.718860:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792200/0xcedf0054f8498f6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af18e expref: 16 pid: 26564 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.718870:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5575f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701798528:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334961.718890:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718899:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718907:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718915:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718922:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.718942:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334961.719093:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3290:x1848989701796608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18940us (21296us total) trans 21474838249 rc 0/0 00000100:00100000:2.0:1763334961.719101:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4534 00010000:00010000:2.0:1763334961.719121:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334961.719127:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.719134:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334961.719137:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.719144:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.719154:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.719160:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499428 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.719171:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334961.719173:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334961.719174:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334961.719193:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab34a80/2, rc 0, transno 21474838249 00000100:00100000:2.0:1763334961.719198:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701796608:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763334961.719222:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849908c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af1e9 expref: 26 pid: 6518 timeout: 1126 lvb_type: 1 00000100:00100000:2.0:1763334961.719231:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8418e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701798400:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334961.719244:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.719251:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.719258:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.719266:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.719273:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.719289:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334961.719511:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499284 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af291 expref: 15 pid: 26216 timeout: 1126 lvb_type: 0 00000100:00100000:1.0:1763334961.719523:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701798272:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334961.719535:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.719543:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.719555:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.719562:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.719568:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.719605:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763334961.719756:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3291:x1848989701796736:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21716us (22841us total) trans 21474838248 rc 0/0 00000100:00100000:3.0:1763334961.719765:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4528 00000100:00100000:1.0:1763334961.719767:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3291:x1848989701796864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20563us (22721us total) trans 21474838250 rc 0/0 00000100:00100000:1.0:1763334961.719772:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4531 00010000:00010000:3.0:1763334961.719791:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763334961.719797:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.719804:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334961.719808:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.719816:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.719829:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.719837:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499421 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.719853:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334961.719856:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.719863:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334961.719866:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.719874:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.719883:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.719890:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849941a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334961.719902:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334961.719903:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334961.719905:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334961.719933:0:32239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499157 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af236 expref: 25 pid: 6519 timeout: 1126 lvb_type: 0 00010000:00010000:0.0:1763334961.720013:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334961.720020:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334961.720045:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab34000/2, rc 0, transno 21474838250 00000100:00100000:0.0:1763334961.720049:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701796864:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1763334961.720058:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab35f80/2, rc 0, transno 21474838248 00000100:00100000:0.0:1763334961.720061:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701796736:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334961.722184:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3291:x1848989701797376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22765us (25093us total) trans 17179870967 rc 0/0 00000100:00100000:0.0:1763334961.722206:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4532 00000004:00080000:1.0:1763334961.722370:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81fd880/2, rc 0, transno 17179870967 00000100:00100000:1.0:1763334961.722379:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701797376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334961.724165:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:32239:1848989701798784:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334961.724206:0:32239:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.724261:0:32239:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.724271:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.724283:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.724291:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.724335:0:32239:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334961.725062:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334961.725075:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.725092:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fc00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334961.725098:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.725109:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.725137:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.725146:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499436 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.725166:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334961.725168:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334961.725170:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763334961.726139:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81fca80/2, rc 0, transno 17179870968 00000100:00100000:1.0:1763334961.726156:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701797504:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334961.726220:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3289:x1848989701797504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 24212us (27577us total) trans 17179870968 rc 0/0 00000100:00100000:0.0:1763334961.726234:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4537 00000100:00100000:2.0:1763334961.726769:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8419180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6518:1848989701798912:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334961.726811:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.726840:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:2.0:1763334961.726921:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+14:52274:x1848989694346240:12345-192.168.201.60@tcp:101:bash.0 Request processed in 8952us (11132us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.726930:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4539 00000100:00100000:2.0:1763334961.731206:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.731300:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694347520 00000100:00100000:1.0:1763334961.731325:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694347520 00010000:00010000:1.0:1763334961.731392:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499387 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2de expref: 14 pid: 26564 timeout: 1126 lvb_type: 1 00000100:00100000:1.0:1763334961.731447:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2403 00000100:00100000:1.0:1763334961.731460:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694347520:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334961.731483:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334961.731503:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499387 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2de expref: 14 pid: 26564 timeout: 1126 lvb_type: 1 00010000:00010000:1.0:1763334961.731522:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499387 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2de expref: 14 pid: 26564 timeout: 1126 lvb_type: 1 00010000:00010000:1.0:1763334961.731560:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499387 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2de expref: 14 pid: 26564 timeout: 1126 lvb_type: 1 00010000:00010000:1.0:1763334961.731611:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334961.731615:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334961.731628:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.731640:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.731704:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 13 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334961.731725:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701799040:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334961.731857:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c58aa540 going to sleep for 11 seconds 00000100:00100000:0.0:1763334961.740101:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.743072:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694347648 00000100:00100000:2.0:1763334961.743095:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694347648 00000100:00100000:2.0:1763334961.743206:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4376 00000100:00100000:2.0:1763334961.743218:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52973:x1848989694347648:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334961.743675:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.743711:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849944b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af31d expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.743806:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499452 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.743824:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499452 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.743836:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499452 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.743852:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499459 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.743859:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499459 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.743866:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499459 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744013:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499460 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744022:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499460 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744029:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499460 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334961.744070:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 2 00000004:00200000:2.0:1763334961.744075:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334961.744094:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499460 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744106:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499460 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744114:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499452 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744121:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499452 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744128:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499452 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744134:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334961.744140:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499452 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744148:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499452 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744162:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334961.744166:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334961.744172:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499452 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744178:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499452 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744193:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499459 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744200:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499459 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744206:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499459 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744211:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334961.744214:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499459 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744219:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499459 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744227:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab600) 00010000:00010000:2.0:1763334961.744230:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334961.744233:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499459 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744238:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499459 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.744278:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849944b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af31d expref: 174 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.744293:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499460 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af31d expref: 173 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.744301:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:2.0:1763334961.744304:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334961.744307:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067400, rc 0) 00000100:00100000:2.0:1763334961.744415:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52973:x1848989694347648:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1198us (4334us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.744426:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4376 00000100:00100000:0.0:1763334961.751456:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.751461:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701799040:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334961.751501:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334961.751526:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694347776 00000100:00100000:3.0:1763334961.751536:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694347776 00000100:00100000:1.0:1763334961.751594:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694347520:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 20135us (20403us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334961.751606:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2403 00000100:00100000:3.0:1763334961.751617:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4540 00000100:00100000:3.0:1763334961.751629:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+25:52274:x1848989694347776:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334961.751654:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.752472:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499467 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af324 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334961.752514:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x218:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334961.752546:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334961.752548:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334961.752562:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af324 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.752619:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af324 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.752636:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334961.752699:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+26:52274:x1848989694347776:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1073us (1259us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334961.752709:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4540 00000100:00100000:1.0:1763334961.760878:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.760944:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.761004:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694348032 00000100:00100000:0.0:1763334961.761018:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694348032 00002000:00010000:0.0:1763334961.761082:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/536 (0->18446744073709551615) 00002000:00100000:0.0:1763334961.761089:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeefe7b80 with x1848989694348032 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334961.761107:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeefe7b80. 00000100:00100000:0.0:1763334961.761140:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694347904 00000100:00100000:0.0:1763334961.761143:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694347904 00002000:00010000:0.0:1763334961.761158:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/532 (0->18446744073709551615) 00002000:00100000:0.0:1763334961.761161:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeefe6d80 with x1848989694347904 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334961.761169:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeefe6d80. 00000100:00100000:1.0:1763334961.761172:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1686 00000100:00100000:1.0:1763334961.761189:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694348032:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:0.0:1763334961.761271:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1687 00000100:00100000:0.0:1763334961.761279:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2359:x1848989694347904:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334961.761635:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334961.761635:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334961.761639:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb mtime from disk: 0 -> 1763334962 00002000:00010000:0.0:1763334961.761639:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb mtime from disk: 0 -> 1763334962 00002000:00010000:1.0:1763334961.761642:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334961.761642:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334961.761646:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb ctime from disk: 0 -> 1763334962 00002000:00010000:0.0:1763334961.761646:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb ctime from disk: 0 -> 1763334962 00002000:00010000:0.0:1763334961.761648:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1763334961.761649:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334961.761812:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694347904:12345-192.168.201.60@tcp:10:bash.0 Request processed in 530us (872us total) trans 21474838251 rc 0/0 00000100:00100000:0.0:1763334961.761820:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1687 00002000:00010000:0.0:1763334961.761825:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/532 (0->18446744073709551615) 00002000:00100000:0.0:1763334961.761828:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeefe6d80 with x1848989694347904 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334961.761833:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeefe6d80. 00000100:00100000:1.0:1763334961.761968:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694348032:12345-192.168.201.60@tcp:10:bash.0 Request processed in 785us (1104us total) trans 17179870969 rc 0/0 00000100:00100000:1.0:1763334961.761979:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1686 00002000:00010000:1.0:1763334961.761982:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/536 (0->18446744073709551615) 00002000:00100000:1.0:1763334961.761984:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeefe7b80 with x1848989694348032 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334961.761988:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeefe7b80. 00000100:00100000:0.0:1763334961.768143:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.768734:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.768881:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694348288 00000100:00100000:3.0:1763334961.768897:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694348288 00000100:00100000:2.0:1763334961.769146:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694348544 00000100:00100000:2.0:1763334961.769152:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694348544 00000100:00100000:2.0:1763334961.769211:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4377 00000100:00100000:2.0:1763334961.769223:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52974:x1848989694348544:12345-192.168.201.60@tcp:101:lfs.0 00000100:00100000:3.0:1763334961.769745:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1621 00000100:00100000:3.0:1763334961.769758:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52274:x1848989694348288:12345-192.168.201.60@tcp:35:bash.0 00010000:00010000:2.0:1763334961.769891:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.769925:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849946e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af32b expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.770018:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499475 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.770036:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499475 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.770051:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499475 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334961.770065:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 2 00010000:00010000:2.0:1763334961.771919:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849946e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af32b expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.771959:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499475 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af32b expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.771969:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:2.0:1763334961.771974:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763334961.771979:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:2.0:1763334961.772101:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52974:x1848989694348544:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2878us (3972us total) trans 8589938636 rc 0/0 00000100:00100000:2.0:1763334961.772112:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4377 00000100:00100000:1.0:1763334961.777743:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52274:x1848989694348288:12345-192.168.201.60@tcp:35:bash.0 Request processed in 7969us (8993us total) trans 8589938637 rc 0/0 00000100:00100000:1.0:1763334961.777763:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1621 00000100:00100000:0.0:1763334961.778076:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.778381:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694348800 00000100:00100000:2.0:1763334961.778397:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694348800 00000100:00100000:2.0:1763334961.778471:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4378 00000100:00100000:2.0:1763334961.778482:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52974:x1848989694348800:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334961.778510:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.778541:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499483 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af332 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.778726:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.778746:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af308 expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.778756:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499460 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af31d expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.778765:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 5/0,1 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.778809:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499460 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af31d expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.778824:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499460 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af31d expref: 177 pid: 32232 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.778841:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701799168:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334961.778954:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af308 expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.778963:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af308 expref: 177 pid: 32232 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.778972:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701799296:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334961.778997:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1763334961.789099:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.789202:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.789369:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694349056 00000100:00100000:1.0:1763334961.789384:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694349056 00010000:00010000:1.0:1763334961.789456:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af308 expref: 178 pid: 32232 timeout: 1126 lvb_type: 0 00000100:00100000:1.0:1763334961.789519:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694348928 00000100:00100000:1.0:1763334961.789522:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694348928 00010000:00010000:1.0:1763334961.789537:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499460 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af31d expref: 179 pid: 32232 timeout: 1126 lvb_type: 0 00000100:00100000:1.0:1763334961.789562:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2404 00000100:00100000:1.0:1763334961.789605:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+179:2359:x1848989694349056:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334961.789626:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334961.789634:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af308 expref: 179 pid: 32232 timeout: 1126 lvb_type: 0 00010000:00010000:1.0:1763334961.789648:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af308 expref: 179 pid: 32232 timeout: 1126 lvb_type: 0 00010000:00010000:1.0:1763334961.789682:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:1.0:1763334961.789689:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.789699:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.789707:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334961.789777:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+179:2359:x1848989694349056:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 204us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334961.789785:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2404 00000100:00100000:1.0:1763334961.789806:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2405 00000100:00100000:1.0:1763334961.789814:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2359:x1848989694348928:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334961.789821:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334961.789826:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499460 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af31d expref: 178 pid: 32232 timeout: 1126 lvb_type: 0 00010000:00010000:1.0:1763334961.789837:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499460 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af31d expref: 178 pid: 32232 timeout: 1126 lvb_type: 0 00010000:00010000:1.0:1763334961.789847:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:1.0:1763334961.789851:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.789860:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.789869:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.789890:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334961.789907:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88ef450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2359:x1848989694348928:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 95us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334961.789914:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2405 00010000:00010000:2.0:1763334961.790339:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499460 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af31d expref: 177 pid: 32232 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.790359:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701799168:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334961.790373:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84993fe lrc: 0/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af308 expref: 176 pid: 32232 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.790382:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701799296:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334961.790410:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.790420:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.790425:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334961.790449:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 5 00010000:00010000:2.0:1763334961.790713:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499483 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af332 expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.790736:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af332 expref: 176 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.790744:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:2.0:1763334961.790747:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334961.790750:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:2.0:1763334961.790804:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52974:x1848989694348800:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 12325us (12730us total) trans 8589938638 rc 0/0 00000100:00100000:2.0:1763334961.790812:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4378 00000100:00100000:0.0:1763334961.792976:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.793215:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694349184 00000100:00100000:2.0:1763334961.793228:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694349184 00000100:00100000:2.0:1763334961.793617:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4379 00000100:00100000:2.0:1763334961.793630:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52975:x1848989694349184:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:2.0:1763334961.793661:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.793691:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8499498 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af339 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.793780:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849949f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.793797:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849949f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.793811:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849949f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.793828:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84994a6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.793838:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84994a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.793843:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84994a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.793999:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84994ad lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.794011:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af332 expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.794021:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84994ad lrc: 4/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.800546:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af332 expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.800591:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af332 expref: 177 pid: 32232 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.800614:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701799424:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334961.800753:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334961.803429:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.803908:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694349312 00000100:00100000:1.0:1763334961.803923:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694349312 00000100:00100000:1.0:1763334961.804001:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4380 00000100:00100000:1.0:1763334961.804014:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52974:x1848989694349312:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.804049:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.804082:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84994b4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af340 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334961.804163:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841a300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701799424:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334961.804195:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84994ad lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.804562:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84994bb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.805113:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84994bb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.805125:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84994bb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334961.805431:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.805530:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694349440 00000100:00100000:0.0:1763334961.805541:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694349440 00010000:00010000:0.0:1763334961.805607:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af332 expref: 180 pid: 32232 timeout: 1126 lvb_type: 0 00000100:00100000:0.0:1763334961.805648:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2406 00000100:00100000:0.0:1763334961.805659:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:2359:x1848989694349440:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334961.805676:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334961.805682:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af332 expref: 180 pid: 32232 timeout: 1126 lvb_type: 0 00010000:00010000:0.0:1763334961.805696:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af332 expref: 180 pid: 32232 timeout: 1126 lvb_type: 0 00010000:00010000:0.0:1763334961.805723:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849948a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x183:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af332 expref: 180 pid: 32232 timeout: 1126 lvb_type: 0 00010000:00010000:0.0:1763334961.805742:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:0.0:1763334961.805747:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84994ad lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.805756:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84994ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.805764:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84994ad lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.805772:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84994bb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.805778:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84994bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.805783:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84994bb lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.805822:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334961.805841:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84994ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.805850:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84994ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334961.805897:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 5 00000100:00100000:0.0:1763334961.805899:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:2359:x1848989694349440:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 241us (469us total) trans 0 rc 0/0 00000004:00200000:2.0:1763334961.805902:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:0.0:1763334961.805909:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2406 00000004:00010000:2.0:1763334961.806052:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84994ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806066:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84994ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806076:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849949f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806082:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849949f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806090:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849949f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806096:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334961.806101:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849949f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806108:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849949f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806117:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334961.806120:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334961.806125:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849949f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806130:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849949f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806143:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84994a6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806148:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84994a6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806153:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84994a6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806158:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334961.806161:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84994a6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806166:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84994a6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806174:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab600) 00010000:00010000:2.0:1763334961.806176:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334961.806180:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84994a6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806185:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84994a6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.806224:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8499498 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af339 expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.806237:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84994ad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af339 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.806245:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:2.0:1763334961.806248:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334961.806618:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84994bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.806627:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84994bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334961.806653:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 5 00000004:00200000:1.0:1763334961.806659:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:2.0:1763334961.807364:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067a00, rc 0) 00000004:00010000:0.0:1763334961.807549:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84994bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.807612:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f84994b4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af340 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.807628:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84994bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af340 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.807636:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:0.0:1763334961.807638:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334961.807641:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:0.0:1763334961.807727:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52974:x1848989694349312:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3714us (4312us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334961.807736:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4380 00000100:00100000:0.0:1763334961.810981:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52975:x1848989694349184:12345-192.168.201.60@tcp:101:rm.0 Request processed in 17342us (18008us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334961.810997:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4379 00000100:00100000:2.0:1763334961.820175:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.820247:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694349696 00000100:00100000:1.0:1763334961.820274:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694349696 00000100:00100000:1.0:1763334961.820378:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1622 00000100:00100000:1.0:1763334961.820395:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52974:x1848989694349696:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334961.820498:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.820716:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694349952 00000100:00100000:0.0:1763334961.820723:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694349952 00000100:00100000:0.0:1763334961.820755:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4381 00000100:00100000:0.0:1763334961.820763:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52975:x1848989694349952:12345-192.168.201.60@tcp:36:rm.0 00000100:00100000:1.0:1763334961.820783:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52974:x1848989694349696:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 394us (625us total) trans 8589938639 rc 0/0 00000100:00100000:1.0:1763334961.820790:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1622 00010000:00010000:0.0:1763334961.820804:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763334961.820851:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84994ad lrc: 0/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af339 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.820883:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84994bb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af340 expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.820898:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84993cd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af2fa expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.820912:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:0.0:1763334961.820919:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334961.820958:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994c2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.820976:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994c2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.820986:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994c2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.821003:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84994c9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.821010:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84994c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.821016:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84994c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.821179:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.821191:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499475 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af32b expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.821207:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.821263:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499475 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af32b expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.821281:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499475 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af32b expref: 175 pid: 32232 timeout: 1126 lvb_type: 0 00000100:00100000:0.0:1763334961.821301:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5576a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701799552:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334961.821382:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3571b40 going to sleep for 11 seconds 00000100:00100000:0.0:1763334961.824013:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5576a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701799552:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334961.824055:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334961.824439:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.824501:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694350080 00000100:00100000:2.0:1763334961.824511:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694350080 00010000:00010000:2.0:1763334961.824561:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499475 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af32b expref: 176 pid: 32232 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.824640:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2407 00000100:00100000:2.0:1763334961.824651:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52974:x1848989694350080:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:2.0:1763334961.824672:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334961.824681:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499475 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af32b expref: 176 pid: 32232 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.824694:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499475 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af32b expref: 176 pid: 32232 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.824724:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499475 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af32b expref: 176 pid: 32232 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.824743:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:2.0:1763334961.824748:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.824759:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.824768:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334961.824801:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334961.824817:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.824824:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334961.824872:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52974:x1848989694350080:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 221us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.824880:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2407 00000004:00080000:0.0:1763334961.825425:0:32232:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x183:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763334961.825680:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.825692:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.825699:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.825707:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.825713:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.825722:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.825735:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:0.0:1763334961.825738:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763334961.825742:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.825748:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994d0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.825773:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994c2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.825778:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994c2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.825783:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994c2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.825788:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.825791:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994c2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.825796:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994c2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.825803:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.825806:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.825810:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994c2 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.825815:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994c2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:0.0:1763334961.825824:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eabf195e reply state 00000000a379519b transno 8589938640 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84994c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334961.825835:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334961.825915:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52975:x1848989694349952:12345-192.168.201.60@tcp:36:rm.0 Request processed in 5149us (5424us total) trans 8589938640 rc 0/0 00000100:00100000:0.0:1763334961.825922:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4381 00010000:00010000:1.0:1763334961.828385:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84994c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.828422:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84994c9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.828438:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84994c9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.828447:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.828458:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84994c9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.828472:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84994c9 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.828499:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad29c0300) 00010000:00010000:1.0:1763334961.828502:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.828508:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84994c9 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.828514:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84994c9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334961.829478:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.829883:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694350464 00000100:00100000:0.0:1763334961.829898:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694350464 00000100:00100000:0.0:1763334961.830034:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4382 00000100:00100000:0.0:1763334961.830047:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52974:x1848989694350464:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.830083:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.830117:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84994d7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af347 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.830253:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84994de lrc: 3/0,1 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.830269:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84994de lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.830283:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84994de lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334961.830299:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 5 00010000:00010000:0.0:1763334961.830475:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f84994d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af347 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.830655:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84994de lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af347 expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.830666:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:0.0:1763334961.830669:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334961.830672:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:0.0:1763334961.831619:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52974:x1848989694350464:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1566us (2209us total) trans 8589938641 rc 0/0 00000100:00100000:0.0:1763334961.831631:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4382 00000100:00100000:2.0:1763334961.842715:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.842783:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694350592 00000100:00100000:0.0:1763334961.842800:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694350592 00000100:00100000:0.0:1763334961.842888:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4383 00000100:00100000:0.0:1763334961.842901:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52974:x1848989694350592:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.842939:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.842971:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994ec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af34e expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.843059:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af34e expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.843076:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af34e expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.843101:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:0.0:1763334961.843105:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334961.843110:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:1.0:1763334961.844880:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.845091:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694350720 00000100:00100000:2.0:1763334961.845105:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694350720 00000100:00100000:0.0:1763334961.845369:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52974:x1848989694350592:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2467us (2668us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334961.845382:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4383 00000100:00100000:0.0:1763334961.845414:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4384 00000100:00100000:0.0:1763334961.845424:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52976:x1848989694350720:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.845447:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.845472:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994f3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af355 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.845561:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f84994fa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845607:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f84994fa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845620:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f84994fa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845638:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499501 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845644:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499501 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845650:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499501 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845742:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f84994fa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845750:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f84994fa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845762:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f84994fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845768:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.845772:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f84994fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845781:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f84994fa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845795:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.845798:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.845802:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f84994fa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845808:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f84994fa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845825:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499501 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845830:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499501 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845835:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499501 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845840:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.845842:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499501 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845848:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499501 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845855:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad29c0000) 00010000:00010000:0.0:1763334961.845858:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.845860:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499501 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845865:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499501 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.845906:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994f3 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af355 expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.845918:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.845920:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.845924:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f84994f3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af355 expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.845933:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334961.846006:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52976:x1848989694350720:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 584us (1140us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334961.846013:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4384 00000100:00100000:1.0:1763334961.850906:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.851420:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.851484:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694350976 00000100:00100000:0.0:1763334961.851499:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694350976 00000100:00100000:0.0:1763334961.851613:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4385 00000100:00100000:0.0:1763334961.851626:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52976:x1848989694350976:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.851657:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.851690:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499508 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af35c expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.851794:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849950f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.851812:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849950f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.851826:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849950f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.851841:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499516 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.851848:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499516 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.851853:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499516 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.851942:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849950f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.851950:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849950f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.851958:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849950f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.851965:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.851969:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849950f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.851978:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849950f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.851996:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.851999:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.852006:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849950f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.852012:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849950f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.852027:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499516 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.852033:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499516 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.852039:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499516 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.852044:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.852047:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499516 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.852052:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499516 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.852060:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad29c0a00) 00010000:00010000:0.0:1763334961.852063:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.852065:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499516 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.852071:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499516 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334961.852112:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499508 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af35c expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.852124:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.852126:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.852130:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499508 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af35c expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.852140:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334961.852237:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52976:x1848989694350976:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 613us (818us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334961.852246:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4385 00000100:00100000:2.0:1763334961.852453:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694350848 00000100:00100000:2.0:1763334961.852459:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694350848 00000100:00100000:2.0:1763334961.852507:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4541 00000100:00100000:2.0:1763334961.852516:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef848850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694350848:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334961.852553:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.852592:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.852602:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334961.852605:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334961.852609:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.852653:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.852668:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 14 pid: 6518 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.852686:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6518:1848989701799680:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334961.852779:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1763334961.857407:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.858103:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.858168:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6518:1848989701799680:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334961.858204:0:6518:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334961.858366:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694351232 00000100:00100000:3.0:1763334961.858380:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694351232 00002000:00100000:3.0:1763334961.858454:0:6522:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x214:0x0] (0->4) req@ffff9a5ac5575f80 x1848989694351232/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:7/0 lens 496/0 e 0 to 0 dl 1763334972 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334961.858467:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5575f80 with x1848989694351232 ext(0->4) 00010000:00010000:3.0:1763334961.858478:0:6522:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 15 pid: 6518 timeout: 1126 lvb_type: 0 00010000:00010000:3.0:1763334961.858496:0:6522:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 15 pid: 6518 timeout: 1126 lvb_type: 0 00002000:00010000:3.0:1763334961.858506:0:6522:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a5ac5575f80 00000100:00100000:3.0:1763334961.858545:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 65 00000100:00100000:3.0:1763334961.858557:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694351232:12345-192.168.201.60@tcp:4:bash.0 00000100:00100000:2.0:1763334961.865808:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694351104 00000100:00100000:0.0:1763334961.865819:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694351232:12345-192.168.201.60@tcp:4:bash.0 Request processed in 7247us (7703us total) trans 21474838252 rc 0/0 00000100:00100000:2.0:1763334961.865828:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694351104 00000100:00100000:0.0:1763334961.865839:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 65 00002000:00100000:0.0:1763334961.865860:0:6522:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x214:0x0] (0->4) req@ffff9a5ac5575f80 x1848989694351232/t21474838252(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:7/0 lens 496/448 e 0 to 0 dl 1763334972 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334961.865871:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5575f80 with x1848989694351232 ext(0->4) 00010000:00010000:0.0:1763334961.865883:0:6522:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 17 pid: 6518 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.865904:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4386 00010000:00010000:0.0:1763334961.865905:0:6522:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 17 pid: 6518 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.865914:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52976:x1848989694351104:12345-192.168.201.60@tcp:101:lfs.0 00002000:00010000:0.0:1763334961.865914:0:6522:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a5ac5575f80 00010000:00010000:2.0:1763334961.865938:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.865964:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8499524 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af363 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.866048:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849952b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.866065:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849952b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.866077:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849952b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334961.866149:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:2.0:1763334961.866153:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334961.866175:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849952b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334961.866203:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f8499524 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af363 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.866221:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849952b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af363 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.866231:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334961.866234:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334961.866240:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:2.0:1763334961.866273:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52976:x1848989694351104:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 362us (8882us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.866280:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4386 00000100:00100000:3.0:1763334961.871303:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.871478:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694351360 00000100:00100000:2.0:1763334961.871494:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694351360 00010000:00010000:2.0:1763334961.871555:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 17 pid: 6518 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334961.871644:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2408 00000100:00100000:2.0:1763334961.871657:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694351360:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334961.871681:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763334961.871706:0:11727:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb size from disk: 0 -> 5 00010000:00010000:2.0:1763334961.871713:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 17 pid: 6518 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.871729:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 17 pid: 6518 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.871757:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499444 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af316 expref: 17 pid: 6518 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334961.871775:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.871778:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334961.871783:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.871795:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.871834:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334961.871911:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694351360:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 255us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.871920:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2408 00010000:00010000:1.0:1763334961.871932:0:6518:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.871952:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.872000:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.872009:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.872018:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.872026:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334961.872031:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.872039:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.872056:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.872064:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849951d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334961.872167:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef848850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694350848:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 19648us (21277us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334961.872176:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4541 00000100:00100000:1.0:1763334961.875755:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.875871:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.875957:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694351488 00000100:00100000:0.0:1763334961.875967:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694351488 00000100:00100000:0.0:1763334961.876019:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694351744 00000100:00100000:0.0:1763334961.876022:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694351744 00000100:00100000:0.0:1763334961.876061:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4387 00000100:00100000:0.0:1763334961.876069:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52976:x1848989694351488:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.876087:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.876107:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499532 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af36a expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.876165:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499539 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876180:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499539 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876190:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499539 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876203:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499540 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876209:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499540 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876215:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499540 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876298:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499539 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876305:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499539 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876321:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499539 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876328:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.876332:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499539 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876340:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499539 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876352:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.876356:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.876361:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499539 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876368:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499539 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876380:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499540 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876385:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499540 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876391:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499540 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876397:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.876399:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499540 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876405:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499540 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876412:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad29c0a00) 00010000:00010000:0.0:1763334961.876415:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.876417:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499540 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876422:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499540 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.876455:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499532 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af36a expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.876466:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.876469:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.876472:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499532 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af36a expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.876481:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:1.0:1763334961.876520:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4388 00000100:00100000:1.0:1763334961.876536:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52974:x1848989694351744:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334961.876560:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334961.876600:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84994ec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af34e expref: 180 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.876616:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:1.0:1763334961.876620:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334961.876637:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499547 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.876645:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499547 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.876653:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499547 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000040:00080000:1.0:1763334961.876991:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1007, 88 off86952 00000004:00080000:1.0:1763334961.876999:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1026510427154ns, next at 1026752974522ns, rc = 0 00000040:00080000:1.0:1763334961.877076:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1018, 88 off88016 00000004:00080000:1.0:1763334961.877081:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1026510509652ns, next at 1026753065722ns, rc = 0 00000040:00080000:1.0:1763334961.877133:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1019, 88 off88104 00000004:00080000:1.0:1763334961.877140:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1026510567872ns, next at 1026753065722ns, rc = 0 00000040:00080000:1.0:1763334961.877163:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1008, 88 off87040 00000004:00080000:1.0:1763334961.877166:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1026510594435ns, next at 1026752974522ns, rc = 0 00000100:00100000:0.0:1763334961.877510:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52976:x1848989694351488:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1438us (1761us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334961.877518:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4387 00000100:00100000:1.0:1763334961.882676:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.882724:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694352000 00000100:00100000:1.0:1763334961.882736:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694352000 00000100:00100000:1.0:1763334961.882808:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4389 00000100:00100000:1.0:1763334961.882820:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52976:x1848989694352000:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.882848:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.882852:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334961.882889:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849952b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af363 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.882911:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334961.882917:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334961.882934:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849954e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af371 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.883105:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499555 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.883122:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499555 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.883133:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499555 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.883148:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849955c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.883156:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849955c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.883163:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849955c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.885441:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499563 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x184:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.885469:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499563 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.885483:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499563 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334961.885499:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x184:0x0]: returning size 0 00010000:00010000:1.0:1763334961.885539:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499555 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.885547:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499555 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.885556:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499555 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.885563:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.885568:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499555 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.885612:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499555 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.885627:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334961.885631:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.885637:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499555 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.885649:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499555 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:1.0:1763334961.885666:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000da02e79d reply state 0000000044623160 transno 8589938643 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849955c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334961.886125:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763334961.886198:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849954e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af371 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.886220:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499563 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af371 expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.886229:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:1.0:1763334961.886232:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334961.886236:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334961.886456:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52976:x1848989694352000:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3636us (3797us total) trans 8589938643 rc 0/0 00000100:00100000:1.0:1763334961.886468:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4389 00010000:00010000:3.0:1763334961.892737:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849955c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.892762:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849955c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.892769:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849955c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.892775:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334961.892782:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849955c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.892791:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849955c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.892813:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829e00) 00010000:00010000:3.0:1763334961.892817:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334961.892823:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849955c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334961.892830:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849955c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334961.896256:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.896321:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694352256 00000100:00100000:1.0:1763334961.896336:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694352256 00000100:00100000:1.0:1763334961.896423:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4390 00000100:00100000:1.0:1763334961.896435:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52976:x1848989694352256:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.896466:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.896497:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499571 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af378 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.896667:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x184:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.896683:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499563 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af371 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.896694:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334961.896743:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499563 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af371 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.896758:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499563 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af371 expref: 182 pid: 32232 timeout: 1126 lvb_type: 0 00000100:00100000:1.0:1763334961.896774:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701799808:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334961.896876:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c58aa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334961.900843:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.901179:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694352384 00000100:00100000:0.0:1763334961.901194:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694352384 00010000:00010000:0.0:1763334961.901255:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499563 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af371 expref: 183 pid: 32232 timeout: 1126 lvb_type: 0 00000100:00100000:0.0:1763334961.901316:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2409 00000100:00100000:0.0:1763334961.901329:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:2360:x1848989694352384:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334961.901351:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334961.901359:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499563 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af371 expref: 183 pid: 32232 timeout: 1126 lvb_type: 0 00010000:00010000:0.0:1763334961.901381:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499563 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af371 expref: 183 pid: 32232 timeout: 1126 lvb_type: 0 00010000:00010000:0.0:1763334961.901413:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:0.0:1763334961.901419:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.901431:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.901439:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.901463:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334961.901541:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:2360:x1848989694352384:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 213us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334961.901549:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2409 00010000:00010000:0.0:1763334961.901642:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499563 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af371 expref: 182 pid: 32232 timeout: 1126 lvb_type: 0 00000100:00100000:0.0:1763334961.901663:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701799808:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334961.901694:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.901705:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.901710:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334961.901735:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x184:0x0]: returning size 0 00000004:00080000:0.0:1763334961.902130:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21a:0x0], index 1: 0 00000004:00080000:0.0:1763334961.902141:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x216:0x0], index 0: 0 00000004:00080000:0.0:1763334961.902147:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x217:0x0], index 0: 0 00000004:00080000:0.0:1763334961.902154:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21b:0x0], index 1: 0 00010000:00010000:0.0:1763334961.902358:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.902368:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.902377:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.902385:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.902391:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.902399:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.902411:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ad2829c00) 00010000:00010000:0.0:1763334961.902414:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334961.902418:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.902424:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499578 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334961.902496:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499571 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af378 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.902511:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.902514:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334961.902518:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499571 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af378 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.902529:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:0.0:1763334961.902629:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52976:x1848989694352256:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6195us (6389us total) trans 8589938644 rc 301/301 00000100:00100000:0.0:1763334961.902637:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4390 00000100:00100000:3.0:1763334961.904794:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.910143:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694352640 00000100:00100000:0.0:1763334961.910166:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694352640 00000100:00100000:0.0:1763334961.910247:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1623 00000100:00100000:0.0:1763334961.910259:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52976:x1848989694352640:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334961.910766:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52976:x1848989694352640:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 504us (5981us total) trans 8589938645 rc 0/0 00000100:00100000:0.0:1763334961.910777:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1623 00000100:00100000:1.0:1763334961.917500:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.917602:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694352896 00000100:00100000:2.0:1763334961.917616:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694352896 00000100:00100000:2.0:1763334961.917831:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1624 00000100:00100000:2.0:1763334961.917844:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52976:x1848989694352896:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334961.918138:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52976:x1848989694352896:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 296us (654us total) trans 8589938646 rc 0/0 00000100:00100000:2.0:1763334961.918148:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1624 00000001:00080000:0.0:1763334961.925058:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938641 is committed 00000001:00080000:0.0:1763334961.925090:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938642 is committed 00000004:00080000:0.0:1763334961.925095:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 661 committed 00000004:00080000:0.0:1763334961.925104:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 673 committed 00000004:00080000:0.0:1763334961.925110:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 672 committed 00000004:00080000:0.0:1763334961.925113:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 660 committed 00000100:00100000:2.0:1763334961.925294:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763334961.925331:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701800064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334961.925423:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334961.925501:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763334961.925514:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701799936:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334961.925539:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334961.925596:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701800064 00000100:00100000:2.0:1763334961.925606:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701800064 00000100:00100000:2.0:1763334961.925668:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701799936 00000100:00100000:2.0:1763334961.925672:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701799936 00000100:00100000:2.0:1763334961.925695:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4542 00000100:00100000:2.0:1763334961.925705:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3292:x1848989701800064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334961.925996:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3292:x1848989701800064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 291us (572us total) trans 17179870970 rc 0/0 00000100:00100000:2.0:1763334961.926005:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4542 00000100:00100000:2.0:1763334961.926027:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4543 00000100:00100000:2.0:1763334961.926033:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3289:x1848989701799936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763334961.926127:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334961.926130:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb mtime from disk: 1763334962 -> 1763334962 00002000:00010000:2.0:1763334961.926133:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334961.926136:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb ctime from disk: 1763334962 -> 1763334962 00002000:00010000:2.0:1763334961.926138:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334961.926166:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3289:x1848989701799936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 133us (625us total) trans 17179870971 rc 0/0 00000100:00100000:2.0:1763334961.926171:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4543 00000004:00080000:2.0:1763334961.926224:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac8418380/2, rc 0, transno 17179870970 00000100:00100000:2.0:1763334961.926231:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701800064:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763334961.926248:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac8419c00/2, rc 0, transno 17179870971 00000100:00100000:2.0:1763334961.926252:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701799936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334961.926603:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763334961.926615:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701800320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334961.926653:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1763334961.926698:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000005dbd88a reply state 000000003f615f3b transno 8589938642 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499547 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334961.926713:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1763334961.926824:0:29629:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763334961.926840:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52974:x1848989694351744:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 50308us (50967us total) trans 8589938642 rc 0/0 00000100:00100000:3.0:1763334961.926849:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4388 00010000:00010000:1.0:1763334961.926948:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499547 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.926959:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499547 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.926968:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499547 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.926975:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.926981:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499547 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.926994:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499547 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.927015:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:1.0:1763334961.927018:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334961.927024:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499547 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.927030:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499547 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:1.0:1763334961.927052:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763334961.927062:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701800192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334961.927096:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334961.927447:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701800320 00000100:00100000:3.0:1763334961.927459:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701800320 00000100:00100000:3.0:1763334961.927510:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701800192 00000100:00100000:3.0:1763334961.927514:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701800192 00000100:00100000:3.0:1763334961.927541:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4544 00000100:00100000:3.0:1763334961.927549:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3290:x1848989701800320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334961.928091:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3290:x1848989701800320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 540us (1434us total) trans 21474838253 rc 0/0 00000100:00100000:3.0:1763334961.928099:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4544 00000100:00100000:3.0:1763334961.928119:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4545 00000100:00100000:3.0:1763334961.928126:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3291:x1848989701800192:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334961.928237:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3291:x1848989701800192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (1140us total) trans 21474838254 rc 0/0 00000100:00100000:3.0:1763334961.928243:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4545 00000004:00080000:3.0:1763334961.928293:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f1f80/2, rc 0, transno 21474838253 00000100:00100000:3.0:1763334961.928301:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701800320:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334961.928476:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f0000/2, rc 0, transno 21474838254 00000100:00100000:1.0:1763334961.928482:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701800192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334961.928602:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.928751:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694353152 00000100:00100000:0.0:1763334961.928759:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694353152 00000100:00100000:0.0:1763334961.928810:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4391 00000100:00100000:0.0:1763334961.928819:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52274:x1848989694353152:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334961.928837:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.928866:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499586 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af37f expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.929069:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849958d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929088:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849958d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929102:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849958d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929119:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499594 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929125:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499594 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929131:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499594 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929218:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849959b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x184:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929226:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849959b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929233:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849959b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:0.0:1763334961.929246:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x184:0x0]: returning size 0 00010000:00010000:0.0:1763334961.929363:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849958d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929375:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849958d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929382:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849958d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929389:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.929394:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849958d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929402:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849958d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929415:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334961.929418:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.929423:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849958d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929430:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849958d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929447:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499594 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929453:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499594 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929459:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499594 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929463:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334961.929466:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499594 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929475:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499594 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929482:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad29c0000) 00010000:00010000:0.0:1763334961.929485:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334961.929487:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499594 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929493:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499594 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334961.929537:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f8499586 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af37f expref: 177 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.929549:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849959b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af37f expref: 176 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.929556:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ad29c0a00) 00010000:00010000:0.0:1763334961.929559:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334961.929561:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334961.929646:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52274:x1848989694353152:12345-192.168.201.60@tcp:101:bash.0 Request processed in 829us (1076us total) trans 8589938647 rc 0/0 00000100:00100000:0.0:1763334961.929652:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4391 00000100:00100000:3.0:1763334961.934151:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334961.934237:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.934320:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694353408 00000100:00100000:2.0:1763334961.934336:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694353408 00000100:00100000:2.0:1763334961.934403:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694353536 00000100:00100000:2.0:1763334961.934406:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694353536 00000100:00100000:2.0:1763334961.934439:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4392 00000100:00100000:2.0:1763334961.934451:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52274:x1848989694353408:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:2.0:1763334961.934531:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334961.934598:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849959b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af37f expref: 176 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.934631:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ad29c0a00) 00010000:00010000:2.0:1763334961.934645:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334961.935002:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f84995a9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x184:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.935023:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f84995a9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334961.935037:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f84995a9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000001:00080000:2.0:1763334961.935110:0:29629:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938648 00000004:00010000:2.0:1763334961.935141:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000097e4eeb9 reply state 00000000e44521c5 transno 8589938649 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f84995a9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:2.0:1763334961.935152:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334961.935293:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52274:x1848989694353408:12345-192.168.201.60@tcp:36:bash.0 Request processed in 841us (1153us total) trans 8589938649 rc 0/0 00000100:00100000:2.0:1763334961.935304:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4392 00000020:00080000:2.0:1763334961.935325:0:29629:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763334961.935355:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4393 00000100:00100000:2.0:1763334961.935365:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52974:x1848989694353536:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334961.935381:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334961.935394:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84995b0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af386 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.935439:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84995b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af386 expref: 178 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.935458:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84995b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af386 expref: 178 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334961.935480:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:2.0:1763334961.935484:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334961.935487:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067c00, rc 0) 00000100:00100000:2.0:1763334961.935511:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52974:x1848989694353536:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 149us (1272us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334961.935517:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4393 00000100:00100000:3.0:1763334961.938329:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334961.938422:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f84995a9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.938437:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f84995a9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.938446:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f84995a9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.938453:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334961.938458:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f84995a9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.938467:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f84995a9 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.938490:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ac6cab600) 00010000:00010000:1.0:1763334961.938494:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334961.938500:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f84995a9 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334961.938506:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f84995a9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x184:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:0.0:1763334961.939078:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694353664 00000100:00100000:0.0:1763334961.939094:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694353664 00000100:00100000:0.0:1763334961.939171:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4394 00000100:00100000:0.0:1763334961.939184:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52274:x1848989694353664:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334961.939218:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.939247:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84995b7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x184:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af38d expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.939339:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84995b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af38d expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.939356:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84995b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af38d expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334961.939377:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:0.0:1763334961.939380:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334961.939384:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792200, rc 0) 00000100:00100000:0.0:1763334961.939479:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52274:x1848989694353664:12345-192.168.201.60@tcp:101:bash.0 Request processed in 297us (1174us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334961.939488:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4394 00000100:00100000:2.0:1763334961.944925:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334961.945038:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334961.945103:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694353792 00000100:00100000:1.0:1763334961.945118:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694353792 00000100:00100000:1.0:1763334961.945196:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694354048 00000100:00100000:1.0:1763334961.945199:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694354048 00000100:00100000:1.0:1763334961.945236:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4395 00000100:00100000:1.0:1763334961.945248:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52974:x1848989694353792:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334961.945282:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.945320:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84995be lrc: 2/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af394 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.945424:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84995c5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.945445:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84995c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.945458:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84995c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334961.945523:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x183:0x0]: returning size 5 00000004:00200000:1.0:1763334961.945531:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334961.945555:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84995c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.945619:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84995be lrc: 0/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af394 expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.945641:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84995c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af394 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.945653:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:1.0:1763334961.945657:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763334961.945662:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334961.945739:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52974:x1848989694353792:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 493us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334961.945747:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4395 00000100:00100000:1.0:1763334961.945851:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4396 00000100:00100000:1.0:1763334961.945858:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52274:x1848989694354048:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334961.945867:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334961.945869:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334961.945887:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84995b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af38d expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.945897:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ad29c0000) 00010000:00010000:1.0:1763334961.945905:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334961.945916:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84995cc lrc: 2/0,0 mode: --/EX res: [0x200000404:0x184:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af39b expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334961.945954:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84995d3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x184:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.945966:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84995d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334961.945973:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84995d3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000040:00080000:1.0:1763334961.946523:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1020, 88 off88192 00000004:00080000:1.0:1763334961.946535:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1026579961993ns, next at 1026753065722ns, rc = 0 00000040:00080000:1.0:1763334961.946659:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1009, 88 off87128 00000004:00080000:1.0:1763334961.946665:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1026580093134ns, next at 1026752974522ns, rc = 0 00000040:00080000:1.0:1763334961.946690:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1010, 88 off87216 00000004:00080000:1.0:1763334961.946693:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1026580121817ns, next at 1026752974522ns, rc = 0 00000040:00080000:1.0:1763334961.946709:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1021, 88 off88280 00000004:00080000:1.0:1763334961.946712:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1026580140866ns, next at 1026753065722ns, rc = 0 00000100:00100000:2.0:1763334961.954649:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334961.955711:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694354176 00000100:00100000:0.0:1763334961.955730:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694354176 00000100:00100000:0.0:1763334961.955814:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4546 00000100:00100000:0.0:1763334961.955827:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694354176:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334961.955853:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334961.955885:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f84995da lrc: 2/0,0 mode: --/PR res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3a2 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334961.955918:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x214:0x0] initial LVB size: 5, mtime: 0x691a5b32, atime: 0x0, ctime: 0x691a5b32, blocks: 0x1 00010000:00010000:0.0:1763334961.955945:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.955947:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334961.955959:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f84995da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a2 expref: 16 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334961.955984:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f84995da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a2 expref: 16 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334961.956001:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793800, rc 0) 00000100:00100000:0.0:1763334961.956084:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694354176:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 259us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334961.956093:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4546 00000001:00080000:0.0:1763334961.999875:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938647 is committed 00000001:00080000:0.0:1763334961.999912:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938650 is committed 00000004:00080000:0.0:1763334961.999918:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 675 committed 00000004:00080000:0.0:1763334961.999940:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 663 committed 00000004:00080000:0.0:1763334961.999955:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 662 committed 00000004:00080000:0.0:1763334961.999959:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 674 committed 00010000:00010000:0.0:1763334962.000068:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84995d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x184:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af39b expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.000090:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ad2829300) 00010000:00010000:0.0:1763334962.000096:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763334962.000126:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f84995cc lrc: 0/0,0 mode: --/EX res: [0x200000404:0x184:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af39b expref: 173 pid: 29627 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763334962.000153:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84995d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x184:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af39b expref: 172 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.000212:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ad2829300) 00010000:00010000:0.0:1763334962.000216:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763334962.000221:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:0.0:1763334962.000367:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52274:x1848989694354048:12345-192.168.201.60@tcp:101:bash.0 Request processed in 54505us (55324us total) trans 8589938650 rc 0/0 00000100:00100000:0.0:1763334962.000381:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4396 00000100:00100000:1.0:1763334962.000861:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701800576:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334962.000938:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334962.001177:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701800448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334962.001207:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334962.001291:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701800576 00000100:00100000:1.0:1763334962.001301:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701800576 00000100:00100000:1.0:1763334962.001375:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701800448 00000100:00100000:1.0:1763334962.001379:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701800448 00000100:00100000:1.0:1763334962.001404:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4547 00000100:00100000:1.0:1763334962.001415:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3291:x1848989701800576:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334962.001842:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3291:x1848989701800576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 427us (902us total) trans 21474838255 rc 0/0 00000100:00100000:1.0:1763334962.001851:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4547 00000100:00100000:1.0:1763334962.001875:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4548 00000100:00100000:1.0:1763334962.001882:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3290:x1848989701800448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334962.001991:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3290:x1848989701800448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (782us total) trans 21474838256 rc 0/0 00000100:00100000:1.0:1763334962.001997:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4548 00000004:00080000:1.0:1763334962.002047:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c7800/2, rc 0, transno 21474838255 00000100:00100000:1.0:1763334962.002054:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701800576:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1763334962.002157:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1763334962.002185:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c4700/2, rc 0, transno 21474838256 00000100:00100000:0.0:1763334962.002189:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701800448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334962.002453:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763334962.002464:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701800832:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334962.002505:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334962.002536:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701800832 00000100:00100000:3.0:1763334962.002541:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701800832 00000100:00100000:3.0:1763334962.002607:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4549 00000100:00100000:3.0:1763334962.002615:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+34:3290:x1848989701800832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334962.002790:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3290:x1848989701800832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (283us total) trans 17179870972 rc 0/0 00000100:00100000:3.0:1763334962.002796:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4549 00000100:00080000:3.0:1763334962.002813:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1763334962.002829:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeec5a300/2, rc 0, transno 17179870972 00000100:00100000:3.0:1763334962.002833:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701800832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334962.002888:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763334962.002898:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701800704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334962.002926:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334962.003064:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701800704 00000100:00100000:3.0:1763334962.003068:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701800704 00000100:00100000:3.0:1763334962.003100:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4550 00000100:00100000:3.0:1763334962.003107:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3291:x1848989701800704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334962.003815:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+36:3291:x1848989701800704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 703us (883us total) trans 17179870973 rc 0/0 00000100:00100000:3.0:1763334962.003825:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4550 00000004:00080000:1.0:1763334962.003912:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeec58380/2, rc 0, transno 17179870973 00000100:00100000:1.0:1763334962.003919:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701800704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.005775:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.006205:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694354304 00000100:00100000:0.0:1763334962.006221:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694354304 00000100:00100000:0.0:1763334962.006332:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4551 00000100:00100000:0.0:1763334962.006345:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+27:52274:x1848989694354304:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334962.006371:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.006405:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f84995e1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3a9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334962.006443:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334962.006472:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.006475:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.006489:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f84995e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a9 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.006508:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f84995e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a9 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.006526:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334962.006646:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+28:52274:x1848989694354304:12345-192.168.201.60@tcp:101:bash.0 Request processed in 302us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.006655:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4551 00000100:00080000:3.0:1763334962.006821:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763334962.009788:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.009905:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694354432 00000100:00100000:1.0:1763334962.009919:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694354432 00000100:00100000:1.0:1763334962.010008:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4552 00000100:00100000:1.0:1763334962.010019:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+16:52274:x1848989694354432:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334962.010042:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334962.010071:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84995e8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3b0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334962.010104:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x216:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334962.010138:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.010141:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.010153:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84995e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3b0 expref: 17 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.010173:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84995e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3b0 expref: 17 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.010196:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334962.010280:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+17:52274:x1848989694354432:12345-192.168.201.60@tcp:101:bash.0 Request processed in 262us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334962.010288:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4552 00000100:00080000:3.0:1763334962.010383:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763334962.015945:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.016349:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.020728:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694354560 00000100:00100000:0.0:1763334962.020755:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694354560 00002000:00010000:0.0:1763334962.020829:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/538 (0->18446744073709551615) 00002000:00100000:0.0:1763334962.020835:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afc8e9c00 with x1848989694354560 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334962.020852:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afc8e9c00. 00000100:00100000:1.0:1763334962.021453:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694354688 00000100:00100000:1.0:1763334962.021463:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694354688 00002000:00010000:2.0:1763334962.023816:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/534 (0->18446744073709551615) 00002000:00100000:2.0:1763334962.023835:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e86680 with x1848989694354688 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334962.023851:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9e86680. 00010000:00010000:1.0:1763334962.023988:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334962.024386:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1688 00000100:00100000:2.0:1763334962.024405:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694354560:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:1.0:1763334962.024597:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1689 00000100:00100000:1.0:1763334962.024615:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694354688:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334962.025047:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x216:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334962.025053:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x216:0x0] updating lvb mtime from disk: 0 -> 1763334962 00002000:00010000:1.0:1763334962.025056:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x216:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334962.025060:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x216:0x0] updating lvb ctime from disk: 0 -> 1763334962 00002000:00010000:1.0:1763334962.025063:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x216:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334962.025181:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694354688:12345-192.168.201.60@tcp:10:bash.0 Request processed in 573us (8830us total) trans 21474838257 rc 0/0 00000100:00100000:1.0:1763334962.025190:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1689 00002000:00010000:1.0:1763334962.025195:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/534 (0->18446744073709551615) 00002000:00100000:1.0:1763334962.025198:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e86680 with x1848989694354688 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334962.025204:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9e86680. 00002000:00010000:2.0:1763334962.025483:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334962.025486:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x21a:0x0] updating lvb mtime from disk: 0 -> 1763334962 00002000:00010000:2.0:1763334962.026047:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x21a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334962.026050:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x21a:0x0] updating lvb ctime from disk: 0 -> 1763334962 00002000:00010000:2.0:1763334962.026052:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334962.026418:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694354560:12345-192.168.201.60@tcp:10:bash.0 Request processed in 2014us (10484us total) trans 17179870974 rc 0/0 00000100:00100000:3.0:1763334962.026429:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1688 00002000:00010000:3.0:1763334962.026434:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/538 (0->18446744073709551615) 00002000:00100000:3.0:1763334962.026437:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afc8e9c00 with x1848989694354560 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334962.026444:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afc8e9c00. 00000100:00100000:2.0:1763334962.027289:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.027401:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694354816 00000100:00100000:3.0:1763334962.027414:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694354816 00000100:00100000:0.0:1763334962.028431:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1690 00000100:00100000:0.0:1763334962.028454:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2362:x1848989694354816:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334962.028536:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84995ef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.028558:0:6522:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.028561:0:6522:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.028586:0:6522:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84995ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.028608:0:6522:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84995ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.028830:0:6522:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84995ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.028841:0:6522:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84995ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.028850:0:6522:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84995ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.028866:0:6522:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334962.028871:0:6522:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84995ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.028881:0:6522:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84995ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.028903:0:6522:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84995ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.028912:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84995ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334962.029025:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2362:x1848989694354816:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 579us (1739us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334962.029035:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1690 00000100:00100000:2.0:1763334962.029712:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.029785:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694355072 00000100:00100000:1.0:1763334962.029797:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694355072 00000100:00100000:1.0:1763334962.029864:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1625 00000100:00100000:1.0:1763334962.029879:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52274:x1848989694355072:12345-192.168.201.60@tcp:35:bash.0 00000100:00080000:3.0:1763334962.030009:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1763334962.030525:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52274:x1848989694355072:12345-192.168.201.60@tcp:35:bash.0 Request processed in 649us (812us total) trans 8589938651 rc 0/0 00000100:00100000:1.0:1763334962.030533:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1625 00000100:00100000:1.0:1763334962.032448:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.032609:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694355200 00000100:00100000:0.0:1763334962.032622:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694355200 00000100:00100000:0.0:1763334962.032683:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4397 00000100:00100000:0.0:1763334962.032694:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52974:x1848989694355200:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334962.032722:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.032749:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f84995f6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3b7 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.032791:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84995fd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334962.032809:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84995fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334962.032822:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84995fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334962.032957:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f84995f6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3b7 expref: 175 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.032980:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792200/0xcedf0054f84995fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x183:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3b7 expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.032990:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:0.0:1763334962.032993:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1763334962.032997:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792200, rc 0) 00000100:00100000:0.0:1763334962.033059:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52974:x1848989694355200:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 367us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.033066:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4397 00000100:00100000:2.0:1763334962.037498:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.037605:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694355328 00000100:00100000:1.0:1763334962.037620:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694355328 00000100:00100000:1.0:1763334962.037699:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4398 00000100:00100000:1.0:1763334962.037712:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52977:x1848989694355328:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:1.0:1763334962.037743:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334962.037775:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499604 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3be expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.037874:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849960b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.037893:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849960b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.037907:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849960b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.037926:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499612 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.037933:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499612 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.037939:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499612 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038099:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499619 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x184:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038109:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499619 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038117:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499619 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334962.038167:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x184:0x0]: returning size 5 00000004:00200000:1.0:1763334962.038174:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334962.038199:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499619 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038213:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499619 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038222:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849960b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038229:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849960b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038237:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849960b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038243:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.038249:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849960b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038258:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849960b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038274:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334962.038278:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.038285:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849960b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038293:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849960b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038320:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499612 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038327:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499612 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038332:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499612 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038337:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.038340:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499612 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038346:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499612 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038353:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829c00) 00010000:00010000:1.0:1763334962.038356:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.038359:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499612 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038365:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499612 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.038404:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499604 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3be expref: 176 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.038420:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499619 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3be expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.038434:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ad2829300) 00010000:00010000:1.0:1763334962.038437:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334962.038440:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478000, rc 0) 00000100:00100000:1.0:1763334962.038533:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52977:x1848989694355328:12345-192.168.201.60@tcp:101:rm.0 Request processed in 822us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334962.038542:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4398 00000100:00100000:2.0:1763334962.042040:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.042152:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694355456 00000100:00100000:3.0:1763334962.042167:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694355456 00000100:00100000:3.0:1763334962.042267:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1691 00000100:00100000:3.0:1763334962.042280:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694355456:12345-192.168.201.60@tcp:4:lfs.0 00002000:00010000:3.0:1763334962.042367:0:14384:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x219:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334962.042378:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499620 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.042399:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.042401:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.042409:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499620 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.042425:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499620 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334962.046056:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.046193:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694355712 00000100:00100000:3.0:1763334962.046208:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694355712 00000100:00100000:3.0:1763334962.046294:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4399 00000100:00100000:3.0:1763334962.046314:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52977:x1848989694355712:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:3.0:1763334962.046393:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1763334962.046432:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499619 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x184:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3be expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.046462:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f84995d3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x184:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af39b expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.046476:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ad2829300) 00010000:00010000:3.0:1763334962.050345:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334962.050404:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499627 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.050431:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499627 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.050445:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499627 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.050469:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849962e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.050476:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849962e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.050483:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849962e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.050670:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499635 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x184:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.050679:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499635 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.050687:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499635 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000040:00080000:3.0:1763334962.051248:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1022, 64 off88344 00000040:00080000:3.0:1763334962.051370:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1011, 64 off87280 00000040:00080000:3.0:1763334962.051393:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1012, 64 off87344 00000040:00080000:3.0:1763334962.051409:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1023, 64 off88408 00010000:00010000:3.0:1763334962.051499:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849963c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x184:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.051512:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849963c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.051527:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849963c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.051535:0:29627:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849963c lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.051543:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849963c lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.051551:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849963c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.051818:0:29627:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763334962.051852:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499635 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.051859:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499635 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.051866:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499635 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.051872:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fc00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.051877:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499635 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.051886:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499635 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x184:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.051902:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ae1a32a00) 00010000:00010000:3.0:1763334962.051906:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763334962.051912:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499635 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x184:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.051922:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499635 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x184:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.052010:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499627 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.052017:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499627 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.052023:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499627 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.052028:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.052031:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499627 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.052037:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499627 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.052044:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.052047:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.052050:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499627 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.052055:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499627 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:3.0:1763334962.052066:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bd3e387a reply state 00000000ef76f2b5 transno 8589938652 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849962e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334962.052077:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763334962.052352:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334962.052361:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849963c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334962.052368:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334962.052372:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849963c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334962.052378:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849963c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x184:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334962.052388:0:8205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x184:0x0].0x0 (ffff9a5ae1a32a00) 00010000:00010000:0.0:1763334962.052391:0:8205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763334962.052396:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849963c lrc: 1/0,0 mode: --/PW res: [0x200000404:0x184:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334962.052402:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f849963c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x184:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334962.052419:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334962.052421:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334962.052423:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334962.053080:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52977:x1848989694355712:12345-192.168.201.60@tcp:36:rm.0 Request processed in 6765us (7031us total) trans 8589938652 rc 0/0 00000100:00100000:3.0:1763334962.053098:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4399 00010000:00010000:1.0:1763334962.057160:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849962e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.057185:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849962e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.057194:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849962e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.057202:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168ee00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.057208:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849962e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.057218:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849962e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.057242:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ae1a32100) 00010000:00010000:1.0:1763334962.057246:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.057252:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849962e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.057259:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849962e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334962.077826:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.077878:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694355840 00000100:00100000:3.0:1763334962.077891:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694355840 00000100:00100000:3.0:1763334962.077958:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4400 00000100:00100000:3.0:1763334962.077969:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52978:x1848989694355840:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334962.078002:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.078031:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499643 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3c5 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.078122:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849964a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078138:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849964a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078152:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849964a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078168:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499651 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078175:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499651 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078181:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499651 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078278:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849964a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078286:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849964a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078296:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849964a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078310:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fc00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.078316:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849964a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078325:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849964a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078341:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.078344:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.078350:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849964a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078357:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849964a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078375:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499651 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078380:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499651 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078386:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499651 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078392:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.078395:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499651 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078402:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499651 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078410:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5b021c4a00) 00010000:00010000:3.0:1763334962.078412:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.078415:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499651 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078420:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499651 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.078463:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499643 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3c5 expref: 175 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.078474:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.078477:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.078481:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499643 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3c5 expref: 175 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.078492:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f600, rc 0) 00000100:00100000:3.0:1763334962.078641:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52978:x1848989694355840:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 671us (830us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334962.078649:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4400 00000100:00100000:3.0:1763334962.089475:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.090062:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694355968 00000100:00100000:0.0:1763334962.090079:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694355968 00000100:00100000:0.0:1763334962.090157:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4401 00000100:00100000:0.0:1763334962.090171:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52978:x1848989694355968:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334962.090205:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.090244:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499658 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3cc expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.090362:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849965f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090383:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849965f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090397:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849965f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090414:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499666 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090422:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499666 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090429:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499666 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090518:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849965f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090526:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849965f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090533:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849965f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090540:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.090545:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849965f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090554:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849965f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090597:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.090601:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.090608:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849965f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090615:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849965f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090629:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499666 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090635:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499666 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090642:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499666 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090652:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.090656:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499666 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090663:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499666 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090672:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad29c0a00) 00010000:00010000:0.0:1763334962.090674:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.090678:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499666 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090684:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499666 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.090726:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499658 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3cc expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.090738:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.090742:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.090745:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499658 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3cc expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.090755:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334962.090861:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52978:x1848989694355968:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 692us (1407us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334962.090871:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4401 00000100:00100000:1.0:1763334962.096211:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.096372:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694356096 00000100:00100000:2.0:1763334962.096387:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694356096 00000100:00100000:2.0:1763334962.096462:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4402 00000100:00100000:2.0:1763334962.096475:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52978:x1848989694356096:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.096503:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.096533:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849966d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3d3 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.096665:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499674 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.096683:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499674 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.096697:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499674 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334962.096777:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:2.0:1763334962.096782:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334962.096806:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499674 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.096835:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849966d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3d3 expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.096854:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499674 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3d3 expref: 175 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.096869:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.096873:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334962.096877:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:2.0:1763334962.096959:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52978:x1848989694356096:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 486us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334962.096967:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4402 00000100:00100000:0.0:1763334962.105206:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.105618:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694356224 00000100:00100000:1.0:1763334962.105634:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694356224 00000100:00100000:1.0:1763334962.105714:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4403 00000100:00100000:1.0:1763334962.105726:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52978:x1848989694356224:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334962.105753:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334962.105783:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849967b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3da expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.105883:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499682 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.105902:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499682 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.105916:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499682 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.105932:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499689 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.105940:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499689 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.105947:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499689 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106029:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499682 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106038:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499682 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106047:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499682 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106054:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.106060:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499682 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106070:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499682 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106085:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334962.106089:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.106096:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499682 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106102:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499682 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106118:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499689 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106125:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499689 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106132:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499689 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106137:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.106140:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499689 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106147:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499689 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106156:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829c00) 00010000:00010000:1.0:1763334962.106159:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.106162:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499689 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106168:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499689 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.106205:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849967b lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3da expref: 176 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.106218:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334962.106221:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.106225:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849967b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3da expref: 176 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.106235:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334962.106332:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52978:x1848989694356224:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 607us (1141us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334962.106341:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4403 00000100:00100000:0.0:1763334962.113190:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.113318:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694356480 00000100:00100000:3.0:1763334962.113334:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694356480 00000100:00100000:3.0:1763334962.113416:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4404 00000100:00100000:3.0:1763334962.113428:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52978:x1848989694356480:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334962.113463:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.113467:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334962.113507:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499674 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3d3 expref: 175 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.113529:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.113534:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334962.113552:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499690 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3e1 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.113755:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499697 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.113771:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499697 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.113783:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499697 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.113801:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849969e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.113809:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849969e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.113815:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849969e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.114427:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84996a5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.114440:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84996a5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.114448:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84996a5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334962.114460:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x186:0x0]: returning size 0 00010000:00010000:3.0:1763334962.114501:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499697 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.114510:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499697 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.114517:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499697 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.114525:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.114530:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499697 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.114539:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499697 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.114550:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.114557:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.114563:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499697 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.114603:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499697 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:3.0:1763334962.114619:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000028c9897f reply state 000000007d0e9d98 transno 8589938653 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849969e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334962.114630:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763334962.114669:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499690 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3e1 expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.114685:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84996a5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3e1 expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.114700:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5adaf40a00) 00010000:00010000:3.0:1763334962.114702:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334962.114705:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168ee00, rc 0) 00000100:00100000:3.0:1763334962.114795:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52978:x1848989694356480:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1370us (1624us total) trans 8589938653 rc 0/0 00000100:00100000:3.0:1763334962.114804:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4404 00010000:00010000:2.0:1763334962.118047:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849969e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.118071:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849969e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.118079:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849969e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.118086:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fc00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.118092:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849969e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.118102:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849969e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.118127:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5adaf40800) 00010000:00010000:2.0:1763334962.118131:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.118137:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849969e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.118144:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f849969e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334962.121982:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.122954:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694356736 00000100:00100000:2.0:1763334962.122981:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694356736 00000100:00100000:2.0:1763334962.123072:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4405 00000100:00100000:2.0:1763334962.123087:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52978:x1848989694356736:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.123124:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.123157:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84996b3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3e8 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.123327:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 3/0,1 mode: --/EX res: [0x200000404:0x186:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.123349:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84996a5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3e1 expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.123362:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 4/0,1 mode: --/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.123424:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84996a5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3e1 expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.123443:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84996a5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3e1 expref: 177 pid: 29627 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334962.123463:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac721bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701800960:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334962.123659:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b540 going to sleep for 11 seconds 00000100:00100000:3.0:1763334962.126694:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.126728:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694356864 00000100:00100000:3.0:1763334962.126740:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694356864 00010000:00010000:3.0:1763334962.126787:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84996a5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3e1 expref: 178 pid: 29627 timeout: 1126 lvb_type: 0 00000100:00100000:3.0:1763334962.126826:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2410 00000100:00100000:3.0:1763334962.126835:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2360:x1848989694356864:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334962.126853:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334962.126860:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84996a5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3e1 expref: 178 pid: 29627 timeout: 1126 lvb_type: 0 00010000:00010000:3.0:1763334962.126875:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84996a5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3e1 expref: 178 pid: 29627 timeout: 1126 lvb_type: 0 00010000:00010000:3.0:1763334962.126905:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5adaf40a00) 00010000:00010000:3.0:1763334962.126912:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 3/0,1 mode: --/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.126923:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.126932:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.126956:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334962.127016:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2360:x1848989694356864:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 182us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334962.127024:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2410 00010000:00010000:0.0:1763334962.127151:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f84996a5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3e1 expref: 177 pid: 29627 timeout: 1126 lvb_type: 0 00000100:00100000:0.0:1763334962.127168:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac721bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701800960:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334962.127194:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.127203:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.127210:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334962.127230:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x186:0x0]: returning size 0 00000004:00080000:0.0:1763334962.127704:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x218:0x0], index 0: 0 00000004:00080000:0.0:1763334962.127715:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21c:0x0], index 1: 0 00000004:00080000:0.0:1763334962.127721:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21d:0x0], index 1: 0 00000004:00080000:0.0:1763334962.127726:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x219:0x0], index 0: 0 00010000:00010000:0.0:1763334962.127920:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.127930:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.127938:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.127945:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.127950:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.127963:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.127977:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5adaf40a00) 00010000:00010000:0.0:1763334962.127980:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334962.127983:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 2/0,0 mode: --/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.127990:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84996ba lrc: 0/0,0 mode: --/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.128056:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84996b3 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3e8 expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.128067:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.128070:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334962.128074:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84996b3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3e8 expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.128084:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067a00, rc 0) 00000100:00100000:0.0:1763334962.128138:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52978:x1848989694356736:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5055us (7151us total) trans 8589938654 rc 301/301 00000100:00100000:0.0:1763334962.128147:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4405 00000100:00100000:3.0:1763334962.131286:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.132609:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694357120 00000100:00100000:0.0:1763334962.132628:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694357120 00000100:00100000:0.0:1763334962.132711:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1626 00000100:00100000:0.0:1763334962.132723:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52978:x1848989694357120:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334962.133245:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52978:x1848989694357120:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 522us (1972us total) trans 8589938655 rc 0/0 00000100:00100000:0.0:1763334962.133255:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1626 00000100:00100000:3.0:1763334962.135027:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.135073:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694357376 00000100:00100000:3.0:1763334962.135086:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694357376 00000100:00100000:3.0:1763334962.135140:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1627 00000100:00100000:3.0:1763334962.135151:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52978:x1848989694357376:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334962.137484:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52978:x1848989694357376:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 2317us (2452us total) trans 8589938656 rc 0/0 00000100:00100000:2.0:1763334962.137501:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1627 00002000:00010000:0.0:1763334962.146492:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763334962.146505:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb mtime from disk: 0 -> 1763334962 00002000:00010000:0.0:1763334962.146508:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb ctime from disk: 0 -> 1763334962 00002000:00010000:0.0:1763334962.146510:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1763334962.146528:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499620 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.146541:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499620 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.146550:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499620 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.146557:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334962.146563:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499620 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.146595:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499620 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.146621:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499620 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.146629:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499620 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334962.146753:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694355456:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 104466us (104724us total) trans 17179870975 rc 0/0 00000100:00100000:0.0:1763334962.146767:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1691 00000001:00080000:0.0:1763334962.146820:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179870968 is committed 00000001:00080000:0.0:1763334962.146851:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179870969 is committed 00000001:00080000:0.0:1763334962.146899:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179870974 is committed 00000001:00080000:0.0:1763334962.146906:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179870971 is committed 00000001:00080000:0.0:1763334962.146916:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179870975 is committed 00000001:00080000:0.0:1763334962.146924:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179870973 is committed 00000100:00100000:0.0:1763334962.147501:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.155258:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694357632 00000100:00100000:1.0:1763334962.155287:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694357632 00000100:00100000:1.0:1763334962.155436:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4406 00000100:00100000:1.0:1763334962.155450:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52274:x1848989694357632:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334962.155491:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334962.155528:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84996c8 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3ef expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.155792:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f84996cf lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.155809:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f84996cf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.155822:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f84996cf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.155837:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84996d6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.155843:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84996d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.155848:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84996d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.155931:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84996dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.155938:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84996dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.155945:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84996dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334962.155956:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x186:0x0]: returning size 0 00010000:00010000:1.0:1763334962.156103:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f84996cf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156111:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f84996cf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156123:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f84996cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156130:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.156135:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f84996cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156145:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f84996cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156162:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334962.156165:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.156172:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f84996cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156180:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f84996cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156196:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84996d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156200:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84996d6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156205:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84996d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156209:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.156212:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84996d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156218:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84996d6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156224:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829c00) 00010000:00010000:1.0:1763334962.156226:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.156229:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84996d6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156234:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f84996d6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.156289:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84996c8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3ef expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.156315:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84996dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3ef expref: 180 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.156322:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5ad2829e00) 00010000:00010000:1.0:1763334962.156325:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334962.156327:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334962.156429:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52274:x1848989694357632:12345-192.168.201.60@tcp:101:bash.0 Request processed in 981us (8931us total) trans 8589938657 rc 0/0 00000100:00100000:1.0:1763334962.156438:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4406 00000100:00100000:1.0:1763334962.161388:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.162175:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694357888 00000100:00100000:2.0:1763334962.162193:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694357888 00000100:00100000:2.0:1763334962.162277:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4407 00000100:00100000:2.0:1763334962.162290:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52274:x1848989694357888:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:2.0:1763334962.162383:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334962.162425:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f84996dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3ef expref: 180 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.162447:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5ad2829e00) 00010000:00010000:2.0:1763334962.162460:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334962.162825:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f84996eb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.162843:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f84996eb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.162853:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f84996eb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:2.0:1763334962.162909:0:29627:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938658 00000004:00010000:2.0:1763334962.162931:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ef9b295f reply state 00000000823ce0a3 transno 8589938659 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f84996eb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334962.162940:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334962.163056:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52274:x1848989694357888:12345-192.168.201.60@tcp:36:bash.0 Request processed in 768us (1685us total) trans 8589938659 rc 0/0 00000100:00100000:2.0:1763334962.163064:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4407 00000020:00080000:2.0:1763334962.163070:0:29627:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763334962.165388:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f84996eb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.165414:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f84996eb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.165423:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f84996eb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.165434:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.165440:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f84996eb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.165449:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f84996eb lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.165471:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:1.0:1763334962.165475:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.165482:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f84996eb lrc: 2/0,0 mode: --/PW res: [0x200000404:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.165489:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f84996eb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x186:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334962.167432:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.167666:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.167811:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694358016 00000100:00100000:0.0:1763334962.167826:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694358016 00000100:00100000:0.0:1763334962.167892:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694358272 00000100:00100000:0.0:1763334962.167896:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694358272 00000100:00100000:0.0:1763334962.168057:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4408 00000100:00100000:0.0:1763334962.168069:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52274:x1848989694358016:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334962.168100:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763334962.168119:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4409 00000100:00100000:1.0:1763334962.168128:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52974:x1848989694358272:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334962.168191:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334962.168226:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f84995c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x183:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af394 expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.168247:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:1.0:1763334962.168252:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334962.168342:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84996f2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.168362:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84996f2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.168377:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84996f2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.168744:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84996f9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3f6 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.168795:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84996f9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3f6 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.168811:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84996f9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3f6 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.168830:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5ad29c0a00) 00010000:00010000:0.0:1763334962.168834:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334962.168837:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:0.0:1763334962.168961:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52274:x1848989694358016:12345-192.168.201.60@tcp:101:bash.0 Request processed in 895us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.168970:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4408 00000004:00010000:2.0:1763334962.171738:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000055279b7a reply state 00000000a914c85b transno 8589938660 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84996f2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334962.171767:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334962.171938:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52974:x1848989694358272:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 3808us (4267us total) trans 8589938660 rc 0/0 00000100:00100000:2.0:1763334962.171949:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4409 00000100:00100000:2.0:1763334962.180728:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.180830:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694358400 00010000:00010000:1.0:1763334962.180848:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84996f2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334962.180848:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694358400 00010000:00010000:1.0:1763334962.180863:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84996f2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.180871:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84996f2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.180878:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.180884:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84996f2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.180892:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84996f2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.180913:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:1.0:1763334962.180917:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.180923:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84996f2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.180931:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84996f2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334962.180933:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4553 00000100:00100000:0.0:1763334962.180944:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+19:52974:x1848989694358400:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334962.180969:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.180998:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499700 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af3fd expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334962.181031:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x219:0x0] initial LVB size: 4096, mtime: 0x691a5b32, atime: 0x0, ctime: 0x691a5b32, blocks: 0xb 00010000:00010000:0.0:1763334962.181061:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.181064:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.181074:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499700 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3fd expref: 20 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.181092:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499700 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3fd expref: 20 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.181107:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334962.181189:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+20:52974:x1848989694358400:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 246us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.181198:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4553 00000100:00100000:3.0:1763334962.181660:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.181717:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694358656 00000100:00100000:0.0:1763334962.181724:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694358656 00000100:00100000:0.0:1763334962.181764:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4410 00000100:00100000:0.0:1763334962.181773:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52274:x1848989694358656:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334962.181796:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.181799:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334962.181825:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84996f9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3f6 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.181841:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5ad29c0a00) 00010000:00010000:0.0:1763334962.181850:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334962.181863:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499707 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af404 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.181918:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849970e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x186:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.181931:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849970e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.181940:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849970e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:0.0:1763334962.183717:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1013, 88 off87432 00000004:00080000:0.0:1763334962.183736:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1026817163713ns, next at 1026752974522ns, rc = 0 00000040:00080000:0.0:1763334962.183801:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1024, 88 off88496 00000004:00080000:0.0:1763334962.183806:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1026817233763ns, next at 1026753065722ns, rc = 0 00000040:00080000:0.0:1763334962.183914:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1025, 88 off88584 00000004:00080000:0.0:1763334962.183918:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1026817346693ns, next at 1026753065722ns, rc = 0 00000040:00080000:0.0:1763334962.183944:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1014, 88 off87520 00000004:00080000:0.0:1763334962.183948:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1026817376517ns, next at 1026752974522ns, rc = 0 00000100:00100000:3.0:1763334962.186445:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.186547:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694358784 00000100:00100000:1.0:1763334962.186561:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694358784 00000100:00100000:1.0:1763334962.186649:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4554 00000100:00100000:1.0:1763334962.186660:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+18:52974:x1848989694358784:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334962.186683:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334962.186713:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499715 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af40b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334962.186744:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x215:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334962.186773:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.186775:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.186784:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499715 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af40b expref: 19 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.186802:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499715 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af40b expref: 19 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.186816:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334962.186885:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+19:52974:x1848989694358784:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 226us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334962.186893:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4554 00000100:00100000:0.0:1763334962.192740:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.192798:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.192835:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694359040 00000100:00100000:1.0:1763334962.192836:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694358912 00000100:00100000:1.0:1763334962.192848:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694358912 00000100:00100000:0.0:1763334962.192848:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694359040 00002000:00010000:1.0:1763334962.192907:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/537 (5->18446744073709551615) 00002000:00010000:0.0:1763334962.192907:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/533 (0->18446744073709551615) 00002000:00100000:1.0:1763334962.192913:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac841a300 with x1848989694358912 ext(5->18446744073709551615) 00002000:00100000:0.0:1763334962.192913:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1f1180 with x1848989694359040 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334962.192929:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac841a300. 00002000:00010000:0.0:1763334962.192929:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afb1f1180. 00000100:00100000:0.0:1763334962.192966:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1692 00000100:00100000:1.0:1763334962.192972:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1693 00000100:00100000:0.0:1763334962.192976:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2361:x1848989694359040:12345-192.168.201.60@tcp:10:lfs.0 00000100:00100000:1.0:1763334962.192978:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694358912:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:1.0:1763334962.193299:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763334962.193299:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x215:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334962.193315:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x215:0x0] updating lvb mtime from disk: 0 -> 1763334962 00002000:00010000:0.0:1763334962.193318:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x215:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334962.193320:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x215:0x0] updating lvb ctime from disk: 0 -> 1763334962 00002000:00010000:0.0:1763334962.193323:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x215:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334962.193394:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2361:x1848989694359040:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 418us (594us total) trans 21474838258 rc 0/0 00000100:00100000:0.0:1763334962.193404:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1692 00002000:00010000:0.0:1763334962.193409:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/533 (0->18446744073709551615) 00002000:00100000:0.0:1763334962.193411:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1f1180 with x1848989694359040 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334962.193416:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afb1f1180. 00002000:00010000:1.0:1763334962.196510:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb mtime from disk: 1763334962 -> 1763334962 00002000:00010000:1.0:1763334962.196515:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334962.196518:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb ctime from disk: 1763334962 -> 1763334962 00002000:00010000:1.0:1763334962.196521:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1763334962.196647:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2362:x1848989694358912:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 3660us (3916us total) trans 17179870976 rc 0/0 00000100:00100000:1.0:1763334962.196662:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1693 00002000:00010000:1.0:1763334962.196670:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/537 (5->18446744073709551615) 00002000:00100000:1.0:1763334962.196674:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac841a300 with x1848989694358912 ext(5->18446744073709551615) 00002000:00010000:1.0:1763334962.196688:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac841a300. 00000100:00100000:0.0:1763334962.208481:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.209457:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694359296 00000100:00100000:2.0:1763334962.209478:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694359296 00000100:00100000:2.0:1763334962.209562:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4411 00000100:00100000:2.0:1763334962.209621:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52974:x1848989694359296:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334962.209783:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849971c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.209810:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849971c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.209826:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849971c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00010000:2.0:1763334962.210189:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009ea45d14 reply state 000000001cc864bd transno 8589938662 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849971c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334962.210204:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334962.211825:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52974:x1848989694359296:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 2236us (3347us total) trans 8589938662 rc 0/0 00000100:00100000:2.0:1763334962.211842:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4411 00010000:00010000:1.0:1763334962.222483:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849971c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.222513:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849971c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.222524:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849971c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.222532:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.222538:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849971c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.222548:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849971c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.222596:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:1.0:1763334962.222601:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.222610:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849971c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.222617:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849971c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334962.226816:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.226921:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694359424 00000100:00100000:1.0:1763334962.226938:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694359424 00000100:00100000:1.0:1763334962.227015:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4555 00000100:00100000:1.0:1763334962.227029:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694359424:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:1.0:1763334962.227285:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763334962.227289:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb mtime from disk: 1763334962 -> 1763334962 00002000:00010000:1.0:1763334962.227291:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb atime from disk: 0 -> 1763334962 00002000:00010000:1.0:1763334962.227294:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb ctime from disk: 1763334962 -> 1763334962 00002000:00010000:1.0:1763334962.227296:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334962.227394:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694359424:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 367us (594us total) trans 21474838259 rc 0/0 00000100:00100000:1.0:1763334962.227403:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4555 00000100:00100000:1.0:1763334962.235872:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.235968:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694359680 00000100:00100000:2.0:1763334962.235983:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694359680 00000100:00100000:2.0:1763334962.236062:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1628 00000100:00100000:2.0:1763334962.236075:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52974:x1848989694359680:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:2.0:1763334962.236153:0:30956:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x183:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84994de lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af347 expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.236217:0:30956:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334962.236231:0:30956:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84995b0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af386 expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.236242:0:30956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334962.236362:0:30956:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84995b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af386 expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.236378:0:30956:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84995b0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af386 expref: 185 pid: 29629 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334962.236396:0:30956:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac721b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:30956:1848989701801088:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334962.237742:0:30956:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1763334962.242161:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.242201:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694359808 00000100:00100000:0.0:1763334962.242215:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694359808 00010000:00010000:0.0:1763334962.242273:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84995b0 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af386 expref: 186 pid: 29629 timeout: 1126 lvb_type: 0 00000100:00100000:0.0:1763334962.242320:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2411 00000100:00100000:0.0:1763334962.242330:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2360:x1848989694359808:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334962.242350:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334962.242358:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84995b0 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af386 expref: 186 pid: 29629 timeout: 1126 lvb_type: 0 00010000:00010000:0.0:1763334962.242372:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84995b0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af386 expref: 186 pid: 29629 timeout: 1126 lvb_type: 0 00010000:00010000:0.0:1763334962.242402:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:0.0:1763334962.242407:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30956 initiator: MDT0 00010000:00010000:0.0:1763334962.242420:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30956 initiator: MDT0 00010000:00010000:0.0:1763334962.242429:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30956 initiator: MDT0 00010000:00010000:0.0:1763334962.242449:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334962.242506:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2360:x1848989694359808:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 177us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.242513:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2411 00010000:00010000:1.0:1763334962.243401:0:30956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84995b0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af386 expref: 185 pid: 29629 timeout: 1126 lvb_type: 0 00000100:00100000:1.0:1763334962.243426:0:30956:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac721b480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:30956:1848989701801088:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334962.243455:0:30956:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334962.243464:0:30956:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334962.243470:0:30956:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30956 initiator: MDT0 00000040:00080000:1.0:1763334962.243954:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1015, 88 off87608 00000004:00080000:1.0:1763334962.243964:0:30956:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1026877391382ns, next at 1026752974522ns, rc = 0 00000040:00080000:1.0:1763334962.244012:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1026, 88 off88672 00000004:00080000:1.0:1763334962.244017:0:30956:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1026877444771ns, next at 1026753065722ns, rc = 0 00000040:00080000:1.0:1763334962.244039:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1027, 88 off88760 00000004:00080000:1.0:1763334962.244042:0:30956:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1026877470612ns, next at 1026753065722ns, rc = 0 00000040:00080000:1.0:1763334962.244055:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1016, 88 off87696 00000004:00080000:1.0:1763334962.244058:0:30956:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1026877486173ns, next at 1026752974522ns, rc = 0 00000001:00080000:3.0:1763334962.253164:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938661 is committed 00000004:00080000:3.0:1763334962.253182:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 665 committed 00000004:00080000:3.0:1763334962.253197:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 677 committed 00000004:00080000:3.0:1763334962.253205:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 676 committed 00000004:00080000:3.0:1763334962.253207:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 664 committed 00000100:00100000:3.0:1763334962.253432:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701801216:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334962.253531:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334962.253612:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763334962.253619:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701801600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334962.253642:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334962.253673:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701801344:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334962.253695:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334962.253713:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763334962.253717:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701801472:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334962.253733:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334962.253763:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701801216 00000100:00100000:3.0:1763334962.253772:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701801216 00000100:00100000:3.0:1763334962.253820:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701801600 00000100:00100000:3.0:1763334962.253822:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701801600 00000100:00100000:3.0:1763334962.253835:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701801344 00000100:00100000:3.0:1763334962.253837:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701801344 00000100:00100000:3.0:1763334962.253850:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701801472 00000100:00100000:3.0:1763334962.253853:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701801472 00000100:00100000:3.0:1763334962.253871:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4556 00000100:00100000:3.0:1763334962.253879:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3290:x1848989701801216:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334962.253907:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:534 count 1 00010000:00010000:3.0:1763334962.253939:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.253964:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84995e8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3b0 expref: 20 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.253973:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334962.253976:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334962.253980:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.254007:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84995e8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3b0 expref: 20 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.254022:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84995e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3b0 expref: 20 pid: 32241 timeout: 1126 lvb_type: 0 00000100:00100000:3.0:1763334962.254039:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701801728:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334962.254109:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e70600 going to sleep for 11 seconds 00000100:00100000:3.0:1763334962.254127:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4557 00000100:00100000:3.0:1763334962.254134:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3290:x1848989701801600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334962.254431:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3290:x1848989701801600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 295us (785us total) trans 21474838260 rc 0/0 00000100:00100000:3.0:1763334962.254439:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4557 00000100:00100000:3.0:1763334962.254461:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4558 00000100:00100000:3.0:1763334962.254467:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3291:x1848989701801344:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334962.254477:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:535 count 1 00002000:00010000:3.0:1763334962.254503:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x217:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334962.254508:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499731 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.254517:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.254518:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.254524:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499731 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.254538:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499731 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.254549:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499731 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.254562:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499731 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.254605:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334962.254778:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3291:x1848989701801344:12345-0@lo:6:osp-syn-0-0.0 Request processed in 311us (1081us total) trans 21474838261 rc 0/0 00000100:00100000:3.0:1763334962.254784:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4558 00000100:00100000:3.0:1763334962.254796:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4559 00000100:00100000:3.0:1763334962.254801:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+27:3291:x1848989701801472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334962.254890:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+28:3291:x1848989701801472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 88us (1155us total) trans 21474838262 rc 0/0 00000100:00100000:3.0:1763334962.254897:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4559 00010000:00010000:3.0:1763334962.254943:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334962.254951:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499731 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.254960:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334962.254965:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499731 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.254974:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499731 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.254992:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499731 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.255004:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499731 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.255023:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334962.255024:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334962.255026:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334962.255066:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a22d80/2, rc 0, transno 21474838262 00000100:00100000:3.0:1763334962.255079:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701801472:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334962.255090:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a22300/2, rc 0, transno 21474838261 00000100:00100000:3.0:1763334962.255093:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701801344:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763334962.255121:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a22680/2, rc 0, transno 21474838260 00000100:00100000:3.0:1763334962.255129:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701801600:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763334962.258106:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849970e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x186:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af404 expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.258131:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5ae1a32b00) 00010000:00010000:0.0:1763334962.258135:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763334962.258159:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499707 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x186:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af404 expref: 183 pid: 30972 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763334962.258181:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849970e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x186:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af404 expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.258224:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5ae1a32b00) 00010000:00010000:0.0:1763334962.258227:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763334962.258230:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334962.258346:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52274:x1848989694358656:12345-192.168.201.60@tcp:101:bash.0 Request processed in 76570us (76685us total) trans 8589938661 rc 0/0 00000100:00100000:0.0:1763334962.258358:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4410 00000100:00100000:2.0:1763334962.265063:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701802240:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.265163:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.265229:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763334962.265237:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701801856:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.265273:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334962.265785:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701802240 00000100:00100000:1.0:1763334962.265799:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701802240 00000100:00100000:1.0:1763334962.265857:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701801856 00000100:00100000:1.0:1763334962.265860:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701801856 00000100:00100000:1.0:1763334962.265884:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4560 00000100:00100000:1.0:1763334962.265895:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1848989701802240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334962.266249:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3289:x1848989701802240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 355us (1085us total) trans 17179870977 rc 0/0 00000100:00100000:1.0:1763334962.266257:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4560 00000100:00100000:1.0:1763334962.266277:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4561 00000100:00100000:1.0:1763334962.266283:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1848989701801856:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763334962.266298:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:538 count 1 00010000:00010000:1.0:1763334962.266334:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.266358:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f84995e1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a9 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.266367:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334962.266370:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334962.266374:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.266419:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f84995e1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a9 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.266433:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f84995e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a9 expref: 20 pid: 6518 timeout: 1126 lvb_type: 0 00000100:00100000:1.0:1763334962.266447:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701802368:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334962.266524:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334962.266698:0:3289:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179870973 gen 2 00000004:00080000:2.0:1763334962.266706:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa3ae300, transno 17179870935 00000004:00080000:2.0:1763334962.266721:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a21180, transno 17179870936 00000004:00080000:2.0:1763334962.266724:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9831180, transno 17179870937 00000004:00080000:2.0:1763334962.266727:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a22a00, transno 17179870938 00000004:00080000:2.0:1763334962.266730:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a21880, transno 17179870939 00000004:00080000:2.0:1763334962.266733:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a21500, transno 17179870940 00000004:00080000:2.0:1763334962.266753:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aef0a0000, transno 17179870943 00000004:00080000:2.0:1763334962.266756:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aef0a0a80, transno 17179870944 00000004:00080000:2.0:1763334962.266759:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aef0a3480, transno 17179870945 00000004:00080000:2.0:1763334962.266762:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aef0a3800, transno 17179870946 00000004:00080000:2.0:1763334962.266766:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aef0a0380, transno 17179870949 00000004:00080000:2.0:1763334962.266769:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aef0a1880, transno 17179870950 00000004:00080000:2.0:1763334962.266771:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab32300, transno 17179870951 00000004:00080000:2.0:1763334962.266774:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab31500, transno 17179870952 00000004:00080000:2.0:1763334962.266776:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c7480, transno 17179870956 00000004:00080000:2.0:1763334962.266779:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c6680, transno 17179870957 00000004:00080000:2.0:1763334962.266782:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c5500, transno 17179870958 00000004:00080000:2.0:1763334962.266784:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c4a80, transno 17179870959 00000004:00080000:2.0:1763334962.266787:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa746a00, transno 17179870960 00000004:00080000:2.0:1763334962.266790:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa745c00, transno 17179870961 00000004:00080000:2.0:1763334962.266793:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fd500, transno 17179870963 00000004:00080000:2.0:1763334962.266796:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fdc00, transno 17179870964 00000004:00080000:2.0:1763334962.266799:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fd180, transno 17179870965 00000004:00080000:2.0:1763334962.266801:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81ff480, transno 17179870966 00000004:00080000:2.0:1763334962.266803:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fd880, transno 17179870967 00000004:00080000:2.0:1763334962.266806:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fca80, transno 17179870968 00000004:00080000:2.0:1763334962.266809:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac8418380, transno 17179870970 00000004:00080000:2.0:1763334962.266811:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac8419c00, transno 17179870971 00000004:00080000:2.0:1763334962.266814:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeec5a300, transno 17179870972 00000004:00080000:2.0:1763334962.266817:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeec58380, transno 17179870973 00000100:00100000:2.0:1763334962.266824:0:3289:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a59c39e5f80 x1848989701802240/t17179870977(17179870977) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334978 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763334962.266836:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c39e5f80/2, rc 0, transno 17179870977 00000100:00100000:2.0:1763334962.266841:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701802240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334962.266957:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701802112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334962.267001:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334962.267027:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763334962.267034:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701801984:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334962.267055:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334962.267146:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701802112 00000100:00100000:0.0:1763334962.267152:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701802112 00000100:00100000:0.0:1763334962.267187:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701801984 00000100:00100000:0.0:1763334962.267190:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701801984 00000100:00100000:0.0:1763334962.267206:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4562 00000100:00100000:0.0:1763334962.267214:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3292:x1848989701802112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334962.267449:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701802112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 234us (447us total) trans 17179870978 rc 0/0 00000100:00100000:0.0:1763334962.267457:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4562 00000100:00100000:0.0:1763334962.267473:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4563 00000100:00100000:0.0:1763334962.267479:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3292:x1848989701801984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334962.267493:0:25383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:539 count 1 00002000:00010000:0.0:1763334962.267527:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334962.267536:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849973f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.267551:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.267553:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.267560:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849973f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763334962.268343:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 4 in progress, 3 in flight, 30 done 00010000:00010000:0.0:1763334962.268535:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849973f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.268555:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849973f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.268563:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849973f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.268615:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334962.268651:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334962.268662:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849973f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.268671:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334962.268677:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849973f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.268687:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849973f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.268710:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849973f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.268717:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849973f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.268739:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334962.268741:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334962.268743:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334962.268908:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701801984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1426us (1848us total) trans 17179870979 rc 0/0 00000100:00100000:0.0:1763334962.268918:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4563 00000004:00080000:0.0:1763334962.268981:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c39e4380/2, rc 0, transno 17179870979 00000100:00100000:0.0:1763334962.269003:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701801984:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763334962.269017:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c39e6300/2, rc 0, transno 17179870978 00000100:00100000:0.0:1763334962.269020:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701802112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334962.270106:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.270147:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.270160:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694359936 00000100:00100000:0.0:1763334962.270169:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694360064 00000100:00100000:1.0:1763334962.270170:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694359936 00000100:00100000:0.0:1763334962.270171:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694360064 00000100:00100000:0.0:1763334962.270208:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4564 00010000:00010000:1.0:1763334962.270211:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84995e8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3b0 expref: 22 pid: 32241 timeout: 1126 lvb_type: 0 00000100:00100000:0.0:1763334962.270217:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:52274:x1848989694360064:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334962.270235:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763334962.270242:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2412 00000100:00100000:1.0:1763334962.270247:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694359936:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334962.270262:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334962.270269:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84995e8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3b0 expref: 22 pid: 32241 timeout: 1126 lvb_type: 0 00010000:00010000:0.0:1763334962.270269:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499746 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af412 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.270284:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84995e8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3b0 expref: 22 pid: 32241 timeout: 1126 lvb_type: 0 00002000:00010000:0.0:1763334962.270315:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x218:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334962.270317:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.270320:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.270327:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.270331:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.270333:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.270338:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.270341:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499746 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af412 expref: 23 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.270354:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499746 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af412 expref: 23 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.270365:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334962.270367:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334962.270423:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:52274:x1848989694360064:12345-192.168.201.60@tcp:101:bash.0 Request processed in 206us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.270430:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4564 00010000:00010000:3.0:1763334962.270626:0:32241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f84995e8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3b0 expref: 22 pid: 32241 timeout: 1126 lvb_type: 0 00000100:00100000:3.0:1763334962.270642:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9830e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701801728:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334962.270670:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.270682:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.270690:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.270705:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.270714:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.270735:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334962.271390:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88ee450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694359936:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1133us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334962.271401:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2412 00000100:00100000:2.0:1763334962.272612:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.272678:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694360192 00000100:00100000:2.0:1763334962.272687:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694360192 00010000:00010000:2.0:1763334962.272732:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f84995e1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a9 expref: 21 pid: 6518 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334962.272771:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2413 00000100:00100000:2.0:1763334962.272781:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694360192:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334962.272798:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334962.272804:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f84995e1 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a9 expref: 21 pid: 6518 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334962.272818:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f84995e1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a9 expref: 21 pid: 6518 timeout: 1126 lvb_type: 0 00010000:00010000:2.0:1763334962.272850:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334962.272853:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334962.272860:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.272873:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.272895:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334962.272940:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694360192:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 161us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334962.272947:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2413 00010000:00010000:2.0:1763334962.272999:0:7819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f84995e1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a9 expref: 20 pid: 6518 timeout: 1126 lvb_type: 0 00000100:00100000:2.0:1763334962.273015:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701802368:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334962.273038:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273048:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273056:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273067:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273075:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273095:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763334962.273458:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701801856:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7173us (8183us total) trans 17179870980 rc 0/0 00000100:00100000:2.0:1763334962.273467:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4561 00010000:00010000:2.0:1763334962.273492:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763334962.273501:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273511:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334962.273516:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273526:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273541:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273549:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849972a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273590:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334962.273594:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273601:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334962.273605:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273613:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273623:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273630:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f8499738 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.273644:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334962.273646:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334962.273647:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334962.273679:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81fc380/2, rc 0, transno 17179870980 00000100:00100000:2.0:1763334962.273694:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701801856:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763334962.275619:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334962.276075:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3290:x1848989701801216:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22187us (22536us total) trans 21474838263 rc 0/0 00000100:00100000:3.0:1763334962.276093:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4556 00000004:00080000:0.0:1763334962.276264:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a23b80/2, rc 0, transno 21474838263 00000100:00100000:0.0:1763334962.276280:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701801216:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334962.280613:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.280961:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694360320 00000100:00100000:0.0:1763334962.280975:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694360320 00000100:00100000:0.0:1763334962.281046:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4565 00000100:00100000:0.0:1763334962.281058:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+20:52274:x1848989694360320:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334962.281083:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.281113:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849974d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af419 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334962.281145:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334962.281176:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.281179:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.281192:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849974d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af419 expref: 21 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.281211:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849974d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af419 expref: 21 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.281227:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334962.282114:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+21:52274:x1848989694360320:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1051us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.282126:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4565 00000100:00100000:0.0:1763334962.292994:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.293041:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.293200:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694360448 00000100:00100000:2.0:1763334962.293217:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694360448 00002000:00010000:2.0:1763334962.293288:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/536 (0->18446744073709551615) 00002000:00100000:2.0:1763334962.293295:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e16d80 with x1848989694360448 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334962.293321:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac7e16d80. 00000100:00100000:2.0:1763334962.293352:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694360576 00000100:00100000:2.0:1763334962.293356:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694360576 00002000:00010000:2.0:1763334962.293372:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/540 (0->18446744073709551615) 00002000:00100000:2.0:1763334962.293376:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e15f80 with x1848989694360576 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334962.293384:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac7e15f80. 00000100:00100000:2.0:1763334962.293409:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1694 00000100:00100000:2.0:1763334962.293421:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694360448:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334962.293855:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x218:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334962.293860:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x218:0x0] updating lvb mtime from disk: 0 -> 1763334962 00002000:00010000:2.0:1763334962.293864:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x218:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334962.293866:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x218:0x0] updating lvb ctime from disk: 0 -> 1763334962 00002000:00010000:2.0:1763334962.293869:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x218:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334962.293963:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694360448:12345-192.168.201.60@tcp:10:bash.0 Request processed in 543us (984us total) trans 21474838264 rc 0/0 00000100:00100000:2.0:1763334962.293974:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1694 00002000:00010000:2.0:1763334962.293980:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/536 (0->18446744073709551615) 00002000:00100000:2.0:1763334962.293983:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e16d80 with x1848989694360448 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334962.293987:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac7e16d80. 00000100:00100000:2.0:1763334962.294011:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1695 00000100:00100000:2.0:1763334962.294019:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694360576:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334962.294215:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334962.294219:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x21c:0x0] updating lvb mtime from disk: 0 -> 1763334962 00002000:00010000:2.0:1763334962.294221:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x21c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334962.294223:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x21c:0x0] updating lvb ctime from disk: 0 -> 1763334962 00002000:00010000:2.0:1763334962.294225:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334962.294250:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694360576:12345-192.168.201.60@tcp:10:bash.0 Request processed in 233us (1208us total) trans 17179870981 rc 0/0 00000100:00100000:2.0:1763334962.294256:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1695 00002000:00010000:2.0:1763334962.294259:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/540 (0->18446744073709551615) 00002000:00100000:2.0:1763334962.294262:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e15f80 with x1848989694360576 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334962.294266:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac7e15f80. 00000100:00100000:1.0:1763334962.304073:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.305858:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694360832 00000100:00100000:3.0:1763334962.305880:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694360832 00000100:00100000:3.0:1763334962.305951:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1629 00000100:00100000:3.0:1763334962.305962:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52274:x1848989694360832:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:3.0:1763334962.306497:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52274:x1848989694360832:12345-192.168.201.60@tcp:35:bash.0 Request processed in 532us (2436us total) trans 8589938664 rc 0/0 00000100:00100000:3.0:1763334962.306506:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1629 00000100:00100000:0.0:1763334962.317163:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.317548:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694360960 00000100:00100000:1.0:1763334962.317564:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694360960 00000100:00100000:1.0:1763334962.317702:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4412 00000100:00100000:1.0:1763334962.317715:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52979:x1848989694360960:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:1.0:1763334962.317745:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334962.317778:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499754 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af420 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.317871:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849975b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.317889:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849975b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.317902:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849975b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.317916:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499762 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.317926:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499762 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.317932:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499762 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318061:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499769 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x186:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318070:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499769 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318076:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499769 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334962.318121:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x186:0x0]: returning size 5 00000004:00200000:1.0:1763334962.318126:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334962.318149:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499769 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318162:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499769 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318171:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849975b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318177:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849975b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318184:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849975b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318191:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.318196:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849975b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318204:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849975b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318218:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334962.318222:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.318229:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849975b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318236:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849975b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318250:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499762 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318256:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499762 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318261:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499762 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318266:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.318269:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499762 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318274:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499762 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318280:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829e00) 00010000:00010000:1.0:1763334962.318283:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.318285:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499762 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318291:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499762 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.318340:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499754 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af420 expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.318355:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499769 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af420 expref: 176 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.318362:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5ae1a32b00) 00010000:00010000:1.0:1763334962.318364:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334962.318367:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334962.318457:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52979:x1848989694360960:12345-192.168.201.60@tcp:101:rm.0 Request processed in 744us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334962.318466:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4412 00000001:00080000:3.0:1763334962.321748:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938663 is committed 00000004:00080000:3.0:1763334962.321763:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 667 committed 00000004:00080000:3.0:1763334962.321780:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 679 committed 00000004:00080000:3.0:1763334962.321786:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 678 committed 00000004:00080000:3.0:1763334962.321789:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 666 committed 00000100:00100000:0.0:1763334962.322128:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701802496:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334962.322226:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1763334962.322550:0:30956:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c071fb35 reply state 0000000036816e2e transno 8589938663 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30956 initiator: MDT0 00000100:00100000:1.0:1763334962.322568:0:30956:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763334962.322603:0:30956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:1.0:1763334962.322607:0:30956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334962.322617:0:30956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f84994de lrc: 0/0,0 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af347 expref: 173 pid: 32232 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1763334962.322761:0:30956:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763334962.322778:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52974:x1848989694359680:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 86705us (86922us total) trans 8589938663 rc 0/0 00000100:00100000:1.0:1763334962.322789:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1628 00000100:00100000:1.0:1763334962.322836:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701802496 00000100:00100000:1.0:1763334962.322844:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701802496 00000100:00100000:1.0:1763334962.322898:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4566 00000100:00100000:1.0:1763334962.322907:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3290:x1848989701802496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334962.323168:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763334962.323173:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb mtime from disk: 1763334962 -> 1763334962 00002000:00010000:1.0:1763334962.323175:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb atime from disk: 1763334962 -> 1763334962 00002000:00010000:1.0:1763334962.323177:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb ctime from disk: 1763334962 -> 1763334962 00002000:00010000:1.0:1763334962.323179:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x214:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334962.325702:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701802880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334962.325803:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.326644:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701802624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334962.326644:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3290:x1848989701802496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3730us (4411us total) trans 21474838265 rc 0/0 00000100:00100000:1.0:1763334962.326666:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4566 00000100:00100000:1.0:1763334962.326716:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701802880 00000100:00100000:2.0:1763334962.326722:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334962.326729:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701802880 00000100:00100000:2.0:1763334962.326767:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763334962.326779:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701802752:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334962.326780:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701802624 00000100:00100000:1.0:1763334962.326784:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701802624 00000100:00100000:1.0:1763334962.326814:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4567 00000100:00100000:2.0:1763334962.326816:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334962.326824:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701802880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.326859:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701802752 00000100:00100000:2.0:1763334962.326863:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701802752 00000100:00100000:2.0:1763334962.326904:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4568 00000100:00100000:2.0:1763334962.326911:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3291:x1848989701802624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334962.327221:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x215:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334962.327227:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x215:0x0] updating lvb mtime from disk: 1763334962 -> 1763334962 00002000:00010000:2.0:1763334962.327230:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x215:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334962.327232:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x215:0x0] updating lvb ctime from disk: 1763334962 -> 1763334962 00002000:00010000:2.0:1763334962.327236:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x215:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334962.327315:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+30:3291:x1848989701802624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 404us (598us total) trans 21474838266 rc 0/0 00000100:00100000:2.0:1763334962.327324:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4568 00000100:00100000:2.0:1763334962.327342:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4569 00000100:00100000:2.0:1763334962.327349:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701802752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763334962.327506:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334962.327509:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb mtime from disk: 1763334962 -> 1763334962 00002000:00010000:2.0:1763334962.327512:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334962.327514:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb ctime from disk: 1763334962 -> 1763334962 00002000:00010000:2.0:1763334962.327516:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x218:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:2.0:1763334962.327550:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3291:x1848989701802752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (735us total) trans 17179870982 rc 0/0 00000100:00100000:2.0:1763334962.327556:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4569 00002000:00010000:1.0:1763334962.327559:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763334962.327564:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb mtime from disk: 1763334962 -> 1763334962 00002000:00010000:1.0:1763334962.327567:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334962.327603:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb ctime from disk: 1763334962 -> 1763334962 00002000:00010000:1.0:1763334962.327606:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x219:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1763334962.327651:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701802880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 828us (1847us total) trans 17179870983 rc 0/0 00000100:00100000:1.0:1763334962.327659:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4567 00010000:00010000:1.0:1763334962.327694:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334962.327706:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334962.327719:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334962.327726:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.327733:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334962.327742:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334962.327761:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:1.0:1763334962.327765:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334962.327771:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334962.327777:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499723 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30956 initiator: MDT0 00000004:00080000:1.0:1763334962.327846:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab35880/2, rc 0, transno 17179870983 00000004:00080000:0.0:1763334962.330738:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab36a00/2, rc 0, transno 21474838265 00000100:00100000:0.0:1763334962.330760:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701802496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334962.336478:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701802880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334962.337205:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.337313:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.337369:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694361216 00000100:00100000:1.0:1763334962.337385:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694361216 00000100:00100000:1.0:1763334962.337449:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694361344 00000100:00100000:1.0:1763334962.337452:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694361344 00000100:00100000:1.0:1763334962.337499:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4413 00000100:00100000:1.0:1763334962.337512:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52979:x1848989694361216:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:1.0:1763334962.337644:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1763334962.337680:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499769 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x186:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af420 expref: 173 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.337704:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849970e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x186:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af404 expref: 172 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.337716:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5ae1a32b00) 00010000:00010000:1.0:1763334962.337730:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334962.337761:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499770 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.337776:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499770 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.337787:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499770 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.337802:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499777 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.337808:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499777 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.337813:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499777 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.337970:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849977e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x186:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.337979:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849977e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.337987:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849977e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:1.0:1763334962.338663:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1017, 64 off87760 00000004:00080000:1.0:1763334962.338678:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1026972105630ns, next at 1027972101713ns, rc = 0 00000040:00080000:1.0:1763334962.338794:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1028, 64 off88824 00000004:00080000:1.0:1763334962.338799:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1026972227580ns, next at 1027972226189ns, rc = 0 00000040:00080000:1.0:1763334962.338818:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1029, 64 off88888 00000040:00080000:1.0:1763334962.338833:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1018, 64 off87824 00010000:00010000:1.0:1763334962.338929:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499785 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x186:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.338942:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499785 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.338953:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499785 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.338960:0:32232:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499785 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.338967:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499785 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.338974:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499785 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339012:0:32232:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334962.339042:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849977e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339049:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849977e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339056:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849977e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339063:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.339070:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849977e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339081:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849977e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x186:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334962.339095:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4414 00010000:00010000:1.0:1763334962.339096:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5ad2829b00) 00010000:00010000:1.0:1763334962.339103:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763334962.339110:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849977e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x186:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339117:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849977e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x186:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334962.339125:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52974:x1848989694361344:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334962.339206:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499770 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339214:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499770 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339219:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499770 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339224:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.339228:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499770 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339234:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499770 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339242:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334962.339245:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.339247:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499770 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339257:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499770 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:1.0:1763334962.339267:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bdc4e7bc reply state 000000007019adc4 transno 8589938665 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499777 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334962.339275:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334962.339418:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52979:x1848989694361216:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1907us (2217us total) trans 8589938665 rc 0/0 00000100:00100000:1.0:1763334962.339427:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4413 00010000:00010000:1.0:1763334962.339474:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334962.339480:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499785 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339488:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334962.339490:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499785 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339497:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499785 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x186:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339506:0:5737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x186:0x0].0x0 (ffff9a5ad2829b00) 00010000:00010000:1.0:1763334962.339509:0:5737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763334962.339513:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499785 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x186:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339519:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499785 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x186:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.339535:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.339536:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.339539:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334962.339557:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.339598:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849978c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af427 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.339661:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849978c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af427 expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.339675:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066200/0xcedf0054f849978c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x183:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af427 expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.339696:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:2.0:1763334962.339699:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334962.339703:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066200, rc 0) 00000100:00100000:2.0:1763334962.339757:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52974:x1848989694361344:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 648us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334962.339764:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4414 00000004:00080000:2.0:1763334962.339862:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab36300/2, rc 0, transno 17179870982 00000100:00100000:2.0:1763334962.340383:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701802752:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763334962.340413:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab35c00/2, rc 0, transno 21474838266 00000100:00100000:2.0:1763334962.340432:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701802624:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1763334962.343962:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499777 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.343987:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499777 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.343996:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499777 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.344003:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.344009:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499777 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.344017:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499777 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.344039:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad2829e00) 00010000:00010000:2.0:1763334962.344042:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.344048:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499777 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.344055:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499777 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334962.347067:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.347318:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694361600 00000100:00100000:2.0:1763334962.347334:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694361600 00000100:00100000:2.0:1763334962.351982:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1630 00000100:00100000:2.0:1763334962.352048:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52974:x1848989694361600:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:2.0:1763334962.352809:0:30956:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x183:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763334962.352940:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1019, 64 off87888 00000040:00080000:2.0:1763334962.352972:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1030, 64 off88952 00000040:00080000:2.0:1763334962.352988:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1031, 64 off89016 00000040:00080000:2.0:1763334962.353003:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1020, 64 off87952 00010000:00010000:2.0:1763334962.353106:0:30956:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499793 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334962.353128:0:30956:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499793 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334962.353143:0:30956:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499793 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334962.353154:0:30956:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499793 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334962.353161:0:30956:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499793 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334962.353168:0:30956:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499793 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334962.353197:0:30956:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334962.353428:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52974:x1848989694361600:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1416us (6375us total) trans 8589938666 rc 0/0 00000100:00100000:2.0:1763334962.353440:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1630 00010000:00010000:1.0:1763334962.353635:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334962.353645:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499793 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334962.353654:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334962.353658:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499793 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334962.353667:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499793 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x183:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334962.353683:0:5736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x183:0x0].0x0 (ffff9a5ad29c0b00) 00010000:00010000:1.0:1763334962.353686:0:5736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763334962.353691:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499793 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334962.353697:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499793 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x183:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334962.353708:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.353710:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.353712:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334962.357762:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.357862:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694361728 00000100:00100000:3.0:1763334962.357879:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694361728 00000100:00100000:3.0:1763334962.357956:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4415 00000100:00100000:3.0:1763334962.357968:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52980:x1848989694361728:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334962.358000:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.358033:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849979a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af42e expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.358130:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84997a1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358149:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84997a1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358163:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84997a1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358182:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997a8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358188:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358194:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358290:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84997a1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358307:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84997a1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358314:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84997a1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358324:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.358329:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84997a1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358338:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84997a1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358354:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.358358:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.358364:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84997a1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358371:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84997a1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358388:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358394:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997a8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358399:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997a8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358404:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.358407:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997a8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358413:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997a8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358419:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5e600) 00010000:00010000:3.0:1763334962.358422:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.358424:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997a8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358428:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997a8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.358472:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849979a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af42e expref: 174 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.358482:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.358484:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.358488:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849979a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af42e expref: 174 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.358497:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f600, rc 0) 00000100:00100000:3.0:1763334962.358645:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52980:x1848989694361728:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 678us (899us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334962.358654:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4415 00000100:00100000:0.0:1763334962.365845:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.365947:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694361984 00000100:00100000:2.0:1763334962.365962:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694361984 00000100:00100000:2.0:1763334962.366030:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4416 00000100:00100000:2.0:1763334962.366042:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52974:x1848989694361984:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.366071:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.366101:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84997af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af435 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.366205:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997b6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366222:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997b6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366233:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997b6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366248:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997bd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366267:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366274:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366382:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997b6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366390:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997b6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366397:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997b6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366405:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.366411:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997b6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366420:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997b6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366436:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.366440:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.366446:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997b6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366452:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997b6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366470:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366476:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997bd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366482:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366821:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.366829:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366837:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366846:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334962.366849:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.366852:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997bd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366858:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997bd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.366909:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84997af lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af435 expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.366921:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.366924:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334962.366928:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84997af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af435 expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.366937:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:2.0:1763334962.368139:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52974:x1848989694361984:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2083us (2294us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334962.368155:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4416 00000100:00100000:0.0:1763334962.374846:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.380778:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694362112 00000100:00100000:2.0:1763334962.380801:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694362112 00000100:00100000:2.0:1763334962.380907:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4417 00000100:00100000:2.0:1763334962.380923:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52980:x1848989694362112:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.380953:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.380985:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84997c4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af43c expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.381089:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997cb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381112:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381132:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381147:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997d2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381153:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381160:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381284:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381292:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997cb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381308:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381315:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.381320:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381329:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381344:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.381349:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.381357:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997cb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381363:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f84997cb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381378:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381384:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997d2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381390:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381395:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.381398:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381403:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997d2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381410:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334962.381413:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.381416:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997d2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381422:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f84997d2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.381462:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84997c4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af43c expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.381474:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.381477:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.381480:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84997c4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af43c expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.381489:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:2.0:1763334962.381615:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52980:x1848989694362112:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 696us (6788us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334962.381624:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4417 00000100:00100000:1.0:1763334962.393011:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.393122:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694362496 00000100:00100000:3.0:1763334962.393135:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694362496 00000100:00100000:3.0:1763334962.393211:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4418 00000100:00100000:3.0:1763334962.393223:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52980:x1848989694362496:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334962.393251:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.393281:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f84997d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af44a expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.393408:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997e0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.393434:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.393451:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334962.393859:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000004:00200000:0.0:1763334962.393894:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:0.0:1763334962.393900:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334962.393935:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.393969:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f84997d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af44a expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.393991:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997e0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af44a expref: 174 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.394001:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.394004:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763334962.394008:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fe00, rc 0) 00000100:00100000:0.0:1763334962.394084:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52980:x1848989694362496:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 863us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.394092:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4418 00000100:00100000:0.0:1763334962.394117:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694362368 00000100:00100000:0.0:1763334962.394121:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694362368 00000100:00100000:0.0:1763334962.394160:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4419 00000100:00100000:0.0:1763334962.394167:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52981:x1848989694362368:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334962.394177:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.394188:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84997e7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af443 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.394264:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84997ee lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394274:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84997ee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394283:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84997ee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394308:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84997f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394315:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84997f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394322:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84997f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394377:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84997ee lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394386:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84997ee lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394393:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84997ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394399:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.394404:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84997ee lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394412:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84997ee lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394423:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.394425:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.394430:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84997ee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394435:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f84997ee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394446:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84997f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394452:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84997f5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394458:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84997f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394463:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.394467:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84997f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394473:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84997f5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394480:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd700) 00010000:00010000:0.0:1763334962.394482:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.394485:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84997f5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394490:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f84997f5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.394522:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84997e7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af443 expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.394535:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.394537:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334962.394541:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f84997e7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af443 expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.394550:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334962.394631:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52981:x1848989694362368:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 464us (774us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334962.394640:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4419 00000100:00100000:0.0:1763334962.402726:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.402861:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694362752 00000100:00100000:2.0:1763334962.402878:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694362752 00000100:00100000:2.0:1763334962.402964:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4420 00000100:00100000:2.0:1763334962.402976:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52980:x1848989694362752:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.403008:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.403012:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334962.403056:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84997e0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af44a expref: 174 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.403079:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.403085:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334962.403106:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84997fc lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af451 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.403325:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499803 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.403343:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499803 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.403355:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499803 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.403377:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849980a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.403384:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849980a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.403390:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849980a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.404132:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499811 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.404144:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499811 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.404152:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499811 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334962.404163:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x188:0x0]: returning size 0 00010000:00010000:2.0:1763334962.404193:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499803 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.404201:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499803 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.404209:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499803 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.404216:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.404221:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499803 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.404229:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499803 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.404241:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.404244:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.404248:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499803 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.404254:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499803 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:2.0:1763334962.404267:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000773333ca reply state 00000000bb7be69d transno 8589938667 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849980a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334962.404276:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334962.404327:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84997fc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af451 expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.404343:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499811 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af451 expref: 175 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.404350:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:2.0:1763334962.404352:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334962.404355:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:2.0:1763334962.404463:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52980:x1848989694362752:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1489us (1754us total) trans 8589938667 rc 0/0 00000100:00100000:2.0:1763334962.404474:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4420 00010000:00010000:2.0:1763334962.413146:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849980a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.413169:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849980a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.413183:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849980a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.413190:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.413197:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849980a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.413206:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849980a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.413226:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334962.413230:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.413236:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849980a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.413243:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849980a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334962.416651:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.416702:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.416722:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694363008 00000100:00100000:1.0:1763334962.416736:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694363008 00000100:00100000:1.0:1763334962.416818:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694363264 00000100:00100000:1.0:1763334962.416821:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694363264 00000100:00100000:1.0:1763334962.416858:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4421 00000100:00100000:1.0:1763334962.416872:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52980:x1848989694363008:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334962.416910:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763334962.416910:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4422 00000100:00100000:0.0:1763334962.416920:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52982:x1848989694363264:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334962.416927:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334962.416939:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849981f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af458 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.416939:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499826 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af45f expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.417068:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.417068:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499834 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334962.417085:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499834 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334962.417100:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499834 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:0.0:1763334962.417114:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x188:0x0]: returning size 0 00010000:00010000:1.0:1763334962.417133:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499811 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af451 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.417141:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499834 lrc: 2/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334962.417148:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 5/0,1 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.417170:0:32232:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499834 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334962.417202:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499811 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af451 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.417229:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499811 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af451 expref: 179 pid: 29627 timeout: 1127 lvb_type: 0 00000100:00100000:1.0:1763334962.417247:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a21180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701803008:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334962.417392:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499826 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af45f expref: 180 pid: 29629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334962.417398:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee3c0 going to sleep for 11 seconds 00010000:00010000:0.0:1763334962.417415:0:29629:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499834 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af45f expref: 179 pid: 29629 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.417424:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499834 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af45f expref: 179 pid: 29629 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.417436:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:0.0:1763334962.417476:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52982:x1848989694363264:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 557us (771us total) trans 8589938668 rc 0/0 00000100:00100000:0.0:1763334962.417483:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4422 00000100:00100000:1.0:1763334962.421468:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.421706:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a21180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701803008:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334962.421741:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694363392 00010000:00010000:2.0:1763334962.421745:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334962.421751:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694363392 00010000:00010000:0.0:1763334962.421798:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499811 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af451 expref: 179 pid: 29627 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334962.421843:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2414 00000100:00100000:0.0:1763334962.421854:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:2360:x1848989694363392:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334962.421873:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334962.421880:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499811 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af451 expref: 179 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.421892:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499811 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af451 expref: 179 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.421922:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499811 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af451 expref: 179 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.421939:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:0.0:1763334962.421944:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.421954:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334962.422034:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2360:x1848989694363392:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 181us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.422041:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2414 00000100:00100000:0.0:1763334962.423527:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.423624:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.423659:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694363776 00000100:00100000:0.0:1763334962.423672:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694363776 00010000:00010000:0.0:1763334962.423712:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499834 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af45f expref: 178 pid: 29629 timeout: 1127 lvb_type: 0 00000100:00100000:1.0:1763334962.423898:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694363648 00000100:00100000:1.0:1763334962.423904:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694363648 00000100:00100000:1.0:1763334962.423944:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1631 00000100:00100000:1.0:1763334962.423954:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52982:x1848989694363648:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334962.424053:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2415 00000100:00100000:2.0:1763334962.424066:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+179:2360:x1848989694363776:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334962.424078:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334962.424084:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499834 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af45f expref: 179 pid: 29629 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334962.424098:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499834 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af45f expref: 179 pid: 29629 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334962.424124:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499834 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af45f expref: 179 pid: 29629 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334962.424140:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:2.0:1763334962.424145:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.424155:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.424163:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.424199:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334962.424242:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.424253:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334962.424274:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x188:0x0]: returning size 0 00000004:00080000:3.0:1763334962.424737:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21e:0x0], index 1: 0 00000004:00080000:3.0:1763334962.424748:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21a:0x0], index 0: 0 00000004:00080000:0.0:1763334962.424805:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21b:0x0], index 0: 0 00000004:00080000:0.0:1763334962.424817:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21f:0x0], index 1: 0 00010000:00010000:0.0:1763334962.424986:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.424996:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.425003:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.425008:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.425013:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.425021:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.425033:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:0.0:1763334962.425036:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334962.425039:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 2/0,0 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.425049:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849982d lrc: 0/0,0 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.425111:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849981f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af458 expref: 180 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.425119:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.425122:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334962.425126:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849981f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af458 expref: 180 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.425134:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334962.425273:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52982:x1848989694363648:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1319us (1752us total) trans 8589938669 rc 0/0 00000100:00100000:1.0:1763334962.425285:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1631 00000100:00100000:2.0:1763334962.426249:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2360:x1848989694363776:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 2179us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334962.426263:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2415 00000100:00100000:0.0:1763334962.426427:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52980:x1848989694363008:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 9557us (9793us total) trans 8589938670 rc 301/301 00000100:00100000:0.0:1763334962.426436:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4421 00000100:00100000:0.0:1763334962.429656:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.429718:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694364032 00000100:00100000:2.0:1763334962.429734:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694364032 00000100:00100000:2.0:1763334962.429814:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4423 00000100:00100000:2.0:1763334962.429827:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52982:x1848989694364032:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.429863:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.429896:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8499849 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af466 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.429999:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499850 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430017:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499850 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430033:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499850 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430050:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499857 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430058:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499857 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430065:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499857 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430246:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849985e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430255:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849985e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430264:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849985e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430432:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499850 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430441:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499850 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430448:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499850 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430455:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.430460:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499850 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430474:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499850 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430491:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.430495:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.430503:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499850 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430510:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499850 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430526:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499857 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430533:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499857 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430539:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499857 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430544:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.430547:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499857 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430553:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499857 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430560:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334962.430563:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.430566:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499857 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430593:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499857 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.430649:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f8499849 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af466 expref: 180 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.430665:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849985e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af466 expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.430672:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:2.0:1763334962.430674:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334962.430677:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:2.0:1763334962.430761:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52982:x1848989694364032:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 936us (1121us total) trans 8589938671 rc 0/0 00000100:00100000:2.0:1763334962.430771:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4423 00000100:00100000:0.0:1763334962.430826:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.433245:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694364288 00000100:00100000:2.0:1763334962.433270:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694364288 00000100:00100000:2.0:1763334962.433884:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1632 00000100:00100000:2.0:1763334962.433898:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52980:x1848989694364288:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334962.434668:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.434711:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.434715:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694364416 00000100:00100000:2.0:1763334962.434724:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694364416 00000100:00100000:1.0:1763334962.434774:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694364544 00000100:00100000:1.0:1763334962.434779:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694364544 00000100:00100000:1.0:1763334962.434835:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4570 00000100:00100000:1.0:1763334962.434844:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694364544:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334962.434860:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334962.434891:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849986c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af474 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334962.434923:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334962.434944:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.434947:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.434958:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849986c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af474 expref: 23 pid: 25383 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1763334962.434975:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52980:x1848989694364288:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1080us (4149us total) trans 8589938672 rc 0/0 00010000:00010000:1.0:1763334962.434978:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849986c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af474 expref: 23 pid: 25383 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1763334962.434986:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1632 00010000:00010000:1.0:1763334962.434992:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334962.435014:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694364544:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 172us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334962.435021:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4570 00000100:00100000:1.0:1763334962.435909:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4571 00000100:00100000:1.0:1763334962.435921:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694364416:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334962.435937:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334962.435958:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499873 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af46d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334962.435985:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x21b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334962.436000:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.436002:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.436010:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499873 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af46d expref: 23 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334962.436026:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499873 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af46d expref: 23 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334962.436037:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334962.436086:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694364416:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 167us (1423us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334962.436093:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4571 00000100:00100000:3.0:1763334962.439112:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.440016:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.441001:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694364800 00000100:00100000:0.0:1763334962.441021:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694364800 00000100:00100000:0.0:1763334962.441338:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694365056 00000100:00100000:0.0:1763334962.441342:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694365056 00000100:00100000:3.0:1763334962.441444:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1633 00000100:00100000:3.0:1763334962.441461:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52980:x1848989694364800:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334962.441867:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52980:x1848989694364800:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 410us (2772us total) trans 8589938673 rc 0/0 00000100:00100000:3.0:1763334962.441877:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1633 00000100:00100000:3.0:1763334962.441900:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1634 00000100:00100000:3.0:1763334962.441906:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52982:x1848989694365056:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334962.442122:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52982:x1848989694365056:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 215us (2113us total) trans 8589938674 rc 0/0 00000100:00100000:3.0:1763334962.442130:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1634 00000100:00100000:3.0:1763334962.449272:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.450228:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694365312 00000100:00100000:2.0:1763334962.450246:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694365312 00000100:00100000:2.0:1763334962.450346:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4424 00000100:00100000:2.0:1763334962.450358:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52982:x1848989694365312:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.450406:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.450437:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849987a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af47b expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.450616:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.450635:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849985e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af466 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.450646:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.450694:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849985e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af466 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.450710:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849985e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af466 expref: 183 pid: 32232 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334962.450727:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701803136:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334962.450838:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b540 going to sleep for 11 seconds 00000100:00100000:0.0:1763334962.451970:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.452278:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694365568 00000100:00100000:2.0:1763334962.452292:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694365568 00000100:00100000:2.0:1763334962.452364:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4425 00000100:00100000:2.0:1763334962.452384:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52274:x1848989694365568:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334962.452406:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.452431:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499888 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af482 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.452531:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849988f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.452544:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849988f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.452553:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849988f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334962.454777:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.455464:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701803136:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334962.455507:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334962.455631:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694365696 00000100:00100000:1.0:1763334962.455642:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694365696 00010000:00010000:1.0:1763334962.455690:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849985e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af466 expref: 186 pid: 32232 timeout: 1127 lvb_type: 0 00000100:00100000:1.0:1763334962.455733:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2416 00000100:00100000:1.0:1763334962.455744:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2359:x1848989694365696:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334962.455766:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334962.455773:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849985e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af466 expref: 186 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:1.0:1763334962.455787:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849985e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af466 expref: 186 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:1.0:1763334962.455815:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849985e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af466 expref: 186 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:1.0:1763334962.455831:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:1.0:1763334962.455836:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.455846:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.455854:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.455863:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849988f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.455869:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849988f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.455876:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849988f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.456208:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334962.456230:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.456238:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334962.456274:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x188:0x0]: returning size 0 00010000:00010000:2.0:1763334962.456415:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849988f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.456422:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849988f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334962.456435:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x188:0x0]: returning size 0 00010000:00010000:0.0:1763334962.456491:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849987a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af47b expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.456499:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499888 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af482 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.456508:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af47b expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.456510:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849988f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af482 expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.456517:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:2.0:1763334962.456520:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334962.456523:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:1.0:1763334962.456613:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:2359:x1848989694365696:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 869us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334962.456624:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2416 00010000:00010000:0.0:1763334962.456642:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:0.0:1763334962.456646:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763334962.456649:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066c00, rc 0) 00000100:00100000:0.0:1763334962.456687:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52982:x1848989694365312:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6331us (7445us total) trans 8589938675 rc 0/0 00000100:00100000:0.0:1763334962.456695:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4424 00000100:00100000:2.0:1763334962.457502:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694365568:12345-192.168.201.60@tcp:101:bash.0 Request processed in 5119us (5537us total) trans 8589938676 rc 0/0 00000100:00100000:2.0:1763334962.457512:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4425 00000100:00100000:0.0:1763334962.472635:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.472686:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.472720:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694365824 00000100:00100000:0.0:1763334962.472726:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.472735:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694365824 00000100:00100000:0.0:1763334962.472753:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694366208 00000100:00100000:0.0:1763334962.472756:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694366208 00000100:00100000:3.0:1763334962.472804:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694366080 00000100:00100000:3.0:1763334962.472807:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694366080 00000100:00100000:0.0:1763334962.472813:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 383 00000100:00100000:3.0:1763334962.472822:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1635 00000100:00100000:0.0:1763334962.472825:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:2361:x1848989694366208:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763334962.472828:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52982:x1848989694365824:12345-192.168.201.60@tcp:33:lfs.0 00010000:00010000:0.0:1763334962.472849:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334962.472885:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849988f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af482 expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.472909:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:0.0:1763334962.472917:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334962.472987:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2361:x1848989694366208:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 163us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.472995:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 383 00000100:00100000:2.0:1763334962.473014:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1636 00000100:00100000:2.0:1763334962.473028:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694366080:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:3.0:1763334962.473269:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52982:x1848989694365824:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 441us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334962.473280:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1635 00000100:00100000:2.0:1763334962.473946:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694366080:12345-192.168.201.60@tcp:35:bash.0 Request processed in 918us (1253us total) trans 8589938677 rc 0/0 00000100:00100000:2.0:1763334962.473957:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1636 00000100:00100000:1.0:1763334962.479380:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.479735:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694366464 00000100:00100000:2.0:1763334962.479750:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694366464 00000100:00100000:2.0:1763334962.479827:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4426 00000100:00100000:2.0:1763334962.479839:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694366464:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:2.0:1763334962.480212:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84998a4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.480232:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84998a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.480245:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84998a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:2.0:1763334962.480313:0:29627:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938678 00000004:00010000:2.0:1763334962.480342:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000867616e2 reply state 00000000ed47a1ae transno 8589938679 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84998a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334962.480352:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334962.480472:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694366464:12345-192.168.201.60@tcp:36:bash.0 Request processed in 634us (1120us total) trans 8589938679 rc 0/0 00000100:00100000:2.0:1763334962.480480:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4426 00000020:00080000:2.0:1763334962.480487:0:29627:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1763334962.492624:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84998a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.492648:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84998a4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.492657:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84998a4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.492669:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.492676:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84998a4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.492686:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84998a4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.492709:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:2.0:1763334962.492714:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.492720:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84998a4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.492726:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84998a4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334962.494958:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.495210:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694366592 00000100:00100000:2.0:1763334962.495225:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694366592 00000100:00100000:0.0:1763334962.496164:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4427 00000100:00100000:0.0:1763334962.496187:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694366592:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334962.496218:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.496249:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84998ab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af489 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.497244:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84998ab lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af489 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.498493:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84998ab lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af489 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.498533:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:0.0:1763334962.498536:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334962.498541:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334962.499426:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694366592:12345-192.168.201.60@tcp:101:bash.0 Request processed in 3240us (4474us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.499440:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4427 00000100:00100000:0.0:1763334962.509748:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.511536:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694366848 00000100:00100000:2.0:1763334962.511557:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694366848 00000100:00100000:2.0:1763334962.511663:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4428 00000100:00100000:2.0:1763334962.511675:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52983:x1848989694366848:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.511702:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.511731:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84998b2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af490 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.511855:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84998b9 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.511872:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84998b9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.511889:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84998b9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.511906:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998c0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.511911:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.511917:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.512082:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84998c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.512092:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84998c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.512099:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84998c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334962.512110:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x188:0x0]: returning size 0 00010000:00010000:2.0:1763334962.512243:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84998b9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334962.512351:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.512433:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694367104 00000100:00100000:3.0:1763334962.512440:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694367104 00000100:00100000:3.0:1763334962.512480:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4429 00000100:00100000:3.0:1763334962.512489:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52274:x1848989694367104:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334962.512499:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.512502:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334962.512523:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f84998ab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af489 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.512540:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:3.0:1763334962.512546:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334962.512554:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84998d5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af497 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.512606:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84998dc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.512616:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84998c7 lrc: 2/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.512624:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84998dc lrc: 4/0,1 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.512642:0:29627:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84998c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.512652:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84998dc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.513782:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84998b9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.513802:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84998b9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.513809:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.513813:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84998b9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.513823:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84998b9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.513840:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.513843:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.513847:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84998b9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.513854:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f84998b9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.513872:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.513878:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998c0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.513884:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.513889:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.513892:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.513897:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998c0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.513905:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334962.513907:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.513910:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998c0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.513916:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998c0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.514458:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84998b2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af490 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.514489:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84998c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af490 expref: 191 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.514506:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84998c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af490 expref: 191 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.514514:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:0.0:1763334962.514648:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52983:x1848989694366848:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2973us (4914us total) trans 8589938680 rc 0/0 00000100:00100000:0.0:1763334962.514664:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4428 00000100:00100000:0.0:1763334962.519467:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.520063:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694367232 00000100:00100000:2.0:1763334962.520078:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694367232 00000100:00100000:1.0:1763334962.520491:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.521845:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4430 00000100:00100000:2.0:1763334962.521876:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52983:x1848989694367232:12345-192.168.201.60@tcp:101:lfs.0 00000100:00100000:3.0:1763334962.522095:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694367360 00000100:00100000:3.0:1763334962.522108:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694367360 00010000:00010000:3.0:1763334962.522152:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84998c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af490 expref: 192 pid: 32232 timeout: 1127 lvb_type: 0 00000100:00100000:3.0:1763334962.522197:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2417 00000100:00100000:3.0:1763334962.522205:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694367360:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334962.522225:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334962.522233:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84998c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af490 expref: 192 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334962.522246:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84998c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af490 expref: 192 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334962.522275:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84998c7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af490 expref: 192 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334962.522307:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:3.0:1763334962.522315:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84998dc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.522327:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84998dc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.522336:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84998dc lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.522378:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334962.522455:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:2360:x1848989694367360:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 251us (1967us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334962.522463:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2417 00010000:00010000:2.0:1763334962.522507:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.522529:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84998e3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af49e expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.522668:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.522681:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af47b expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.522688:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84998dc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.522695:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 5/1,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.522710:0:32232:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84998dc lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.522740:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af47b expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.522754:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af47b expref: 191 pid: 32232 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334962.522771:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701803264:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334962.522835:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bf00 going to sleep for 11 seconds 00010000:00010000:1.0:1763334962.522910:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84998dc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.522919:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84998dc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00000040:00080000:1.0:1763334962.523377:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1032, 88 off89104 00000004:00080000:1.0:1763334962.523389:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1027156815851ns, next at 1027972226189ns, rc = 0 00000040:00080000:1.0:1763334962.523431:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1021, 88 off88040 00000004:00080000:1.0:1763334962.523436:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1027156864396ns, next at 1027972101713ns, rc = 0 00000040:00080000:1.0:1763334962.523471:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1022, 88 off88128 00000004:00080000:1.0:1763334962.523477:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1027156905296ns, next at 1027972101713ns, rc = 0 00000040:00080000:1.0:1763334962.523493:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1033, 88 off89192 00000004:00080000:1.0:1763334962.523498:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1027156925630ns, next at 1027972226189ns, rc = 0 00000100:00100000:3.0:1763334962.534429:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701803264:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334962.534479:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334962.534595:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.534644:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694367488 00000100:00100000:0.0:1763334962.534654:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694367488 00010000:00010000:0.0:1763334962.534699:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af47b expref: 193 pid: 32232 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334962.534740:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2418 00000100:00100000:0.0:1763334962.534750:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2359:x1848989694367488:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334962.534770:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334962.534778:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af47b expref: 193 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.534792:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af47b expref: 193 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.534819:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499881 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x188:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af47b expref: 193 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.534844:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:0.0:1763334962.534849:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.534859:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.534864:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.534870:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334962.534938:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2359:x1848989694367488:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 188us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.534947:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2418 00010000:00010000:1.0:1763334962.571793:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84998dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af497 expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1763334962.571812:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938675 is committed 00010000:00010000:1.0:1763334962.571821:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:1.0:1763334962.571825:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334962.571830:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 3/1,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:3.0:1763334962.571831:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938681 is committed 00000004:00080000:3.0:1763334962.571836:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 682 committed 00010000:00010000:1.0:1763334962.571841:0:29627:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.571848:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00000004:00080000:3.0:1763334962.571853:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 670 committed 00000004:00080000:3.0:1763334962.571860:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 669 committed 00000004:00080000:3.0:1763334962.571864:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 681 committed 00000004:00080000:3.0:1763334962.571873:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 680 committed 00000004:00080000:3.0:1763334962.571876:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 668 committed 00010000:00010000:1.0:1763334962.571899:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84998d5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af497 expref: 180 pid: 29627 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763334962.571926:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84998dc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af497 expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.571972:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f800, rc 0) 00000100:00100000:3.0:1763334962.572053:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701803392:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334962.572063:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52274:x1848989694367104:12345-192.168.201.60@tcp:101:bash.0 Request processed in 59575us (59713us total) trans 8589938681 rc 0/0 00000100:00100000:1.0:1763334962.572073:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4429 00000100:00100000:3.0:1763334962.572125:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334962.572404:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701803392 00000100:00100000:3.0:1763334962.572413:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701803392 00000100:00100000:3.0:1763334962.572459:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4572 00000100:00100000:3.0:1763334962.572467:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3290:x1848989701803392:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334962.572496:0:25383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:540 count 1 00010000:00010000:3.0:1763334962.572524:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.572544:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849974d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af419 expref: 22 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.572552:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334962.572555:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334962.572559:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.572606:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849974d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af419 expref: 22 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.572620:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849974d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af419 expref: 22 pid: 32239 timeout: 1127 lvb_type: 0 00000100:00100000:3.0:1763334962.572632:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701803648:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334962.572676:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa806b40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334962.572861:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701803904:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.572891:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.572910:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701804416:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334962.572927:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.572940:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeef9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701804928:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334962.572954:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.572970:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1763334962.572974:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701804032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.572989:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.573001:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701804544:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334962.573018:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.573038:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701803520:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.573057:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.573072:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701804160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.573087:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.573097:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701804672:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334962.573112:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.573125:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1763334962.573129:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701803776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.573143:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.573154:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701804288:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334962.573168:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.573175:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701804800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334962.573190:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.573212:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701803904 00000100:00100000:2.0:1763334962.573216:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701803904 00000100:00100000:2.0:1763334962.573236:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701804416 00000100:00100000:2.0:1763334962.573238:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701804416 00000100:00100000:2.0:1763334962.573247:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701804928 00000100:00100000:2.0:1763334962.573250:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701804928 00000100:00100000:2.0:1763334962.573257:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701804032 00000100:00100000:2.0:1763334962.573259:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701804032 00000100:00100000:2.0:1763334962.573266:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4573 00000100:00100000:2.0:1763334962.573272:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701803904:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763334962.573446:0:6518:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:537 count 1 00010000:00010000:2.0:1763334962.573465:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.573482:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499700 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3fd expref: 22 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.573489:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334962.573491:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334962.573495:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.573516:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499700 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3fd expref: 22 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.573524:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499700 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3fd expref: 22 pid: 6518 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334962.573541:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee93ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701805056:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334962.573641:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701804544 00000100:00100000:3.0:1763334962.573645:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701804544 00000100:00100000:3.0:1763334962.573663:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701803520 00000100:00100000:3.0:1763334962.573665:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701803520 00000100:00100000:3.0:1763334962.573673:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701804160 00000100:00100000:3.0:1763334962.573675:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701804160 00000100:00100000:3.0:1763334962.573683:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701804672 00000100:00100000:3.0:1763334962.573685:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701804672 00000100:00100000:3.0:1763334962.573693:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701803776 00000100:00100000:3.0:1763334962.573695:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701803776 00000100:00100000:3.0:1763334962.573703:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701804288 00000100:00100000:3.0:1763334962.573705:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701804288 00000100:00100000:3.0:1763334962.573713:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701804800 00000100:00100000:3.0:1763334962.573715:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701804800 00000100:00100000:3.0:1763334962.573725:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4574 00000100:00100000:3.0:1763334962.573730:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3289:x1848989701804416:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334962.573743:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:537 count 1 00002000:00010000:3.0:1763334962.573772:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x219:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334962.573778:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84998ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.573786:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.573788:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.573793:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84998ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.573807:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84998ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.573818:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84998ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.573826:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84998ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.573845:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334962.574126:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3289:x1848989701804416:12345-0@lo:6:osp-syn-0-0.0 Request processed in 393us (1195us total) trans 21474838267 rc 0/0 00000100:00100000:3.0:1763334962.574137:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4574 00000100:00100000:3.0:1763334962.574154:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4575 00000100:00100000:3.0:1763334962.574160:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3289:x1848989701804928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334962.574382:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334962.574404:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4576 00000100:00100000:2.0:1763334962.574412:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3289:x1848989701804032:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763334962.575871:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.575893:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334962.575953:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x188:0x0]: returning size 2 00000004:00200000:0.0:1763334962.575959:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334962.575983:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.576041:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84998e3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x188:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af49e expref: 173 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.576065:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af49e expref: 172 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.576080:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:0.0:1763334962.576085:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763334962.576089:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067c00, rc 0) 00000100:00100000:0.0:1763334962.576179:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52983:x1848989694367232:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 54319us (56727us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.576190:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4430 00010000:00010000:0.0:1763334962.576710:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334962.576722:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84998ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.576733:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fc00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334962.576739:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84998ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.576751:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84998ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.576773:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84998ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.576782:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f84998ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.576806:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334962.576809:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334962.576810:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334962.576838:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4577 00000100:00100000:0.0:1763334962.576858:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef849c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3289:x1848989701804544:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334962.576889:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4578 00000100:00100000:0.0:1763334962.576898:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701803520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334962.576929:0:6517:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:541 count 1 00002000:00010000:0.0:1763334962.576970:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334962.576978:0:6517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f8499906 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.576994:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.576996:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.577003:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f8499906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.577016:0:6517:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f8499906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.577026:0:6517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f8499906 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.577034:0:6517:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f8499906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.577058:0:6517:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334962.577469:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334962.577478:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f8499906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.577486:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334962.577490:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f8499906 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.577498:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f8499906 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.577510:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f8499906 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.577517:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f8499906 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.577532:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.577534:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.577536:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763334962.577802:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a80a80/2, rc 0, transno 21474838267 00000100:00100000:1.0:1763334962.577811:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701804416:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334962.578547:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701804032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4130us (5550us total) trans 17179870985 rc 0/0 00000100:00100000:2.0:1763334962.578560:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4576 00000004:00080000:1.0:1763334962.578565:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a83100/2, rc 0, transno 17179870985 00000100:00100000:1.0:1763334962.578587:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701804032:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.578607:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4579 00000100:00100000:2.0:1763334962.578619:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701804160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763334962.578786:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334962.578790:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763334962.578793:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334962.578795:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763334962.578797:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334962.578837:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701804160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 223us (5749us total) trans 17179870986 rc 0/0 00000100:00100000:2.0:1763334962.578843:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4579 00000100:00100000:2.0:1763334962.578856:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4580 00000100:00100000:2.0:1763334962.578862:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3291:x1848989701804672:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334962.579028:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701803520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2131us (5968us total) trans 17179870984 rc 0/0 00000100:00100000:0.0:1763334962.579035:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4578 00000100:00100000:0.0:1763334962.579053:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4581 00000100:00100000:0.0:1763334962.579060:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701803776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334962.579076:0:6517:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:536 count 1 00010000:00010000:0.0:1763334962.579096:0:6517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.579120:0:6517:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af324 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.579129:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334962.579132:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334962.579136:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.579181:0:6517:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af324 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.579196:0:6517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499467 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af324 expref: 22 pid: 6518 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334962.579215:0:6517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6517:1848989701805184:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334962.579333:0:6517:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c58aa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334962.579358:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4582 00002000:00010000:3.0:1763334962.579539:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x21b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334962.579544:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x21b:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763334962.579546:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x21b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334962.579548:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x21b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763334962.579550:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x21b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334962.579611:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3289:x1848989701804928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5450us (6654us total) trans 21474838268 rc 0/0 00000100:00100000:3.0:1763334962.579621:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4575 00000100:00100000:3.0:1763334962.579646:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4583 00000100:00100000:3.0:1763334962.579654:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3291:x1848989701804800:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334962.579763:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a82680/2, rc 0, transno 17179870984 00000100:00100000:1.0:1763334962.579771:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701803520:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1763334962.579781:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a81180/2, rc 0, transno 17179870986 00000100:00100000:1.0:1763334962.579784:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701804160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334962.579835:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3291:x1848989701804800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 183us (6642us total) trans 21474838269 rc 0/0 00000100:00100000:3.0:1763334962.579842:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4583 00000004:00080000:1.0:1763334962.580099:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a81c00/2, rc 0, transno 21474838269 00000100:00100000:1.0:1763334962.580104:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701804800:0@lo:2:osp-syn-0-0.0 00002000:00080000:3.0:1763334962.580217:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:532 count 1 00010000:00010000:3.0:1763334962.580236:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.580254:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f84995da lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a2 expref: 22 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334962.580262:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.580264:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.580267:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.580311:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f84995da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a2 expref: 22 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334962.580322:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f84995da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a2 expref: 22 pid: 32239 timeout: 1127 lvb_type: 1 00000100:00100000:3.0:1763334962.580335:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21625:1848989701805312:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334962.580491:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa8069c0 going to sleep for 11 seconds 00000004:00080000:3.0:1763334962.580519:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeef9d180/2, rc 0, transno 21474838268 00000100:00100000:3.0:1763334962.580523:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeef9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701804928:0@lo:2:osp-syn-0-0.0 00002000:00080000:2.0:1763334962.582998:0:32239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:533 count 1 00010000:00010000:2.0:1763334962.583055:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.583085:0:32239:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499715 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af40b expref: 22 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.583096:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334962.583099:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334962.583103:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.583155:0:32239:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499715 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af40b expref: 22 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.583169:0:32239:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499715 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af40b expref: 22 pid: 6518 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334962.583190:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee93f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701805440:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334962.583318:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1763334962.583451:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+35:3291:x1848989701804288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334962.583532:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:536 count 1 00010000:00010000:0.0:1763334962.583548:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.583560:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499746 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af412 expref: 22 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.583566:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334962.583568:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334962.583589:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.583617:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499746 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af412 expref: 22 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.583627:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499746 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af412 expref: 22 pid: 25383 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334962.583637:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701805568:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334962.586867:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c58aa600 going to sleep for 11 seconds 00000100:00100000:3.0:1763334962.588823:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701803648:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334962.588861:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334962.588949:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.589589:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.589731:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694367616 00000100:00100000:0.0:1763334962.589742:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694367616 00010000:00010000:0.0:1763334962.589795:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849974d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af419 expref: 23 pid: 32239 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334962.589836:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694367744 00000100:00100000:0.0:1763334962.589839:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694367744 00010000:00010000:0.0:1763334962.589853:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499700 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3fd expref: 24 pid: 6518 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334962.589880:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2419 00000100:00100000:0.0:1763334962.589890:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694367616:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334962.589909:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334962.589915:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849974d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af419 expref: 24 pid: 32239 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.589929:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849974d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af419 expref: 24 pid: 32239 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.589959:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849974d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af419 expref: 24 pid: 32239 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.589979:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.589981:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.589986:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.589998:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.590026:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334962.590087:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694367616:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 198us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.590096:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2419 00000100:00100000:0.0:1763334962.590115:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2420 00000100:00100000:0.0:1763334962.590122:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694367744:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334962.590132:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334962.590137:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499700 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3fd expref: 22 pid: 6518 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.590146:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499700 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3fd expref: 22 pid: 6518 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.590160:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.590161:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.590165:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.590174:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.590186:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334962.590206:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694367744:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 85us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.590213:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2420 00010000:00010000:3.0:1763334962.590504:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499700 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3fd expref: 21 pid: 6518 timeout: 1127 lvb_type: 0 00000100:00100000:3.0:1763334962.590516:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee93ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701805056:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334962.590612:0:6518:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.590622:0:6518:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.590634:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.590645:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.590653:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.595077:0:6518:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334962.595191:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.595232:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.595349:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.595383:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.595413:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.595459:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694368256 00000100:00100000:0.0:1763334962.595463:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.595474:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694368256 00000100:00100000:0.0:1763334962.595489:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694368128 00000100:00100000:0.0:1763334962.595492:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694368128 00010000:00010000:2.0:1763334962.595527:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499715 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af40b expref: 24 pid: 6518 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.595527:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f84995da lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a2 expref: 24 pid: 32239 timeout: 1127 lvb_type: 1 00000100:00100000:2.0:1763334962.595568:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694368384 00000100:00100000:2.0:1763334962.595604:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694368384 00010000:00010000:2.0:1763334962.595620:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499746 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af412 expref: 25 pid: 25383 timeout: 1127 lvb_type: 0 00000100:00100000:3.0:1763334962.595968:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701803904:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22690us (23071us total) trans 17179870987 rc 0/0 00000100:00100000:3.0:1763334962.595979:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4573 00000100:00100000:3.0:1763334962.596004:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694367872 00000100:00100000:3.0:1763334962.596007:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694367872 00000100:00100000:3.0:1763334962.596028:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694368000 00000100:00100000:3.0:1763334962.596031:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694368000 00000100:00100000:3.0:1763334962.596054:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4584 00000100:00100000:3.0:1763334962.596063:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+22:52274:x1848989694367872:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334962.596082:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.596109:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f8499929 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af4a5 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334962.596136:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x21e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334962.596161:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.596164:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.596176:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f8499929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4a5 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.596194:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f8499929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4a5 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.596210:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f600, rc 0) 00010000:00010000:1.0:1763334962.596937:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334962.596950:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.596961:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334962.596967:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.596978:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.597000:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.597014:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f84998f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.597042:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.597044:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.597046:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334962.597735:0:6517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6517:1848989701805184:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334962.597772:0:6517:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334962.597814:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701805568:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334962.597828:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334962.598805:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+23:52274:x1848989694367872:12345-192.168.201.60@tcp:101:bash.0 Request processed in 2732us (3611us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334962.598821:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4584 00000100:00100000:3.0:1763334962.598875:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4585 00000100:00100000:3.0:1763334962.598895:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694368000:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334962.598918:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.598945:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499930 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af4ac expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334962.599032:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701805696:192.168.201.60@tcp:106: 00000100:00100000:3.0:1763334962.599539:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa8063c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334962.599644:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bed500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21625:1848989701805312:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334962.599670:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763334962.599718:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a80380/2, rc 0, transno 17179870987 00000100:00100000:3.0:1763334962.599727:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701803904:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763334962.599747:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.599761:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.599774:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.599782:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.599812:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334962.599986:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694368512 00000100:00100000:0.0:1763334962.599996:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694368512 00010000:00010000:0.0:1763334962.600031:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499467 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af324 expref: 24 pid: 6518 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334962.600054:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2421 00000100:00100000:0.0:1763334962.600063:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694368256:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334962.600077:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334962.600083:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499715 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af40b expref: 25 pid: 6518 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.600094:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499715 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af40b expref: 25 pid: 6518 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.600122:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.600124:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.600130:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.600140:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.600159:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334962.600201:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694368256:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 138us (4851us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.600208:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2421 00000100:00100000:0.0:1763334962.600227:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2422 00000100:00100000:0.0:1763334962.600235:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694368128:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334962.600244:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334962.600248:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f84995da lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a2 expref: 24 pid: 32239 timeout: 1127 lvb_type: 1 00010000:00010000:0.0:1763334962.600258:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f84995da lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a2 expref: 24 pid: 32239 timeout: 1127 lvb_type: 1 00010000:00010000:0.0:1763334962.600273:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f84995da lrc: 0/0,0 mode: --/PR res: [0x240000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af3a2 expref: 24 pid: 32239 timeout: 1127 lvb_type: 1 00010000:00010000:0.0:1763334962.600286:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.600288:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.600292:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.600311:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.600339:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334962.600380:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694368128:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 146us (4996us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.600387:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2422 00000100:00100000:0.0:1763334962.600401:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2423 00000100:00100000:0.0:1763334962.600408:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694368512:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334962.600419:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334962.600424:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499467 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af324 expref: 24 pid: 6518 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.600435:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af324 expref: 24 pid: 6518 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.600454:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499467 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af324 expref: 24 pid: 6518 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.600465:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.600466:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.600470:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.600482:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.600501:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334962.600521:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694368512:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 114us (5057us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.600529:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2423 00000100:00100000:0.0:1763334962.600541:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2424 00000100:00100000:0.0:1763334962.600548:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694368384:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334962.600557:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334962.600563:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499746 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af412 expref: 22 pid: 25383 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.600588:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499746 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af412 expref: 22 pid: 25383 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334962.600599:0:32239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499715 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af40b expref: 22 pid: 6518 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.600600:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499746 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af412 expref: 22 pid: 25383 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334962.600611:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee93f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701805440:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334962.600614:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.600616:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.600620:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.600626:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.600628:0:32239:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.600637:0:32239:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.600643:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.600645:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334962.600652:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.600660:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334962.600662:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694368384:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 116us (5249us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.600669:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2424 00010000:00010000:2.0:1763334962.600677:0:32239:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1763334962.600752:0:6517:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.600760:0:6517:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.600768:0:6517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.600774:0:6517:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.600787:0:6517:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1763334962.601071:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3291:x1848989701804672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22208us (27956us total) trans 21474838270 rc 0/0 00000100:00100000:2.0:1763334962.601081:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4580 00010000:00010000:2.0:1763334962.601112:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1763334962.601120:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.601129:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168ee00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334962.601136:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.601147:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.601162:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.601169:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f84998f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.601188:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763334962.601192:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.601198:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334962.601201:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.601208:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.601217:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.601223:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849991b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.601245:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334962.601248:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.601267:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334962.601270:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.601278:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.601617:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.601629:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.601637:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.601645:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.601669:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334962.601943:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef849c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3289:x1848989701804544:12345-0@lo:6:osp-syn-0-0.0 Request processed in 25093us (28922us total) trans 21474838271 rc 0/0 00000100:00100000:1.0:1763334962.601952:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4577 00010000:00010000:1.0:1763334962.601981:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334962.601987:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.601996:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc16f8b40) 00000100:00100000:0.0:1763334962.601996:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701803776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22935us (28850us total) trans 17179870988 rc 0/0 00010000:00010000:1.0:1763334962.601999:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.602008:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334962.602008:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4581 00010000:00010000:1.0:1763334962.602021:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.602028:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499914 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.602028:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.602043:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.602045:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.602047:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334962.602052:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.602061:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.602070:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.602077:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.602097:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334962.602235:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+36:3291:x1848989701804288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22869us (29064us total) trans 21474838272 rc 0/0 00000100:00100000:3.0:1763334962.602859:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701803392:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30391us (30732us total) trans 17179870989 rc 0/0 00000100:00100000:3.0:1763334962.602869:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4572 00010000:00010000:3.0:1763334962.603024:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334962.603031:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.603041:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334962.603044:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.603052:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.603065:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.603077:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499922 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.603093:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334962.603094:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334962.603096:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334962.603140:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a82d80/2, rc 0, transno 21474838271 00000100:00100000:3.0:1763334962.603147:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701804544:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763334962.603177:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a81500/2, rc 0, transno 17179870989 00000100:00100000:3.0:1763334962.603182:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701803392:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763334962.603562:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.603589:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849990d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.603606:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334962.603608:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334962.603610:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334962.603637:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a82300/2, rc 0, transno 17179870988 00000100:00100000:2.0:1763334962.603642:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701803776:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1763334962.603653:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a80000/2, rc 0, transno 21474838272 00000100:00100000:2.0:1763334962.603656:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701804288:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763334962.603666:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a82a00/2, rc 0, transno 21474838270 00000100:00100000:2.0:1763334962.603669:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701804672:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763334962.606484:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334962.611237:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4582 00000100:00100000:1.0:1763334962.620139:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.620307:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694368640 00000100:00100000:0.0:1763334962.620325:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694368640 00000100:00100000:0.0:1763334962.620413:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4586 00000100:00100000:0.0:1763334962.620427:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+20:52274:x1848989694368640:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334962.620452:0:7819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.620486:0:7819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499937 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af4b3 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334962.620522:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x21a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334962.620553:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.620556:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.620568:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499937 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4b3 expref: 21 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.620608:0:7819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499937 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4b3 expref: 21 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.620624:0:7819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334962.620696:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:52274:x1848989694368640:12345-192.168.201.60@tcp:101:bash.0 Request processed in 272us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.620704:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4586 00002000:00010000:3.0:1763334962.620905:0:6518:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x21e:0x0] updating lvb mtime: 0 -> 1763334963 00002000:00010000:3.0:1763334962.620910:0:6518:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x21e:0x0] updating lvb atime: 0 -> 1763334963 00002000:00010000:3.0:1763334962.620913:0:6518:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x21e:0x0] updating lvb ctime: 0 -> 1763334963 00000100:00100000:3.0:1763334962.620929:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701805696:192.168.201.60@tcp:106: 00010000:00010000:3.0:1763334962.620967:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499930 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4ac expref: 22 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334962.620984:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499930 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4ac expref: 22 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334962.620998:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168e200, rc 0) 00000100:00100000:3.0:1763334962.621020:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694368000:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 22138us (25788us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334962.621027:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4585 00000100:00100000:0.0:1763334962.623046:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.623098:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.623201:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694368896 00000100:00100000:1.0:1763334962.623216:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694368896 00002000:00010000:1.0:1763334962.623269:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/538 (0->18446744073709551615) 00002000:00100000:1.0:1763334962.623275:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad88bd880 with x1848989694368896 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334962.623308:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ad88bd880. 00000100:00100000:1.0:1763334962.623341:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694368768 00000100:00100000:1.0:1763334962.623345:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694368768 00002000:00010000:1.0:1763334962.623359:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/542 (0->18446744073709551615) 00002000:00100000:1.0:1763334962.623363:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad88bce00 with x1848989694368768 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334962.623370:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad88bce00. 00000100:00100000:1.0:1763334962.623401:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1696 00000100:00100000:1.0:1763334962.623412:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694368896:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334962.623892:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x21a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334962.623899:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x21a:0x0] updating lvb mtime from disk: 0 -> 1763334963 00002000:00010000:1.0:1763334962.623902:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x21a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334962.623905:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x21a:0x0] updating lvb ctime from disk: 0 -> 1763334963 00002000:00010000:1.0:1763334962.623908:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x21a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334962.623983:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694368896:12345-192.168.201.60@tcp:10:bash.0 Request processed in 571us (949us total) trans 21474838273 rc 0/0 00000100:00100000:1.0:1763334962.623991:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1696 00002000:00010000:1.0:1763334962.623996:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/538 (0->18446744073709551615) 00002000:00100000:1.0:1763334962.623999:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad88bd880 with x1848989694368896 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334962.624003:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ad88bd880. 00000100:00100000:1.0:1763334962.624024:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1697 00000100:00100000:1.0:1763334962.624031:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694368768:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334962.624202:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x21e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334962.624205:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x21e:0x0] updating lvb mtime from disk: 1763334963 -> 1763334963 00002000:00010000:1.0:1763334962.624209:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x21e:0x0] updating lvb atime from disk: 1763334963 -> 0 00002000:00010000:1.0:1763334962.624211:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x21e:0x0] updating lvb ctime from disk: 1763334963 -> 1763334963 00002000:00010000:1.0:1763334962.624213:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x21e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334962.624236:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694368768:12345-192.168.201.60@tcp:10:bash.0 Request processed in 205us (1138us total) trans 17179870990 rc 0/0 00000100:00100000:1.0:1763334962.624242:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1697 00002000:00010000:1.0:1763334962.624245:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/542 (0->18446744073709551615) 00002000:00100000:1.0:1763334962.624248:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad88bce00 with x1848989694368768 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334962.624252:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad88bce00. 00000100:00100000:2.0:1763334962.626936:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.627039:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694369152 00000100:00100000:0.0:1763334962.627053:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694369152 00000100:00100000:0.0:1763334962.627122:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1637 00000100:00100000:0.0:1763334962.627133:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+172:52983:x1848989694369152:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334962.627599:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52983:x1848989694369152:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 437us (645us total) trans 8589938682 rc 0/0 00000100:00100000:0.0:1763334962.627609:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1637 00000100:00100000:1.0:1763334962.635788:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.635902:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694369408 00000100:00100000:2.0:1763334962.635917:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694369408 00000100:00100000:2.0:1763334962.635983:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1638 00000100:00100000:2.0:1763334962.635995:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52274:x1848989694369408:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:2.0:1763334962.638512:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52274:x1848989694369408:12345-192.168.201.60@tcp:35:bash.0 Request processed in 2500us (2720us total) trans 8589938683 rc 0/0 00000100:00100000:2.0:1763334962.638530:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1638 00000100:00100000:2.0:1763334962.643867:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.643975:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694369664 00000100:00100000:0.0:1763334962.643991:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694369664 00000100:00100000:0.0:1763334962.644136:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4431 00000100:00100000:0.0:1763334962.644150:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52983:x1848989694369664:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334962.644186:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.644219:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849993e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af4ba expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.644640:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499945 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.644658:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499945 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.644670:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499945 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.644687:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849994c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.644693:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849994c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.644699:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849994c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.644889:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499953 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.644900:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499953 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.644908:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499953 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334962.644921:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x188:0x0]: returning size 5 00010000:00010000:0.0:1763334962.645053:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499945 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645063:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499945 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645076:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499945 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645083:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.645089:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499945 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645098:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499945 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645111:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.645115:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.645120:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499945 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645126:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499945 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645143:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849994c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645149:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849994c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645156:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849994c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645162:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.645165:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849994c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645171:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849994c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645180:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334962.645183:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.645186:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849994c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645192:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849994c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.645247:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849993e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4ba expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.645264:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499953 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4ba expref: 176 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.645272:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:0.0:1763334962.645274:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334962.645277:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:0.0:1763334962.650425:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52983:x1848989694369664:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6257us (6555us total) trans 8589938684 rc 0/0 00000100:00100000:0.0:1763334962.650443:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4431 00000100:00100000:1.0:1763334962.661652:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.661774:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694369792 00000100:00100000:0.0:1763334962.661792:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694369792 00000100:00100000:0.0:1763334962.661875:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4432 00000100:00100000:0.0:1763334962.661888:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52984:x1848989694369792:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:0.0:1763334962.661926:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.661955:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499961 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af4c1 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.662058:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499968 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662076:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499968 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662089:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499968 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662103:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849996f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662110:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849996f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662116:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849996f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662272:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499976 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662282:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499976 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662308:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499976 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334962.662357:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x188:0x0]: returning size 5 00000004:00200000:0.0:1763334962.662363:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334962.662399:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499976 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662414:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499976 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662424:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499968 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662432:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499968 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662439:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499968 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662445:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.662451:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499968 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662460:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499968 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662475:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.662478:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.662483:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499968 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662489:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499968 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662504:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849996f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662510:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849996f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662515:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849996f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662520:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.662523:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849996f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662528:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849996f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662535:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334962.662537:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.662540:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849996f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662545:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849996f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.662632:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499961 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4c1 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.662649:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499976 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4c1 expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.662656:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:0.0:1763334962.662659:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334962.662662:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334962.662743:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52984:x1848989694369792:12345-192.168.201.60@tcp:101:rm.0 Request processed in 857us (1105us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.662752:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4432 00000100:00100000:2.0:1763334962.666100:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.666521:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694370048 00000100:00100000:3.0:1763334962.666537:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694370048 00000100:00100000:0.0:1763334962.666678:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1639 00000100:00100000:0.0:1763334962.666695:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52983:x1848989694370048:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334962.667225:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52983:x1848989694370048:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 532us (1137us total) trans 8589938685 rc 0/0 00000100:00100000:1.0:1763334962.667236:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1639 00000100:00100000:2.0:1763334962.667942:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.668004:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694370176 00000100:00100000:0.0:1763334962.668012:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694370176 00000100:00100000:0.0:1763334962.668071:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 384 00000100:00100000:0.0:1763334962.668082:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2360:x1848989694370176:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334962.668103:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334962.668135:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499976 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4c1 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.668156:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:0.0:1763334962.668162:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334962.668210:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88edc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:2360:x1848989694370176:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 130us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.668217:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 384 00000100:00100000:2.0:1763334962.670656:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.670867:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694370432 00000100:00100000:1.0:1763334962.670880:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694370432 00000100:00100000:1.0:1763334962.670955:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4433 00000100:00100000:1.0:1763334962.670967:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52984:x1848989694370432:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:1.0:1763334962.671043:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763334962.671079:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f84998dc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x188:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af497 expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.671104:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499953 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4ba expref: 176 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.671118:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f84998ea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x188:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af49e expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.671133:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:1.0:1763334962.671143:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334962.671177:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849997d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.671194:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849997d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.671205:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849997d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.671223:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499984 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.671229:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499984 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.671235:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499984 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.671725:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849998b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.671738:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849998b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.671746:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849998b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000040:00080000:1.0:1763334962.672974:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1034, 64 off89256 00000040:00080000:1.0:1763334962.673033:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1023, 64 off88192 00000040:00080000:1.0:1763334962.673053:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1024, 64 off88256 00000040:00080000:1.0:1763334962.673067:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1035, 64 off89320 00010000:00010000:1.0:1763334962.673168:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499992 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x188:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673185:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499992 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673197:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499992 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673207:0:29627:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499992 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673214:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499992 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673220:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499992 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673725:0:29627:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334962.673762:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849998b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673771:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849998b lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673779:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849998b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673785:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.673792:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849998b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673801:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849998b lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673816:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac511c300) 00010000:00010000:1.0:1763334962.673821:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763334962.673826:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849998b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673832:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849998b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x188:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673918:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849997d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673924:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849997d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673929:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849997d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673934:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.673936:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849997d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673942:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849997d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673950:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334962.673953:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.673956:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849997d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.673962:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849997d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:1.0:1763334962.673973:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009a931010 reply state 0000000022da2b3d transno 8589938686 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499984 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334962.673982:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334962.674120:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52984:x1848989694370432:12345-192.168.201.60@tcp:36:rm.0 Request processed in 3148us (3471us total) trans 8589938686 rc 0/0 00000100:00100000:1.0:1763334962.674130:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4433 00010000:00010000:2.0:1763334962.674241:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334962.674265:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499992 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.674272:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334962.674275:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499992 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.674282:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499992 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.674300:0:5737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x188:0x0].0x0 (ffff9a5ac511c300) 00010000:00010000:2.0:1763334962.674303:0:5737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763334962.674306:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499992 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.674312:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499992 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x188:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.674332:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334962.674334:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334962.674335:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334962.680157:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334962.680896:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499984 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.680916:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499984 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.680925:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499984 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.680932:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.680938:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499984 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.680948:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499984 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.680971:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac511c700) 00010000:00010000:2.0:1763334962.680975:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.680981:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499984 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.680988:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499984 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334962.682654:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694370688 00000100:00100000:0.0:1763334962.682679:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694370688 00000100:00100000:1.0:1763334962.683155:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4434 00000100:00100000:1.0:1763334962.683170:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52983:x1848989694370688:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334962.683209:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334962.683239:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499999 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af4c8 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.684604:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84999a0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684628:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84999a0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684643:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84999a0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684661:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84999a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684667:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84999a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684674:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84999a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684764:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84999a0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684772:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84999a0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684784:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84999a0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684790:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.684795:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84999a0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684802:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84999a0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684816:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334962.684821:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.684828:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84999a0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684835:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f84999a0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684856:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84999a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684861:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84999a7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684866:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84999a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684871:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.684874:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84999a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684880:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84999a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684888:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac94cce00) 00010000:00010000:1.0:1763334962.684891:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.684893:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84999a7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684898:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f84999a7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.684939:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499999 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4c8 expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.684951:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334962.684954:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334962.684957:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499999 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4c8 expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.684967:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:1.0:1763334962.685072:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52983:x1848989694370688:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1904us (4933us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334962.685081:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4434 00000100:00100000:1.0:1763334962.709407:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.709552:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694370944 00000100:00100000:2.0:1763334962.709566:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694370944 00000100:00100000:2.0:1763334962.709647:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4435 00000100:00100000:2.0:1763334962.709658:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52986:x1848989694370944:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.709688:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.709716:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84999ae lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af4cf expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.709817:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999b5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.709835:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999b5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.709849:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999b5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.709865:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999bc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.709871:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.709877:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.709963:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999b5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.709970:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999b5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.709977:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.709983:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.709987:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.709996:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999b5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.710009:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.710012:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.710017:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999b5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.710023:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.710036:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999bc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.710042:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999bc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.710048:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999bc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.710052:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.710055:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999bc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.710060:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999bc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.710066:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334962.710068:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.710070:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999bc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.710075:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999bc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.710114:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84999ae lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4cf expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.710124:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.710127:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334962.710130:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84999ae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4cf expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.710140:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067400, rc 0) 00000100:00100000:2.0:1763334962.710221:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52986:x1848989694370944:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 564us (831us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334962.710229:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4435 00000100:00100000:0.0:1763334962.717976:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.718213:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694371072 00000100:00100000:2.0:1763334962.718232:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694371072 00000100:00100000:2.0:1763334962.718324:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4436 00000100:00100000:2.0:1763334962.718338:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52985:x1848989694371072:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.718373:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.718412:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84999c3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af4d6 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.718523:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999ca lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718544:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718562:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718622:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718630:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718638:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718733:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718740:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999ca lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718748:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718754:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.718759:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718767:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999ca lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718782:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.718786:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.718793:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999ca lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718800:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f84999ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718815:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718822:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999d1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718827:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718832:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.718835:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718847:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718854:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334962.718857:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.718859:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999d1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718864:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f84999d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.718906:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84999c3 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4d6 expref: 176 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.718917:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.718920:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.718924:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f84999c3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4d6 expref: 176 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.718934:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067400, rc 0) 00000100:00100000:2.0:1763334962.719025:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52985:x1848989694371072:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 691us (1067us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334962.719034:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4436 00000100:00100000:1.0:1763334962.724546:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.724750:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694371200 00000100:00100000:2.0:1763334962.724765:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694371200 00000100:00100000:2.0:1763334962.724839:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4437 00000100:00100000:2.0:1763334962.724851:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52985:x1848989694371200:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.724879:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.724910:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84999d8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af4dd expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.725008:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84999df lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725027:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84999df lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725043:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84999df lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725059:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84999e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725065:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84999e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725072:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84999e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725160:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84999df lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725169:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84999df lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725176:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84999df lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725182:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.725187:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84999df lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725195:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84999df lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725209:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.725212:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.725218:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84999df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725224:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f84999df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725239:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84999e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725245:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84999e6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725263:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84999e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725268:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.725271:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84999e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725277:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84999e6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725285:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334962.725287:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.725289:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84999e6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725304:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f84999e6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.725342:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84999d8 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4dd expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.725353:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.725355:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.725359:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f84999d8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4dd expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.725369:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067a00, rc 0) 00000100:00100000:2.0:1763334962.725451:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52985:x1848989694371200:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 603us (923us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334962.725460:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4437 00000100:00100000:3.0:1763334962.730130:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.733174:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694371328 00000100:00100000:0.0:1763334962.733196:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694371328 00000100:00100000:3.0:1763334962.733228:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.733341:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694371456 00000100:00100000:0.0:1763334962.733346:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694371456 00000100:00100000:0.0:1763334962.733388:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4438 00000100:00100000:0.0:1763334962.733400:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52986:x1848989694371328:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334962.733431:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763334962.733464:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4439 00010000:00010000:0.0:1763334962.733464:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f84999ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af4e4 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334962.733474:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52985:x1848989694371456:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334962.733481:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.733493:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84999f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af4eb expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.733554:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84999fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.733554:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499a02 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.733782:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499a02 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.733803:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84999fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.733803:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499a02 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.733812:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84999fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.733821:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a09 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.733828:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.733833:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334962.733891:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334962.733895:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:0.0:1763334962.733902:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499a02 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.733909:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499a02 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.733916:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499a02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00000004:00010000:3.0:1763334962.733920:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84999fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.733922:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.733926:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499a02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.733934:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499a02 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.733946:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.733947:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f84999f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4eb expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.733949:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.733955:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499a02 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.733961:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499a02 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.733967:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84999fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4eb expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.733970:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.733975:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.733976:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a09 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.733978:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334962.733981:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168e200, rc 0) 00010000:00010000:0.0:1763334962.733982:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.733986:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.733988:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.733992:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a09 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.733998:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334962.734001:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.734003:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a09 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.734008:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a09 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.734031:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f84999ed lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4e4 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.734042:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.734044:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.734048:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f84999ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4e4 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334962.734062:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52985:x1848989694371456:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 590us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334962.734069:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4439 00010000:00010000:0.0:1763334962.734384:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793800, rc 0) 00000100:00100000:0.0:1763334962.734422:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52986:x1848989694371328:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1024us (4306us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334962.734429:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4438 00000100:00100000:3.0:1763334962.739866:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.740554:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694371712 00000100:00100000:0.0:1763334962.740800:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694371712 00000100:00100000:1.0:1763334962.741283:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4440 00000100:00100000:1.0:1763334962.741307:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52985:x1848989694371712:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334962.741336:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334962.741340:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334962.741373:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f84999fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4eb expref: 176 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.741397:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334962.741403:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334962.741420:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499a10 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af4f2 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.741670:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499a17 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.741687:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499a17 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.741700:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499a17 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.741719:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499a1e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.741725:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499a1e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.741732:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499a1e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.742396:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499a25 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.742410:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499a25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.742418:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499a25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334962.742430:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x189:0x0]: returning size 0 00010000:00010000:1.0:1763334962.742462:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499a17 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.742469:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499a17 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.742476:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499a17 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.742482:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.742487:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499a17 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.742495:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499a17 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.742504:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334962.742507:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.742512:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499a17 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334962.742518:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499a17 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:1.0:1763334962.742532:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000064fd93ec reply state 000000001595b867 transno 8589938687 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499a1e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334962.742541:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763334962.742607:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499a10 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4f2 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.742623:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499a25 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4f2 expref: 177 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.742636:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac94cc600) 00010000:00010000:1.0:1763334962.742639:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334962.742641:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334962.742753:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52985:x1848989694371712:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1458us (2903us total) trans 8589938687 rc 0/0 00000100:00100000:1.0:1763334962.742762:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4440 00000100:00100000:3.0:1763334962.748652:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.748723:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694371968 00000100:00100000:0.0:1763334962.748738:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694371968 00000100:00100000:0.0:1763334962.748829:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4441 00000100:00100000:0.0:1763334962.748844:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52985:x1848989694371968:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334962.748882:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.748913:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499a33 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af4f9 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334962.748969:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334962.749037:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499a1e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.749048:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499a1e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.749056:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499a1e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.749062:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.749070:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499a1e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.749074:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.749079:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499a1e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.749089:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499a25 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4f2 expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.749097:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac94cce00) 00010000:00010000:0.0:1763334962.749098:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.749100:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.749106:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499a1e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334962.749111:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499a1e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.749142:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499a25 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4f2 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334962.749146:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694372224 00000100:00100000:2.0:1763334962.749150:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694372224 00010000:00010000:0.0:1763334962.749156:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499a25 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4f2 expref: 179 pid: 32232 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334962.749180:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad88be680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701805824:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334962.749184:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4442 00000100:00100000:2.0:1763334962.749190:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52987:x1848989694372224:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.749198:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.749207:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499a41 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af500 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.749247:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a48 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.749270:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.749280:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334962.749309:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x189:0x0]: returning size 0 00000100:00100000:0.0:1763334962.749315:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c58aac00 going to sleep for 11 seconds 00010000:00010000:2.0:1763334962.750211:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.750224:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a48 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.750230:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a48 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.750235:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.750239:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a48 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.750245:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a48 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.750462:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac94cc600) 00010000:00010000:2.0:1763334962.750465:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334962.750470:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a48 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.750476:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a48 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.750542:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499a41 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af500 expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.750555:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.750557:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334962.750562:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499a41 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af500 expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.750680:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:2.0:1763334962.750861:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52987:x1848989694372224:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1667us (1890us total) trans 8589938688 rc 301/301 00000100:00100000:2.0:1763334962.750871:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4442 00000100:00100000:3.0:1763334962.751163:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad88be680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701805824:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334962.751192:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334962.752930:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.752979:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.753018:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694372352 00000100:00100000:2.0:1763334962.753031:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694372352 00000100:00100000:1.0:1763334962.753054:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694372608 00000100:00100000:1.0:1763334962.753060:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694372608 00010000:00010000:2.0:1763334962.753079:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499a25 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4f2 expref: 181 pid: 32232 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334962.753111:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2425 00000100:00100000:1.0:1763334962.753111:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1640 00000100:00100000:2.0:1763334962.753121:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+181:2360:x1848989694372352:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763334962.753121:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52987:x1848989694372608:12345-192.168.201.60@tcp:35:lfs.0 00010000:00010000:2.0:1763334962.753139:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334962.753147:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499a25 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4f2 expref: 181 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334962.753159:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499a25 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4f2 expref: 181 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334962.753184:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499a25 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4f2 expref: 181 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334962.753202:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac94cc600) 00010000:00010000:2.0:1763334962.753207:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.753217:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.753225:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.753259:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334962.753334:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+181:2360:x1848989694372352:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 214us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334962.753341:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2425 00010000:00010000:2.0:1763334962.753381:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.753389:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334962.753399:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52987:x1848989694372608:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 280us (420us total) trans 8589938689 rc 0/0 00000100:00100000:1.0:1763334962.753405:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1640 00000004:00200000:2.0:1763334962.753408:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x189:0x0]: returning size 0 00000004:00080000:2.0:1763334962.753811:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21c:0x0], index 0: 0 00000004:00080000:2.0:1763334962.753823:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x220:0x0], index 1: 0 00000004:00080000:2.0:1763334962.753830:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x221:0x0], index 1: 0 00000004:00080000:2.0:1763334962.753836:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21d:0x0], index 0: 0 00010000:00010000:2.0:1763334962.753998:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.754007:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.754014:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.754020:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.754025:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.754033:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.754050:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac94cc600) 00010000:00010000:2.0:1763334962.754058:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334962.754063:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.754069:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499a3a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.754134:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499a33 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4f9 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.754144:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.754147:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334962.754151:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499a33 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4f9 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.754160:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793800, rc 0) 00000100:00100000:2.0:1763334962.754215:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52985:x1848989694371968:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5371us (5573us total) trans 8589938690 rc 301/301 00000100:00100000:2.0:1763334962.754223:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4441 00000100:00100000:0.0:1763334962.756528:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.756649:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694372864 00000100:00100000:3.0:1763334962.756664:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694372864 00000100:00100000:3.0:1763334962.756923:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1641 00000100:00100000:3.0:1763334962.756935:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52985:x1848989694372864:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334962.758968:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52985:x1848989694372864:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 2024us (2441us total) trans 8589938691 rc 0/0 00000100:00100000:0.0:1763334962.758985:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1641 00000100:00100000:0.0:1763334962.760095:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.761566:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.761985:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694373120 00000100:00100000:2.0:1763334962.762000:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694373120 00000100:00100000:2.0:1763334962.762333:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4443 00000100:00100000:2.0:1763334962.762347:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52987:x1848989694373120:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.762384:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.762414:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499a5d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af507 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.762535:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499a64 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.762554:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499a64 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.762596:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499a64 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.762614:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499a6b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.762622:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499a6b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.762629:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499a6b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.762795:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499a72 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.762804:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499a72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.762812:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499a72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334962.762823:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x189:0x0]: returning size 0 00010000:00010000:2.0:1763334962.762948:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499a64 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.762957:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499a64 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.762967:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499a64 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.762973:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.762978:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499a64 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.762987:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499a64 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.763002:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.763006:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.763012:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499a64 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.763018:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499a64 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.763032:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499a6b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.763038:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499a6b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.763045:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499a6b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.763049:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.763052:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499a6b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.763058:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499a6b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.763065:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334962.763068:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.763071:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499a6b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.763075:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499a6b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.763124:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499a5d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af507 expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.763140:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499a72 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af507 expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.763147:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334962.763150:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334962.763153:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:2.0:1763334962.763244:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52987:x1848989694373120:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 899us (3151us total) trans 8589938692 rc 0/0 00000100:00100000:2.0:1763334962.763252:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4443 00000100:00100000:1.0:1763334962.764919:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694373376 00000100:00100000:1.0:1763334962.764942:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694373376 00000100:00100000:1.0:1763334962.765018:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1642 00000100:00100000:1.0:1763334962.765029:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52985:x1848989694373376:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334962.765349:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52985:x1848989694373376:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 320us (3791us total) trans 8589938693 rc 0/0 00000100:00100000:1.0:1763334962.765357:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1642 00000100:00100000:2.0:1763334962.767174:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.767326:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694373504 00000100:00100000:3.0:1763334962.767339:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694373504 00000100:00100000:3.0:1763334962.767684:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4587 00000100:00100000:3.0:1763334962.767697:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694373504:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334962.767720:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.767749:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499a80 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af50e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334962.767782:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x21c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334962.767812:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.767814:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.767828:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499a80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af50e expref: 23 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334962.767849:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499a80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af50e expref: 23 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334962.767866:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168ee00, rc 0) 00000100:00100000:3.0:1763334962.768397:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694373504:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 699us (1230us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334962.768406:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4587 00000100:00100000:0.0:1763334962.772142:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.773476:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694373760 00000100:00100000:2.0:1763334962.773493:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694373760 00000100:00100000:2.0:1763334962.773590:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4444 00000100:00100000:2.0:1763334962.773605:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52274:x1848989694373760:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334962.773639:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.773670:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499a87 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af515 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.773825:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.773843:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499a72 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af507 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.773855:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 4/0,1 mode: --/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.773903:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499a72 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af507 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.773921:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499a72 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af507 expref: 184 pid: 30972 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334962.773937:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee93f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701805952:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334962.774052:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44be40 going to sleep for 11 seconds 00000100:00100000:0.0:1763334962.775556:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.777171:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694374016 00000100:00100000:2.0:1763334962.777193:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694374016 00000100:00100000:3.0:1763334962.777853:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.778147:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694374144 00000100:00100000:0.0:1763334962.778154:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694374144 00010000:00010000:0.0:1763334962.778197:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499a72 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af507 expref: 186 pid: 30972 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334962.778246:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2426 00000100:00100000:0.0:1763334962.778273:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2359:x1848989694374144:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334962.778303:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334962.778312:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499a72 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af507 expref: 186 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.778326:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499a72 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af507 expref: 186 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.778365:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:0.0:1763334962.778372:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.778386:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.778394:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.778420:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334962.778494:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2359:x1848989694374144:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 223us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.778502:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2426 00010000:00010000:0.0:1763334962.778690:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499a72 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af507 expref: 185 pid: 30972 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334962.778708:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee93f100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701805952:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334962.778734:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.778742:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.778747:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334962.778772:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x189:0x0]: returning size 0 00010000:00010000:0.0:1763334962.778995:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499a87 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af515 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.779013:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af515 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.779025:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:0.0:1763334962.779028:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763334962.779030:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:0.0:1763334962.779069:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694373760:12345-192.168.201.60@tcp:101:bash.0 Request processed in 5468us (6945us total) trans 8589938694 rc 0/0 00000100:00100000:0.0:1763334962.779078:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4444 00000100:00100000:2.0:1763334962.780796:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1643 00000100:00100000:2.0:1763334962.780825:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52987:x1848989694374016:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334962.781288:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52987:x1848989694374016:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 475us (5740us total) trans 8589938695 rc 0/0 00000100:00100000:2.0:1763334962.781308:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1643 00000100:00100000:1.0:1763334962.783223:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.783455:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694374400 00000100:00100000:3.0:1763334962.783468:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694374400 00000100:00100000:3.0:1763334962.783863:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4445 00000100:00100000:3.0:1763334962.783877:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694374400:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:3.0:1763334962.784299:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499a9c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.784323:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499a9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.784338:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499a9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:3.0:1763334962.784409:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938696 00000004:00010000:3.0:1763334962.784436:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000016616a15 reply state 000000003bb96764 transno 8589938697 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499a9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334962.784448:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334962.784568:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694374400:12345-192.168.201.60@tcp:36:bash.0 Request processed in 693us (1358us total) trans 8589938697 rc 0/0 00000100:00100000:3.0:1763334962.784600:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4445 00000020:00080000:3.0:1763334962.784608:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763334962.789234:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.790825:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694374656 00000100:00100000:3.0:1763334962.790845:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694374656 00000100:00100000:3.0:1763334962.790926:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4446 00000100:00100000:3.0:1763334962.790939:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52987:x1848989694374656:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334962.790974:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.791004:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499aa3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af51c expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.791115:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499aaa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.791134:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499aaa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.791149:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499aaa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.791168:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499ab1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.791175:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.791183:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.791389:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499ab8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.791400:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x18/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.791410:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x18/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334962.791423:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x189:0x0]: returning size 0 00010000:00010000:3.0:1763334962.791559:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499aaa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.791568:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499aaa lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.793312:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499aaa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.793320:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.793327:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499aaa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.793339:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499aaa lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.793359:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.793363:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.793370:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499aaa lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.793378:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499aaa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.793398:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499ab1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.793404:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499ab1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.793414:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.793419:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.793421:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499ab1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.793427:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499ab1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.793434:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5e600) 00010000:00010000:3.0:1763334962.793437:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.793440:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499ab1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.793446:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499ab1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.793531:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499aa3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af51c expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.793546:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x18/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af51c expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.793553:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:3.0:1763334962.793556:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 18 00010000:00010000:3.0:1763334962.793559:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abf400, rc 0) 00000100:00100000:2.0:1763334962.795161:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.795222:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694374784 00000100:00100000:2.0:1763334962.795237:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694374784 00000100:00100000:2.0:1763334962.795322:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4447 00000100:00100000:2.0:1763334962.795335:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52274:x1848989694374784:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334962.795371:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.795397:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499ac6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af523 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.795480:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af523 expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.795498:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af523 expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.795520:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334962.795523:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334962.795526:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:2.0:1763334962.795619:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52274:x1848989694374784:12345-192.168.201.60@tcp:101:bash.0 Request processed in 286us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334962.795626:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4447 00010000:00010000:1.0:1763334962.795833:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499a9c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.795847:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499a9c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.795855:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499a9c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.795862:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.795866:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499a9c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.795875:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499a9c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.795890:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:1.0:1763334962.795892:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.795896:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499a9c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x189:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.795902:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499a9c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x189:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334962.796873:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52987:x1848989694374656:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5929us (7649us total) trans 8589938698 rc 0/0 00000100:00100000:3.0:1763334962.796885:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4446 00000100:00100000:0.0:1763334962.800309:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.800367:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.800634:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694375040 00000100:00100000:2.0:1763334962.800652:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694375040 00000100:00100000:2.0:1763334962.800721:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1644 00000100:00100000:2.0:1763334962.800732:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52987:x1848989694375040:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334962.801444:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694375296 00000100:00100000:3.0:1763334962.801450:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694375296 00000100:00100000:3.0:1763334962.801489:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4448 00000100:00100000:3.0:1763334962.801498:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52274:x1848989694375296:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334962.801510:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.801514:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334962.801548:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499ac6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af523 expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.801592:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:3.0:1763334962.801598:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334962.801629:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8499acd lrc: 2/0,0 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af52a expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.801675:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ad4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.801689:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499ab8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af51c expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.801698:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ad4 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.801742:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af51c expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.801757:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af51c expref: 192 pid: 30972 timeout: 1127 lvb_type: 0 00000100:00100000:3.0:1763334962.801773:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6beca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701806080:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334962.802471:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52987:x1848989694375040:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1733us (2180us total) trans 8589938699 rc 0/0 00000100:00100000:3.0:1763334962.802481:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa8063c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334962.802485:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1644 00000100:00100000:2.0:1763334962.807545:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.809193:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.809277:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694375552 00000100:00100000:3.0:1763334962.809288:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694375552 00000100:00100000:1.0:1763334962.809306:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6beca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701806080:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334962.809343:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ad4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.809350:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af51c expref: 192 pid: 30972 timeout: 1127 lvb_type: 0 00000100:00100000:3.0:1763334962.809394:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2427 00000100:00100000:3.0:1763334962.809407:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2359:x1848989694375552:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334962.809433:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334962.809442:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af51c expref: 192 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334962.809456:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af51c expref: 192 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334962.809488:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499ab8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af51c expref: 192 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334962.809508:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:3.0:1763334962.809514:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ad4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.809526:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ad4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.809534:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ad4 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334962.809565:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334962.809596:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ad4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.809603:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ad4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334962.809650:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:2359:x1848989694375552:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 245us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334962.809659:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2427 00000040:00080000:1.0:1763334962.810078:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1025, 88 off88344 00000004:00080000:1.0:1763334962.810089:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1027443515963ns, next at 1027972101713ns, rc = 0 00000040:00080000:1.0:1763334962.810131:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1036, 88 off89408 00000004:00080000:1.0:1763334962.810136:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1027443563729ns, next at 1027972226189ns, rc = 0 00000040:00080000:1.0:1763334962.810163:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1037, 88 off89496 00000004:00080000:1.0:1763334962.810168:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1027443596393ns, next at 1027972226189ns, rc = 0 00000040:00080000:1.0:1763334962.810185:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1026, 88 off88432 00000004:00080000:1.0:1763334962.810188:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1027443616668ns, next at 1027972101713ns, rc = 0 00000100:00100000:0.0:1763334962.810606:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694375424 00000100:00100000:0.0:1763334962.810615:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694375424 00000100:00100000:2.0:1763334962.810990:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1645 00000100:00100000:2.0:1763334962.811002:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52987:x1848989694375424:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:2.0:1763334962.811173:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52987:x1848989694375424:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 173us (3644us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334962.811180:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1645 00000100:00100000:1.0:1763334962.822144:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.822284:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694375808 00000100:00100000:3.0:1763334962.822307:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694375808 00000100:00100000:3.0:1763334962.822385:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4449 00000100:00100000:3.0:1763334962.822399:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52989:x1848989694375808:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334962.822428:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.822457:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499adb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af531 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.822564:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8499ae2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.822614:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8499ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.822627:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8499ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.822647:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ae9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.822654:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.822662:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.822899:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499af0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.822909:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499af0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.822916:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499af0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334962.822926:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x189:0x0]: returning size 2 00010000:00010000:3.0:1763334962.823077:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499af0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823085:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499af0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823092:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499af0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823097:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fc00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.823103:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499af0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823111:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499af0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823124:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:3.0:1763334962.823127:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1763334962.823133:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499af0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823139:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499af0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823157:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8499ae2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823163:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8499ae2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823172:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8499ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823176:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abf000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.823178:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8499ae2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823183:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8499ae2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823188:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.823190:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.823193:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8499ae2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823197:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8499ae2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823205:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ae9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823209:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ae9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823214:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823218:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.823220:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ae9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823225:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ae9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823232:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5e600) 00010000:00010000:3.0:1763334962.823234:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.823236:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ae9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823241:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ae9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334962.823284:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499adb lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af531 expref: 194 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.823307:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.823310:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763334962.823313:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499adb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af531 expref: 194 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.823323:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abf400, rc 0) 00000100:00100000:3.0:1763334962.823408:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52989:x1848989694375808:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1011us (1279us total) trans 8589938701 rc 301/301 00000100:00100000:3.0:1763334962.823417:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4449 00000100:00100000:0.0:1763334962.828213:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.829097:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694375936 00000100:00100000:0.0:1763334962.829114:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694375936 00000100:00100000:1.0:1763334962.829651:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4450 00000100:00100000:1.0:1763334962.829669:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52989:x1848989694375936:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334962.829844:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334962.829874:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499afe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af538 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.829989:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.830007:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af515 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.830016:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ad4 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.830025:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334962.830048:0:29627:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ad4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.830082:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af515 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.830099:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af515 expref: 194 pid: 30972 timeout: 1127 lvb_type: 0 00000100:00100000:1.0:1763334962.830162:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701806208:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334962.830838:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334962.835140:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.835283:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701806208:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334962.835331:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334962.835543:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694376064 00000100:00100000:3.0:1763334962.835554:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694376064 00010000:00010000:3.0:1763334962.835625:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af515 expref: 195 pid: 30972 timeout: 1127 lvb_type: 0 00000100:00100000:3.0:1763334962.835748:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2428 00000100:00100000:3.0:1763334962.835761:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2359:x1848989694376064:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334962.835782:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334962.835792:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af515 expref: 195 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334962.835808:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af515 expref: 195 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334962.835839:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499a8e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x189:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af515 expref: 195 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334962.835858:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:3.0:1763334962.835864:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.835873:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.835879:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.835885:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334962.835947:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2359:x1848989694376064:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 189us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334962.835956:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2428 00000001:00080000:3.0:1763334962.851681:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938694 is committed 00000001:00080000:3.0:1763334962.851711:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938700 is committed 00000004:00080000:3.0:1763334962.851715:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 672 committed 00000004:00080000:3.0:1763334962.851731:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 684 committed 00000004:00080000:3.0:1763334962.851739:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 683 committed 00000004:00080000:3.0:1763334962.851742:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 671 committed 00000100:00100000:3.0:1763334962.851925:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701806720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334962.852020:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334962.852071:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763334962.852077:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701806336:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334962.852101:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334962.852137:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701806720 00000100:00100000:3.0:1763334962.852146:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701806720 00000100:00100000:3.0:1763334962.852198:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701806336 00000100:00100000:3.0:1763334962.852201:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701806336 00000100:00100000:3.0:1763334962.852225:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4588 00000100:00100000:3.0:1763334962.852236:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701806720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334962.852603:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3289:x1848989701806720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 336us (550us total) trans 17179870991 rc 0/0 00000100:00100000:3.0:1763334962.852612:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4588 00000100:00100000:3.0:1763334962.852632:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4589 00000100:00100000:3.0:1763334962.852640:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701806336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334962.852654:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:542 count 1 00010000:00010000:3.0:1763334962.852680:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.852704:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f8499929 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4a5 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.852713:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334962.852717:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334962.852721:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.852756:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f8499929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4a5 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.852774:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f8499929 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4a5 expref: 21 pid: 6518 timeout: 1127 lvb_type: 0 00000100:00100000:3.0:1763334962.852787:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701806848:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334962.852862:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa65ef00 going to sleep for 11 seconds 00000004:00080000:3.0:1763334962.852911:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d6a00/2, rc 0, transno 17179870991 00000100:00100000:3.0:1763334962.852918:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701806720:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763334962.853053:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x189:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af52a expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.853067:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334962.853071:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334962.853076:0:30972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.853086:0:30972:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.853093:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.853145:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8499acd lrc: 0/0,0 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af52a expref: 175 pid: 30972 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763334962.853168:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x189:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af52a expref: 174 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.853202:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abe800, rc 0) 00000100:00100000:2.0:1763334962.853232:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52274:x1848989694375296:12345-192.168.201.60@tcp:101:bash.0 Request processed in 51735us (52865us total) trans 8589938700 rc 0/0 00000100:00100000:2.0:1763334962.853240:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4448 00000100:00100000:2.0:1763334962.853269:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701806464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.853318:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.853346:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763334962.853353:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701806592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.853375:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334962.853752:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701806464 00000100:00100000:0.0:1763334962.853760:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701806464 00000100:00100000:0.0:1763334962.853794:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701806592 00000100:00100000:0.0:1763334962.853797:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701806592 00000100:00100000:0.0:1763334962.853815:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4590 00000100:00100000:0.0:1763334962.853823:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3291:x1848989701806464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334962.853844:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:543 count 1 00010000:00010000:0.0:1763334962.853863:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.853883:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849986c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af474 expref: 21 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334962.853891:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.853893:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.853896:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.853923:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849986c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af474 expref: 21 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334962.853933:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849986c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af474 expref: 21 pid: 25383 timeout: 1127 lvb_type: 1 00000100:00100000:0.0:1763334962.853944:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701806976:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334962.853984:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac506bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1763334962.854002:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4591 00000100:00100000:0.0:1763334962.854009:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3291:x1848989701806592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334962.854224:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3291:x1848989701806592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 215us (847us total) trans 17179870992 rc 0/0 00000100:00100000:0.0:1763334962.854231:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4591 00000004:00080000:2.0:1763334962.854423:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6bed180/2, rc 0, transno 17179870992 00000100:00100000:2.0:1763334962.854431:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701806592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.854730:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701807360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334962.854761:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334962.854817:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701807488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334962.854893:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701807360 00000100:00100000:1.0:1763334962.854899:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701807360 00000100:00100000:1.0:1763334962.854929:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4592 00000100:00100000:1.0:1763334962.854937:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3292:x1848989701807360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334962.855095:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x21c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334962.855099:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x21c:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763334962.855102:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x21c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334962.855105:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x21c:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763334962.855107:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x21c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334962.855246:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334962.855273:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763334962.855279:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701807104:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334962.855312:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334962.855338:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701807488 00000100:00100000:0.0:1763334962.855342:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701807488 00000100:00100000:0.0:1763334962.855364:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701807104 00000100:00100000:0.0:1763334962.855367:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701807104 00000100:00100000:0.0:1763334962.855387:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4593 00000100:00100000:0.0:1763334962.855393:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3289:x1848989701807488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334962.855512:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3289:x1848989701807488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (265us total) trans 21474838275 rc 0/0 00000100:00100000:0.0:1763334962.855519:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4593 00000100:00100000:0.0:1763334962.855533:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4594 00000100:00100000:0.0:1763334962.855539:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3289:x1848989701807104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334962.855550:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:538 count 1 00010000:00010000:0.0:1763334962.855567:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.855614:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499937 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4b3 expref: 22 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.855622:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334962.855625:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334962.855628:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.855655:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499937 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4b3 expref: 22 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.855666:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499937 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4b3 expref: 22 pid: 7819 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334962.855678:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21625:1848989701807616:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334962.855728:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1180 going to sleep for 11 seconds 00000004:00080000:0.0:1763334962.855764:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c7480/2, rc 0, transno 21474838275 00000100:00100000:0.0:1763334962.855771:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701807488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334962.855893:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+39:3292:x1848989701807360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 956us (1130us total) trans 21474838274 rc 0/0 00000100:00100000:1.0:1763334962.855901:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4592 00000004:00080000:2.0:1763334962.855991:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c6d80/2, rc 0, transno 21474838274 00000100:00100000:2.0:1763334962.855997:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701807360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334962.856006:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763334962.856013:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701807232:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334962.856037:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334962.856074:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701807232 00000100:00100000:2.0:1763334962.856079:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701807232 00000100:00100000:2.0:1763334962.856104:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4595 00000100:00100000:2.0:1763334962.856111:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3292:x1848989701807232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334962.856124:0:32239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:539 count 1 00010000:00010000:2.0:1763334962.856138:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.856153:0:32239:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499873 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af46d expref: 22 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334962.856159:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334962.856162:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334962.856165:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.856184:0:32239:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499873 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af46d expref: 22 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334962.856194:0:32239:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499873 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af46d expref: 22 pid: 6519 timeout: 1127 lvb_type: 1 00000100:00100000:2.0:1763334962.856205:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701807744:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334962.856242:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44be40 going to sleep for 11 seconds 00010000:00010000:3.0:1763334962.857118:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.857134:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334962.857187:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x189:0x0]: returning size 2 00000004:00200000:3.0:1763334962.857192:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334962.857216:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.857261:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499afe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x189:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af538 expref: 174 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.857281:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af538 expref: 173 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.857301:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:3.0:1763334962.857305:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334962.857309:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478000, rc 0) 00000100:00100000:3.0:1763334962.857965:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52989:x1848989694375936:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 28295us (29760us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334962.857975:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4450 00000100:00100000:1.0:1763334962.862445:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.862601:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694376192 00000100:00100000:0.0:1763334962.862617:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694376192 00000100:00100000:3.0:1763334962.862790:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701806848:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334962.862930:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334962.863025:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701806976:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334962.863045:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334962.863135:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.863159:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.863183:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.863204:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.863253:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.863302:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701807744:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334962.863321:0:32239:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334962.863350:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694376320 00000100:00100000:2.0:1763334962.863354:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694376320 00010000:00010000:2.0:1763334962.863387:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f8499929 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4a5 expref: 22 pid: 6518 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334962.863415:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694376448 00000100:00100000:2.0:1763334962.863418:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694376448 00010000:00010000:2.0:1763334962.863433:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849986c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af474 expref: 23 pid: 25383 timeout: 1127 lvb_type: 1 00000100:00100000:2.0:1763334962.863445:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694376576 00000100:00100000:2.0:1763334962.863448:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694376576 00010000:00010000:2.0:1763334962.863461:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499937 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4b3 expref: 24 pid: 7819 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334962.863499:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4596 00000100:00100000:0.0:1763334962.863512:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+24:52274:x1848989694376192:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334962.863534:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.863565:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499b28 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af53f expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.863632:0:6517:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499a80 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af50e expref: 25 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334962.863643:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.863645:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334962.863650:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499b28 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af53f expref: 25 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.863693:0:6517:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499a80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af50e expref: 25 pid: 6518 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1763334962.863854:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694376704 00000100:00100000:1.0:1763334962.863859:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694376704 00010000:00010000:1.0:1763334962.863881:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499873 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af46d expref: 26 pid: 6519 timeout: 1127 lvb_type: 1 00000100:00100000:1.0:1763334962.863898:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2429 00000100:00100000:1.0:1763334962.863905:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694376320:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334962.863918:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334962.863924:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f8499929 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4a5 expref: 23 pid: 6518 timeout: 1127 lvb_type: 0 00010000:00010000:1.0:1763334962.863938:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f8499929 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4a5 expref: 23 pid: 6518 timeout: 1127 lvb_type: 0 00010000:00010000:1.0:1763334962.863973:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168f600/0xcedf0054f8499929 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4a5 expref: 23 pid: 6518 timeout: 1127 lvb_type: 0 00010000:00010000:1.0:1763334962.863994:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.863996:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.864001:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.864012:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.864037:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334962.864102:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694376320:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 196us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334962.864110:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2429 00000100:00100000:1.0:1763334962.864131:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2430 00000100:00100000:1.0:1763334962.864139:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694376448:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334962.864147:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334962.864152:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849986c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af474 expref: 21 pid: 25383 timeout: 1127 lvb_type: 1 00010000:00010000:1.0:1763334962.864168:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849986c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af474 expref: 21 pid: 25383 timeout: 1127 lvb_type: 1 00010000:00010000:1.0:1763334962.864181:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849986c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af474 expref: 21 pid: 25383 timeout: 1127 lvb_type: 1 00000100:00100000:3.0:1763334962.864356:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21625:1848989701807616:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334962.864376:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.864424:0:6517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499a80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af50e expref: 26 pid: 6518 timeout: 1127 lvb_type: 1 00000100:00100000:0.0:1763334962.864447:0:6517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6517:1848989701807872:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334962.864520:0:6517:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1c00 going to sleep for 11 seconds 00010000:00010000:1.0:1763334962.864996:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.864999:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.865003:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.865012:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.865040:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334962.865078:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694376448:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 939us (1916us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334962.865085:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2430 00000100:00100000:1.0:1763334962.865106:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2431 00000100:00100000:1.0:1763334962.865114:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694376704:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334962.865125:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334962.865131:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499873 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af46d expref: 26 pid: 6519 timeout: 1127 lvb_type: 1 00010000:00010000:1.0:1763334962.865141:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499873 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af46d expref: 26 pid: 6519 timeout: 1127 lvb_type: 1 00010000:00010000:1.0:1763334962.865158:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499873 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af46d expref: 26 pid: 6519 timeout: 1127 lvb_type: 1 00010000:00010000:1.0:1763334962.865169:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.865171:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334962.865174:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.865182:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.865202:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334962.865222:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694376704:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 109us (2017us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334962.865229:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2431 00010000:00010000:1.0:1763334962.865260:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.865269:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.865281:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.865297:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.865324:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334962.865785:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3289:x1848989701806336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13144us (13681us total) trans 17179870993 rc 0/0 00000100:00100000:1.0:1763334962.865796:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4589 00010000:00010000:1.0:1763334962.865824:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334962.865832:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.865842:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334962.865847:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.865857:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.865872:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.865879:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334962.865902:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.865905:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.865906:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334962.866286:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.866307:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.866316:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.866324:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.866349:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334962.866621:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3291:x1848989701806464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12797us (13301us total) trans 17179870994 rc 0/0 00000100:00100000:3.0:1763334962.866633:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4590 00000004:00080000:0.0:1763334962.866798:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6beea00/2, rc 0, transno 17179870993 00000100:00100000:0.0:1763334962.866807:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701806336:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763334962.866939:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334962.866945:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.866954:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334962.866958:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.866966:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.866984:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.866993:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f8499b13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.867017:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334962.867019:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334962.867021:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334962.867039:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2432 00000100:00100000:2.0:1763334962.867053:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694376576:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334962.867074:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334962.867082:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499937 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4b3 expref: 24 pid: 7819 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334962.867096:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499937 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4b3 expref: 24 pid: 7819 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334962.867115:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499937 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af4b3 expref: 24 pid: 7819 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334962.867126:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334962.867129:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334962.867135:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.867147:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.867181:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334962.867228:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88efc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694376576:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 181us (4044us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334962.867240:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2432 00010000:00010000:2.0:1763334962.867325:0:32239:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334962.867478:0:6517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6517:1848989701807872:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334962.867517:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499b28 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af53f expref: 22 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.867537:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334962.867565:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:52274:x1848989694376192:12345-192.168.201.60@tcp:101:bash.0 Request processed in 4057us (5136us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.867607:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4596 00010000:00010000:2.0:1763334962.868523:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.868534:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.868542:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.868583:0:32239:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334962.868961:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3292:x1848989701807232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12848us (12920us total) trans 21474838276 rc 0/0 00000100:00100000:2.0:1763334962.868972:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4595 00000004:00080000:2.0:1763334962.869049:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c6a00/2, rc 0, transno 21474838276 00000100:00100000:2.0:1763334962.869057:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701807232:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763334962.869093:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6beca80/2, rc 0, transno 17179870994 00000100:00100000:2.0:1763334962.869098:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701806464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334962.869136:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694376960 00000100:00100000:2.0:1763334962.869144:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694376960 00000100:00100000:2.0:1763334962.869198:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1646 00000100:00100000:2.0:1763334962.869208:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+173:52989:x1848989694376960:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334962.869466:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52989:x1848989694376960:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 258us (6211us total) trans 8589938702 rc 0/0 00000100:00100000:2.0:1763334962.869474:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1646 00010000:00010000:0.0:1763334962.869620:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334962.869633:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.869645:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334962.869650:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.869661:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.869685:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.869694:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499b21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.869719:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334962.869722:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334962.869724:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334962.870038:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.870048:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.870057:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.870102:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.870123:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334962.870362:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.875363:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3289:x1848989701807104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19808us (20034us total) trans 21474838277 rc 0/0 00000100:00100000:3.0:1763334962.875382:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4594 00010000:00010000:2.0:1763334962.875541:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334962.875554:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.875568:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334962.875604:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.875618:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.875648:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.875662:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499b1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.875687:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334962.875689:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334962.875691:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334962.875711:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694377088 00000100:00100000:2.0:1763334962.875725:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694377088 00010000:00010000:2.0:1763334962.875773:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499a80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af50e expref: 22 pid: 6518 timeout: 1127 lvb_type: 1 00000100:00100000:2.0:1763334962.875817:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2433 00000100:00100000:2.0:1763334962.875827:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694377088:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334962.875849:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334962.875855:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499a80 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af50e expref: 22 pid: 6518 timeout: 1127 lvb_type: 1 00010000:00010000:2.0:1763334962.875867:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499a80 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af50e expref: 22 pid: 6518 timeout: 1127 lvb_type: 1 00010000:00010000:2.0:1763334962.875887:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499a80 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af50e expref: 22 pid: 6518 timeout: 1127 lvb_type: 1 00010000:00010000:2.0:1763334962.875901:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334962.875904:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334962.875912:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499b28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af53f expref: 21 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.875925:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499b28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af53f expref: 21 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.875974:0:5734:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499b28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af53f expref: 21 pid: 6517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334962.875991:0:5734:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5734:1848989701808000:192.168.201.60@tcp:105: 00000100:00100000:2.0:1763334962.876094:0:5734:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334962.876161:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.876196:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694377216 00000100:00100000:2.0:1763334962.876200:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694377216 00000100:00100000:2.0:1763334962.876236:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4451 00000100:00100000:2.0:1763334962.876242:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52989:x1848989694377216:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.876269:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.876302:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499b2f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af546 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.876504:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499b36 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.876525:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499b36 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.876538:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499b36 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.876556:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b3d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.876565:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00000004:00080000:0.0:1763334962.876719:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f3480/2, rc 0, transno 21474838277 00000100:00100000:0.0:1763334962.876731:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701807104:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763334962.876950:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.877470:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499b44 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.877484:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499b44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.877496:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499b44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334962.877563:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x189:0x0]: returning size 2 00000004:00200000:2.0:1763334962.878003:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334962.878039:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499b44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878056:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499b44 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878066:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499b36 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878077:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499b36 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878084:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499b36 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878091:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.878095:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499b36 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878104:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499b36 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878117:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.878121:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.878126:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499b36 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878139:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499b36 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878155:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878162:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b3d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878167:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b3d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878172:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.878175:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b3d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878180:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b3d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878187:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334962.878190:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.878192:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b3d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878197:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b3d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.878251:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499b2f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af546 expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.878268:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499b44 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af546 expref: 175 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.878276:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334962.878279:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334962.878281:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:2.0:1763334962.879237:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52989:x1848989694377216:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2982us (3064us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334962.879251:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4451 00000100:00100000:1.0:1763334962.882544:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.882719:0:5734:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5ace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5734:1848989701808000:192.168.201.60@tcp:105: 00010000:00010000:2.0:1763334962.882754:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334962.882841:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694377088:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 7014us (12480us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334962.882855:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2433 00000100:00100000:3.0:1763334962.883137:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694377344 00000100:00100000:3.0:1763334962.883147:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694377344 00000100:00100000:3.0:1763334962.883206:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4597 00000100:00100000:3.0:1763334962.883217:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:52274:x1848989694377344:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334962.883242:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.883275:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499b4b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af54d expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334962.883321:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x220:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334962.883353:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.883356:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334962.883367:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499b4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af54d expref: 21 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.883388:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499b4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af54d expref: 21 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.883403:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fc00, rc 0) 00000100:00100000:3.0:1763334962.883436:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:52274:x1848989694377344:12345-192.168.201.60@tcp:101:bash.0 Request processed in 222us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334962.883444:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4597 00000100:00100000:1.0:1763334962.893159:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.893225:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.893343:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694377472 00000100:00100000:3.0:1763334962.893359:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694377472 00002000:00010000:3.0:1763334962.893422:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/540 (0->18446744073709551615) 00002000:00100000:3.0:1763334962.893429:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa746a00 with x1848989694377472 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334962.893447:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa746a00. 00000100:00100000:3.0:1763334962.893485:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694377600 00000100:00100000:3.0:1763334962.893489:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694377600 00002000:00010000:3.0:1763334962.893504:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/544 (0->18446744073709551615) 00002000:00100000:3.0:1763334962.893507:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa745c00 with x1848989694377600 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334962.893515:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa745c00. 00000100:00100000:3.0:1763334962.893537:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1698 00000100:00100000:3.0:1763334962.893548:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694377472:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334962.894009:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x21c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334962.894015:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x21c:0x0] updating lvb mtime from disk: 0 -> 1763334963 00002000:00010000:3.0:1763334962.894018:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x21c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334962.894021:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x21c:0x0] updating lvb ctime from disk: 0 -> 1763334963 00002000:00010000:3.0:1763334962.894024:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x21c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334962.894098:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694377472:12345-192.168.201.60@tcp:10:bash.0 Request processed in 550us (957us total) trans 21474838278 rc 0/0 00000100:00100000:3.0:1763334962.894109:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1698 00002000:00010000:3.0:1763334962.894115:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/540 (0->18446744073709551615) 00002000:00100000:3.0:1763334962.894118:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa746a00 with x1848989694377472 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334962.894124:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa746a00. 00000100:00100000:3.0:1763334962.894148:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1699 00000100:00100000:3.0:1763334962.894156:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694377600:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334962.894355:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334962.894358:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb mtime from disk: 0 -> 1763334963 00002000:00010000:3.0:1763334962.894360:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334962.894363:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb ctime from disk: 0 -> 1763334963 00002000:00010000:3.0:1763334962.894365:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x220:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334962.894390:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694377600:12345-192.168.201.60@tcp:10:bash.0 Request processed in 234us (1164us total) trans 17179870995 rc 0/0 00000100:00100000:3.0:1763334962.894398:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1699 00002000:00010000:3.0:1763334962.894401:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/544 (0->18446744073709551615) 00002000:00100000:3.0:1763334962.894404:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa745c00 with x1848989694377600 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334962.894410:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa745c00. 00000100:00100000:0.0:1763334962.900626:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.900671:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.900830:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694378112 00000100:00100000:2.0:1763334962.900844:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694378112 00000100:00100000:2.0:1763334962.900921:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4452 00000100:00100000:2.0:1763334962.900932:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52990:x1848989694378112:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.900958:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.900987:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499b52 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af554 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.901133:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b59 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.901152:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b59 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x189:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.901166:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b59 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x189:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334962.901180:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x189:0x0]: returning size 2 00010000:00010000:2.0:1763334962.901391:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499b52 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af554 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.901416:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b59 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x189:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af554 expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.901427:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334962.901431:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763334962.901435:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:2.0:1763334962.901520:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52990:x1848989694378112:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 590us (847us total) trans 8589938703 rc 0/0 00000100:00100000:2.0:1763334962.901529:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4452 00000100:00100000:2.0:1763334962.901567:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694377856 00000100:00100000:2.0:1763334962.901630:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694377856 00000100:00100000:2.0:1763334962.901671:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1647 00000100:00100000:2.0:1763334962.901680:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52274:x1848989694377856:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:2.0:1763334962.902039:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52274:x1848989694377856:12345-192.168.201.60@tcp:35:bash.0 Request processed in 357us (1429us total) trans 8589938704 rc 0/0 00000100:00100000:2.0:1763334962.902048:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1647 00000100:00100000:1.0:1763334962.911762:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.911869:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694378368 00000100:00100000:0.0:1763334962.911883:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694378368 00000100:00100000:0.0:1763334962.911952:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4453 00000100:00100000:0.0:1763334962.911961:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52991:x1848989694378368:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:0.0:1763334962.912032:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1763334962.912066:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f8499b44 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af546 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.912090:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499b05 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x189:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af538 expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.912103:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499b59 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x189:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af554 expref: 176 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.912114:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ad4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x189:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af52a expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.912133:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:0.0:1763334962.912146:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334962.912178:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499b67 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.912193:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499b67 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.912203:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499b67 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.912218:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499b6e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.912224:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499b6e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.912229:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499b6e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.912424:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499b75 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.912432:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499b75 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334962.912439:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499b75 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334962.914935:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.917628:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694378496 00000100:00100000:3.0:1763334962.917656:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694378496 00000100:00100000:3.0:1763334962.917747:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4454 00000100:00100000:3.0:1763334962.917761:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52990:x1848989694378496:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334962.917791:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.917823:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499b7c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af55b expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763334962.920833:0:30972:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x189:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763334962.921138:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499b75 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.921154:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499b75 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.921164:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499b75 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.921170:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.921177:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499b75 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.921187:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499b75 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.921212:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac51bdc00) 00010000:00010000:1.0:1763334962.921217:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763334962.921224:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499b75 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.921232:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499b75 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x189:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.921256:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499b67 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.921262:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499b67 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.921272:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499b67 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.921276:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334962.921279:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499b67 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.921285:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499b67 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.921324:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334962.921326:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334962.921329:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499b67 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334962.921334:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499b67 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:1.0:1763334962.921346:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c071fb35 reply state 0000000003f008ba transno 8589938705 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499b6e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334962.921355:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334962.921521:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52991:x1848989694378368:12345-192.168.201.60@tcp:36:rm.0 Request processed in 9550us (9762us total) trans 8589938705 rc 0/0 00000100:00100000:1.0:1763334962.921533:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4453 00010000:00010000:3.0:1763334962.924429:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499b7c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af55b expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.924468:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f800/0xcedf0054f8499b7c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x189:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af55b expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.924506:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac51bdc00) 00010000:00010000:3.0:1763334962.924510:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334962.924516:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f800, rc 0) 00000100:00100000:3.0:1763334962.924636:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52990:x1848989694378496:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6877us (9715us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334962.924646:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4454 00010000:00010000:2.0:1763334962.927342:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499b6e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.927367:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499b6e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.927377:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499b6e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.927385:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.927392:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499b6e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.927403:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499b6e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.927434:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd100) 00010000:00010000:2.0:1763334962.927438:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.927445:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499b6e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334962.927451:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499b6e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334962.932236:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.932554:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694378752 00000100:00100000:3.0:1763334962.932690:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694378752 00000100:00100000:3.0:1763334962.933237:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1648 00000100:00100000:3.0:1763334962.933400:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52990:x1848989694378752:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:3.0:1763334962.933909:0:29631:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x189:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763334962.934079:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1027, 64 off88496 00000040:00080000:3.0:1763334962.934129:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1038, 64 off89560 00000040:00080000:3.0:1763334962.934166:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1039, 64 off89624 00000040:00080000:3.0:1763334962.934182:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1028, 64 off88560 00010000:00010000:3.0:1763334962.934306:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499b83 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x189:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334962.934330:0:29631:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499b83 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334962.934347:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499b83 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334962.934357:0:29631:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499b83 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334962.934364:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499b83 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334962.934371:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499b83 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334962.934402:0:29631:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334962.934479:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334962.934489:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499b83 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334962.934497:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334962.934501:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499b83 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334962.934513:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499b83 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x189:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334962.934529:0:5736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x189:0x0].0x0 (ffff9a5ac51bdc00) 00010000:00010000:1.0:1763334962.934533:0:5736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763334962.934540:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499b83 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x189:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334962.934546:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499b83 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x189:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334962.934561:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.934564:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334962.934566:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334962.934633:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52990:x1848989694378752:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1380us (2409us total) trans 8589938706 rc 0/0 00000100:00100000:3.0:1763334962.934645:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1648 00000100:00100000:1.0:1763334962.942140:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.942673:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694378880 00000100:00100000:3.0:1763334962.942697:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694378880 00000100:00100000:3.0:1763334962.942773:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4455 00000100:00100000:3.0:1763334962.942784:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52990:x1848989694378880:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334962.942816:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.942848:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499b8a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af562 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.942942:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b91 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.942961:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b91 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.942975:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b91 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.942991:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499b98 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.942998:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499b98 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943004:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499b98 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943091:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b91 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943099:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b91 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943107:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b91 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943113:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.943118:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b91 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943126:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b91 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943139:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.943143:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.943149:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b91 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943155:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499b91 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943171:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499b98 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943176:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499b98 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943182:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499b98 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943187:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334962.943189:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499b98 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943194:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499b98 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943200:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5e700) 00010000:00010000:3.0:1763334962.943202:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.943205:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499b98 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943210:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499b98 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.943259:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499b8a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af562 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.943272:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.943275:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334962.943278:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499b8a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af562 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.943298:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168ee00, rc 0) 00000100:00100000:3.0:1763334962.943373:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52990:x1848989694378880:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 590us (1249us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334962.943381:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4455 00000100:00100000:0.0:1763334962.948730:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334962.949051:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694379008 00000100:00100000:1.0:1763334962.949068:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694379008 00000100:00100000:1.0:1763334962.949312:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4456 00000100:00100000:1.0:1763334962.949324:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52992:x1848989694379008:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334962.949352:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334962.949384:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499b9f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af569 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.949828:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499ba6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.949851:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.949864:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.949881:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499bad lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.949886:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499bad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.949892:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499bad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.949972:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499ba6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.949978:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499ba6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.949984:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.949990:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.949994:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499ba6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.950001:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499ba6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.950013:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.950016:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.950021:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499ba6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.950027:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499ba6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.950037:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499bad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.950042:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499bad lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.950048:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499bad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.950052:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.950054:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499bad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.950059:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499bad lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.950064:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd000) 00010000:00010000:0.0:1763334962.950066:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.950068:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499bad lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.950073:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499bad lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.950108:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499b9f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af569 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.950117:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.950120:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.950123:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499b9f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af569 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.950133:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:0.0:1763334962.950768:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52992:x1848989694379008:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1440us (2048us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334962.950778:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4456 00000100:00100000:2.0:1763334962.954428:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.955153:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694379136 00000100:00100000:0.0:1763334962.955169:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694379136 00000100:00100000:0.0:1763334962.955249:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4457 00000100:00100000:0.0:1763334962.955261:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52992:x1848989694379136:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334962.955296:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.955329:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499bb4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af570 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.955430:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499bbb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955449:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499bbb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955464:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499bbb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955481:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499bc2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955487:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955493:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955613:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499bbb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955621:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499bbb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955628:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499bbb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955634:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.955639:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499bbb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955647:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499bbb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955662:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.955666:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.955672:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499bbb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955679:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499bbb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955693:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955698:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955703:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955712:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.955714:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955719:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955726:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd700) 00010000:00010000:0.0:1763334962.955728:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.955731:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499bc2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955736:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499bc2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.955773:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499bb4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af570 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.955785:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.955787:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.955791:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499bb4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af570 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.955801:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334962.955893:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52992:x1848989694379136:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 634us (1523us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334962.955902:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4457 00000100:00100000:1.0:1763334962.961524:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.961820:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694379264 00000100:00100000:3.0:1763334962.961835:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694379264 00000100:00100000:3.0:1763334962.961902:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4458 00000100:00100000:3.0:1763334962.961912:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52992:x1848989694379264:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334962.961938:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.961966:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499bc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af577 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.962060:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499bd0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.962078:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.962091:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334962.962168:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334962.962172:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334962.962199:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.962227:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499bc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af577 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.962246:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af577 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.962257:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.962260:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334962.962265:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f600, rc 0) 00000100:00100000:3.0:1763334962.962351:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52992:x1848989694379264:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 440us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334962.962359:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4458 00000100:00100000:1.0:1763334962.966696:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.966803:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694379392 00000100:00100000:0.0:1763334962.966817:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694379392 00000100:00100000:0.0:1763334962.966888:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4459 00000100:00100000:0.0:1763334962.966898:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52992:x1848989694379392:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334962.966923:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.966948:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499bd7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af57e expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.967034:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499bde lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967052:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499bde lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967065:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499bde lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967079:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499be5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967087:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499be5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967093:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499be5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967178:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499bde lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967185:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499bde lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967192:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499bde lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967198:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.967203:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499bde lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967211:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499bde lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967225:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.967229:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.967234:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499bde lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967240:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499bde lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967253:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499be5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967258:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499be5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967263:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499be5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967269:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.967272:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499be5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967278:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499be5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967285:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd000) 00010000:00010000:0.0:1763334962.967296:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.967300:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499be5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967310:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499be5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.967348:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499bd7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af57e expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.967360:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.967362:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334962.967366:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499bd7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af57e expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.967376:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334962.967461:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52992:x1848989694379392:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 565us (790us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334962.967470:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4459 00000100:00100000:1.0:1763334962.974159:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.976679:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694379648 00000100:00100000:3.0:1763334962.976698:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694379648 00000100:00100000:3.0:1763334962.976778:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4460 00000100:00100000:3.0:1763334962.976787:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52992:x1848989694379648:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334962.976813:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334962.976816:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334962.976850:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499bd0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af577 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.976871:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334962.976877:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334962.976892:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499bec lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af585 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334962.977052:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499bf3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.977067:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499bf3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.977077:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499bf3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.977093:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499bfa lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.977099:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499bfa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.977110:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499bfa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.977872:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c01 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.977885:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c01 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.977894:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c01 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334962.977906:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 0 00010000:00010000:2.0:1763334962.977938:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499bf3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.977946:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499bf3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.977955:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499bf3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.977962:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.977967:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499bf3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.977981:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499bf3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.977991:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.977994:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.977999:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499bf3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.978005:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499bf3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:2.0:1763334962.978018:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fc09ce67 reply state 00000000121d817d transno 8589938707 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499bfa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334962.978028:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334962.978062:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499bec lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af585 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.978078:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c01 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af585 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.978087:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334962.978090:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334962.978092:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:2.0:1763334962.978462:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52992:x1848989694379648:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1672us (4316us total) trans 8589938707 rc 0/0 00000100:00100000:2.0:1763334962.978472:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4460 00010000:00010000:2.0:1763334962.981592:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499bfa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.981630:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499bfa lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.981640:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499bfa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.981647:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.981654:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499bfa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.981665:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499bfa lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.981689:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5e700) 00010000:00010000:2.0:1763334962.981694:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334962.981700:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499bfa lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.981707:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499bfa lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334962.981877:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.982117:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694379904 00000100:00100000:2.0:1763334962.982133:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694379904 00000100:00100000:2.0:1763334962.982207:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4461 00000100:00100000:2.0:1763334962.982220:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52992:x1848989694379904:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334962.982257:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334962.982281:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499c0f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af58c expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.982418:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.982432:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c01 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af585 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.982441:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.982480:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c01 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af585 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.982494:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c01 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af585 expref: 180 pid: 29627 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334962.982510:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701808128:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334962.982640:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334962.983661:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334962.983888:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694380160 00000100:00100000:0.0:1763334962.983901:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694380160 00000100:00100000:0.0:1763334962.983963:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4462 00000100:00100000:0.0:1763334962.983974:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52993:x1848989694380160:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334962.983997:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334962.984021:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499c1d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af593 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.984151:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499c24 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.984166:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499c24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.984184:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499c24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334962.984198:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 0 00010000:00010000:0.0:1763334962.986107:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499c24 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.986129:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499c24 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.986137:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499c24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.986143:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334962.986149:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499c24 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.986158:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499c24 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.986179:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:0.0:1763334962.986183:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763334962.986189:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499c24 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.986197:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f8499c24 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334962.986284:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499c1d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af593 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.986307:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334962.986310:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334962.986316:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499c1d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af593 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334962.986327:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334962.986434:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52993:x1848989694380160:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2460us (2780us total) trans 8589938708 rc 301/301 00000100:00100000:0.0:1763334962.986445:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4462 00000100:00100000:2.0:1763334962.986794:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.986901:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701808128:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334962.986934:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334962.987658:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694380288 00000100:00100000:0.0:1763334962.987671:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694380288 00010000:00010000:0.0:1763334962.987713:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c01 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af585 expref: 182 pid: 29627 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334962.987760:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2434 00000100:00100000:0.0:1763334962.987771:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2360:x1848989694380288:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334962.987792:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334962.987800:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c01 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af585 expref: 182 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.987815:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c01 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af585 expref: 182 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.987840:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c01 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af585 expref: 182 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334962.987855:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:0.0:1763334962.987861:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334962.987875:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334962.987883:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334962.987906:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334962.987954:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:2360:x1848989694380288:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 184us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334962.987962:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2434 00010000:00010000:3.0:1763334962.989155:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334962.989174:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334962.989202:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 0 00000004:00080000:2.0:1763334962.989778:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x222:0x0], index 1: 0 00000004:00080000:2.0:1763334962.989792:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21e:0x0], index 0: 0 00000004:00080000:2.0:1763334962.989800:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21f:0x0], index 0: 0 00000004:00080000:2.0:1763334962.989805:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x223:0x0], index 1: 0 00010000:00010000:2.0:1763334962.990005:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.990016:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.990025:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.990046:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334962.990054:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.990063:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.990083:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334962.990087:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334962.990092:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.990100:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c16 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334962.990191:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499c0f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af58c expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.990204:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334962.990207:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334962.990211:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499c0f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af58c expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334962.990222:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067a00, rc 0) 00000100:00100000:2.0:1763334962.990328:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52992:x1848989694379904:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 8109us (8457us total) trans 8589938709 rc 301/301 00000100:00100000:2.0:1763334962.990340:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4461 00000100:00100000:3.0:1763334962.990460:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334962.990937:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694380544 00000100:00100000:2.0:1763334962.990948:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694380544 00000100:00100000:2.0:1763334962.990993:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1649 00000100:00100000:2.0:1763334962.991004:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52993:x1848989694380544:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334962.991946:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52993:x1848989694380544:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 937us (1480us total) trans 8589938710 rc 0/0 00000100:00100000:2.0:1763334962.991959:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1649 00000100:00100000:1.0:1763334962.995989:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334962.996233:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694380800 00000100:00100000:3.0:1763334962.996246:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694380800 00000100:00100000:3.0:1763334962.996669:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1650 00000100:00100000:3.0:1763334962.996686:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52992:x1848989694380800:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334962.997025:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52992:x1848989694380800:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 342us (1051us total) trans 8589938711 rc 0/0 00000100:00100000:3.0:1763334962.997035:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1650 00000100:00100000:0.0:1763334963.001321:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.001892:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694381056 00000100:00100000:3.0:1763334963.001907:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694381056 00000100:00100000:3.0:1763334963.002377:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4463 00000100:00100000:3.0:1763334963.002394:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52993:x1848989694381056:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.002430:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.002462:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499c39 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af59a expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.002592:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499c40 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.002613:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499c40 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.002629:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499c40 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.002647:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499c47 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.002654:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499c47 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.002661:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499c47 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.002845:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499c4e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.002853:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499c4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.002860:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499c4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334963.002872:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 0 00010000:00010000:3.0:1763334963.003002:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499c40 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003010:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499c40 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003018:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499c40 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003024:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.003029:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499c40 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003036:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499c40 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003050:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334963.003054:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.003060:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499c40 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003066:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499c40 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003082:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499c47 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003087:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499c47 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003093:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499c47 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003098:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.003101:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499c47 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003106:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499c47 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003115:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5e600) 00010000:00010000:3.0:1763334963.003117:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.003120:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499c47 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003126:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499c47 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.003181:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499c39 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af59a expref: 185 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.003198:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499c4e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af59a expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.003205:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:3.0:1763334963.003207:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334963.003210:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abe800, rc 0) 00000100:00100000:0.0:1763334963.005513:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52993:x1848989694381056:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3107us (4190us total) trans 8589938712 rc 0/0 00000100:00100000:0.0:1763334963.005529:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4463 00000100:00100000:0.0:1763334963.005784:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.006083:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694381312 00000100:00100000:3.0:1763334963.006280:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694381312 00000100:00100000:0.0:1763334963.006461:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1651 00000100:00100000:0.0:1763334963.006474:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52992:x1848989694381312:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334963.006836:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52992:x1848989694381312:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 363us (1053us total) trans 8589938713 rc 0/0 00000100:00100000:0.0:1763334963.006844:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1651 00000100:00100000:0.0:1763334963.009776:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.010101:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.010237:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694381440 00000100:00100000:2.0:1763334963.010304:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694381440 00000100:00100000:3.0:1763334963.010393:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694381568 00000100:00100000:3.0:1763334963.010397:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694381568 00000100:00100000:2.0:1763334963.010484:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4598 00000100:00100000:2.0:1763334963.010496:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694381440:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334963.010519:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.010547:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499c5c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5a1 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334963.010700:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4599 00000100:00100000:0.0:1763334963.010710:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694381568:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334963.010719:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.010733:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f8499c63 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5a8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334963.010756:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x223:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334963.010779:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.010781:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.010792:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f8499c63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a8 expref: 23 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334963.010811:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f8499c63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a8 expref: 23 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334963.010826:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793800, rc 0) 00002000:00010000:2.0:1763334963.011087:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x21f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334963.011102:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.011104:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.011109:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499c5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a1 expref: 23 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334963.011121:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499c5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a1 expref: 23 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334963.011129:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067a00, rc 0) 00000100:00100000:0.0:1763334963.011242:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2361:x1848989694381568:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 532us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334963.011327:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2361:x1848989694381440:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 833us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.011542:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4599 00000100:00100000:2.0:1763334963.011658:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4598 00000100:00100000:1.0:1763334963.013122:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.013190:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694381824 00000100:00100000:0.0:1763334963.013204:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694381824 00000100:00100000:0.0:1763334963.013527:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4464 00000100:00100000:0.0:1763334963.013539:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694381824:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334963.013568:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.013630:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499c6a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5af expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334963.013643:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.013719:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694382080 00000100:00100000:1.0:1763334963.013726:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694382080 00000100:00100000:1.0:1763334963.013769:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1652 00000100:00100000:1.0:1763334963.013779:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52993:x1848989694382080:12345-192.168.201.60@tcp:35:lfs.0 00010000:00010000:0.0:1763334963.013802:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.013821:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499c4e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af59a expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.013837:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.013882:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499c4e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af59a expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.013898:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499c4e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af59a expref: 187 pid: 29627 timeout: 1127 lvb_type: 0 00000100:00100000:1.0:1763334963.015334:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52993:x1848989694382080:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1546us (1680us total) trans 8589938714 rc 0/0 00000100:00100000:1.0:1763334963.015348:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1652 00000100:00100000:0.0:1763334963.017154:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701808256:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334963.017298:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1763334963.021499:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701808256:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334963.021546:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334963.022783:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.023454:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694382208 00000100:00100000:0.0:1763334963.023470:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694382208 00010000:00010000:0.0:1763334963.023527:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499c4e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af59a expref: 188 pid: 29627 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334963.023604:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2435 00000100:00100000:0.0:1763334963.023616:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:2360:x1848989694382208:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334963.023638:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.023646:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499c4e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af59a expref: 188 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334963.023661:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499c4e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af59a expref: 188 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334963.023690:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499c4e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af59a expref: 188 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334963.023712:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:0.0:1763334963.023718:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.023729:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.023737:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.023775:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334963.023934:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.023947:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334963.023971:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 0 00010000:00010000:2.0:1763334963.024186:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499c6a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5af expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.024206:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5af expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.024214:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:2.0:1763334963.024217:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334963.024219:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334963.024397:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:2360:x1848989694382208:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 778us (1623us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.024406:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2435 00000100:00100000:2.0:1763334963.024493:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694381824:12345-192.168.201.60@tcp:101:bash.0 Request processed in 10955us (11377us total) trans 8589938715 rc 0/0 00000100:00100000:2.0:1763334963.024501:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4464 00000100:00100000:3.0:1763334963.026026:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.026177:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694382464 00000100:00100000:2.0:1763334963.026191:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694382464 00000100:00100000:2.0:1763334963.026258:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4465 00000100:00100000:2.0:1763334963.026269:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52993:x1848989694382464:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334963.026301:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.026331:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c7f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5b6 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.026424:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499c86 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.026438:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499c86 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.026452:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499c86 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.026467:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499c8d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.026474:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499c8d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.026480:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499c8d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.027020:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c94 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.027029:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.027038:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334963.027049:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 0 00010000:00010000:2.0:1763334963.027174:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499c86 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.027184:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499c86 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.027191:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499c86 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.027198:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.027203:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499c86 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.027213:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499c86 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.027227:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334963.027230:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.027236:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499c86 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.027244:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499c86 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.029808:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499c8d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.029830:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499c8d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.029838:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499c8d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.029845:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.029850:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499c8d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.029857:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499c8d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.029879:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab500) 00010000:00010000:2.0:1763334963.029882:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.029887:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499c8d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.029894:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499c8d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.029994:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499c7f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5b6 expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.030012:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5b6 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.030019:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:2.0:1763334963.030021:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763334963.030024:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:2.0:1763334963.032444:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:52993:x1848989694382464:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6160us (6411us total) trans 8589938716 rc 0/0 00000100:00100000:2.0:1763334963.032461:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4465 00000100:00100000:0.0:1763334963.032678:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.033325:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694382720 00000100:00100000:2.0:1763334963.033341:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694382720 00000100:00100000:2.0:1763334963.033406:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4466 00000100:00100000:2.0:1763334963.033417:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:52274:x1848989694382720:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:2.0:1763334963.033871:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.033893:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c94 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5b6 expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.033903:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.033946:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5b6 expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.033969:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5b6 expref: 190 pid: 29627 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334963.033988:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701808384:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334963.034180:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b540 going to sleep for 11 seconds 00000100:00100000:0.0:1763334963.036537:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.036654:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694382976 00000100:00100000:3.0:1763334963.036668:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694382976 00000100:00100000:3.0:1763334963.036741:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1653 00000100:00100000:3.0:1763334963.036753:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52993:x1848989694382976:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334963.037206:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52993:x1848989694382976:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 453us (681us total) trans 8589938718 rc 0/0 00000100:00100000:3.0:1763334963.037216:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1653 00000100:00100000:2.0:1763334963.041968:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701808384:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334963.042015:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334963.043631:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.043673:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.043754:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694383232 00000100:00100000:3.0:1763334963.043768:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694383232 00010000:00010000:3.0:1763334963.043819:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5b6 expref: 192 pid: 29627 timeout: 1127 lvb_type: 0 00000100:00100000:3.0:1763334963.043870:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2436 00000100:00100000:3.0:1763334963.043881:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2359:x1848989694383232:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334963.043898:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334963.043906:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5b6 expref: 192 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334963.043919:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5b6 expref: 192 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334963.043950:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499c94 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5b6 expref: 192 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334963.043968:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:3.0:1763334963.043974:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.043985:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.043992:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.044027:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334963.044092:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:2359:x1848989694383232:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 213us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.044100:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2436 00000100:00100000:0.0:1763334963.044187:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694383104 00000100:00100000:0.0:1763334963.044192:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694383104 00000100:00100000:0.0:1763334963.044227:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1654 00000100:00100000:0.0:1763334963.044234:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52993:x1848989694383104:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:0.0:1763334963.044390:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52993:x1848989694383104:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 156us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.044396:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1654 00010000:00010000:2.0:1763334963.045776:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.050430:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.050458:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:1.0:1763334963.050698:0:29627:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938717 00000004:00010000:1.0:1763334963.050792:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000015348b22 reply state 000000000021da47 transno 8589938719 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334963.050805:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334963.050978:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52274:x1848989694382720:12345-192.168.201.60@tcp:36:bash.0 Request processed in 17555us (18293us total) trans 8589938719 rc 0/0 00000100:00100000:1.0:1763334963.050993:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4466 00000020:00080000:1.0:1763334963.051003:0:29627:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1763334963.058888:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.058920:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.058929:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.058937:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.058943:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.058952:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.058980:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:2.0:1763334963.058986:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.058991:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.058998:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ca2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334963.062141:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.064831:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694383360 00000100:00100000:1.0:1763334963.064852:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694383360 00000100:00100000:1.0:1763334963.064938:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4467 00000100:00100000:1.0:1763334963.064949:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52274:x1848989694383360:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334963.064983:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334963.065013:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499ca9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5bd expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.065095:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5bd expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.065113:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499ca9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5bd expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.065136:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:1.0:1763334963.065140:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334963.065144:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334963.065233:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52274:x1848989694383360:12345-192.168.201.60@tcp:101:bash.0 Request processed in 285us (3106us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334963.065241:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4467 00000100:00100000:0.0:1763334963.074223:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.074398:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694383616 00000100:00100000:3.0:1763334963.074413:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694383616 00000100:00100000:3.0:1763334963.074488:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4468 00000100:00100000:3.0:1763334963.074499:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52274:x1848989694383616:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334963.074526:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.074530:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334963.074567:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499ca9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5bd expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.074620:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:3.0:1763334963.074626:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334963.074645:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8499cb0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5c4 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.074711:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499cb7 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334963.074726:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499cb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334963.074736:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499cb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:3.0:1763334963.075179:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1040, 88 off89712 00000004:00080000:3.0:1763334963.075190:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1027708617664ns, next at 1027972226189ns, rc = 0 00000040:00080000:3.0:1763334963.075229:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1029, 88 off88648 00000004:00080000:3.0:1763334963.075235:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1027708663171ns, next at 1027972101713ns, rc = 0 00000040:00080000:2.0:1763334963.078887:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1030, 88 off88736 00000004:00080000:2.0:1763334963.078907:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1027712334628ns, next at 1027972101713ns, rc = 0 00000040:00080000:2.0:1763334963.079227:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1041, 88 off89800 00000004:00080000:2.0:1763334963.079233:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1027712660971ns, next at 1027972226189ns, rc = 0 00000100:00100000:0.0:1763334963.079413:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.079476:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694383872 00000100:00100000:0.0:1763334963.079489:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694383872 00000100:00100000:0.0:1763334963.079555:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4469 00000100:00100000:0.0:1763334963.079565:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52994:x1848989694383872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334963.079616:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.079646:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cbe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5cb expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.079747:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cc5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.079765:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.079778:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.079795:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499ccc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.079802:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499ccc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.079809:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499ccc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.081747:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499cd3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.081773:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.081785:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:0.0:1763334963.081801:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 2 00010000:00010000:0.0:1763334963.081948:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499cd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.081955:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499cd3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.081963:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.081968:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.081973:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499cd3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.081979:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499cd3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.081992:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:0.0:1763334963.081995:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1763334963.082000:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499cd3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082007:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499cd3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082023:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cc5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082028:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cc5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082033:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082041:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.082044:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cc5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082050:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cc5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082058:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.082060:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.082063:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cc5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082069:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cc5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082078:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499ccc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082084:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499ccc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082089:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499ccc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082094:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.082096:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499ccc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082102:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499ccc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082108:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd200) 00010000:00010000:0.0:1763334963.082112:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.082115:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499ccc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082120:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f8499ccc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.082187:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cbe lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5cb expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.082200:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.082204:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334963.082207:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cbe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5cb expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.082217:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334963.085505:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52994:x1848989694383872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5923us (6079us total) trans 8589938721 rc 301/301 00000100:00100000:0.0:1763334963.085523:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4469 00000100:00100000:3.0:1763334963.089902:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.089951:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694384000 00000100:00100000:3.0:1763334963.089965:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694384000 00000100:00100000:3.0:1763334963.090035:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4470 00000100:00100000:3.0:1763334963.090047:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52994:x1848989694384000:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.090078:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.090110:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8499ce1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5d2 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.090228:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.090246:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5af expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.090253:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499cb7 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334963.090262:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.090295:0:30972:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499cb7 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334963.090330:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5af expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.090348:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5af expref: 196 pid: 29627 timeout: 1127 lvb_type: 0 00000100:00100000:3.0:1763334963.090365:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e15180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701808512:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334963.090469:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa65e180 going to sleep for 11 seconds 00000100:00100000:1.0:1763334963.095179:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.095267:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694384128 00000100:00100000:2.0:1763334963.095279:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694384128 00000100:00100000:3.0:1763334963.095283:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e15180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701808512:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334963.095328:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.095344:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5af expref: 197 pid: 29627 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334963.095390:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2437 00000100:00100000:2.0:1763334963.095401:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2360:x1848989694384128:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334963.095422:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334963.095430:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5af expref: 197 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334963.095443:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5af expref: 197 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334963.095473:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499c71 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5af expref: 197 pid: 29627 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334963.095493:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:2.0:1763334963.095499:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.095510:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.095517:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.095522:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334963.095700:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2360:x1848989694384128:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 299us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334963.095708:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2437 00000001:00080000:3.0:1763334963.118436:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938713 is committed 00000001:00080000:0.0:1763334963.118596:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938719 is committed 00000001:00080000:0.0:1763334963.118633:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938720 is committed 00000004:00080000:0.0:1763334963.118638:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 686 committed 00000004:00080000:0.0:1763334963.118650:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 674 committed 00000004:00080000:0.0:1763334963.118657:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 673 committed 00000004:00080000:0.0:1763334963.118660:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 685 committed 00000100:00100000:0.0:1763334963.118902:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701808640:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334963.118991:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334963.119041:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763334963.119047:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701809024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334963.119071:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334963.119103:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeecead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701808768:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334963.119125:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334963.119145:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763334963.119151:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701808896:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334963.119169:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334963.119207:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701808640 00000100:00100000:0.0:1763334963.119217:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701808640 00000100:00100000:0.0:1763334963.119276:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701809024 00000100:00100000:0.0:1763334963.119279:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701809024 00000100:00100000:0.0:1763334963.119311:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701808768 00000100:00100000:0.0:1763334963.119314:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701808768 00000100:00100000:0.0:1763334963.119331:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701808896 00000100:00100000:0.0:1763334963.119334:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701808896 00000100:00100000:0.0:1763334963.119357:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4600 00000100:00100000:0.0:1763334963.119369:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3290:x1848989701808640:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334963.119403:0:32239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:544 count 1 00010000:00010000:0.0:1763334963.119438:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.119465:0:32239:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499b4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af54d expref: 22 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.119474:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334963.119476:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334963.119480:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.119514:0:32239:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499b4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af54d expref: 22 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.119529:0:32239:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499b4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af54d expref: 22 pid: 21625 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334963.119541:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:32239:1848989701809152:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334963.119655:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1763334963.119676:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4601 00000100:00100000:0.0:1763334963.119685:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3290:x1848989701809024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334963.119987:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334963.119992:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763334963.119995:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334963.119997:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763334963.119998:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334963.120054:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3290:x1848989701809024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 370us (981us total) trans 17179870996 rc 0/0 00000100:00100000:0.0:1763334963.120063:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4601 00000100:00100000:0.0:1763334963.120088:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4602 00000100:00100000:0.0:1763334963.120094:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3291:x1848989701808768:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334963.120106:0:6517:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:545 count 1 00002000:00010000:0.0:1763334963.120131:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x221:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334963.120137:0:6517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499cf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.120146:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.120147:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.120155:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.120171:0:6517:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.120183:0:6517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499cf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.120191:0:6517:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499cf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.120210:0:6517:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334963.120457:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3291:x1848989701808768:12345-0@lo:6:osp-syn-1-0.0 Request processed in 362us (1330us total) trans 17179870997 rc 0/0 00000100:00100000:0.0:1763334963.120465:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4602 00000100:00100000:0.0:1763334963.120478:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4603 00000100:00100000:0.0:1763334963.120484:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3291:x1848989701808896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334963.120636:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3291:x1848989701808896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 151us (1465us total) trans 17179870998 rc 0/0 00000100:00100000:0.0:1763334963.120643:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4603 00010000:00010000:0.0:1763334963.120692:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334963.120699:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499cf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.120709:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334963.120714:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499cf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.120729:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499cf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.120749:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499cf6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.120757:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f8499cf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.120774:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334963.120777:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334963.120778:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334963.120823:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeece8000/2, rc 0, transno 17179870998 00000100:00100000:0.0:1763334963.120832:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701808896:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334963.120842:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeecead80/2, rc 0, transno 17179870997 00000100:00100000:0.0:1763334963.120845:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeecead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701808768:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763334963.120875:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeece9180/2, rc 0, transno 17179870996 00000100:00100000:0.0:1763334963.120879:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701809024:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763334963.122495:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499cb7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5c4 expref: 176 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.122515:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:2.0:1763334963.122518:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334963.122523:0:32232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.122534:0:32232:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.122541:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.122614:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f8499cb0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5c4 expref: 176 pid: 32232 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763334963.122642:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499cb7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5c4 expref: 175 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.122692:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abf400, rc 0) 00000100:00100000:2.0:1763334963.122769:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52274:x1848989694383616:12345-192.168.201.60@tcp:101:bash.0 Request processed in 48271us (48563us total) trans 8589938720 rc 0/0 00000100:00100000:2.0:1763334963.122779:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4468 00010000:00010000:3.0:1763334963.122883:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.122893:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334963.122934:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 2 00000004:00200000:3.0:1763334963.122939:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334963.122960:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.122989:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f8499ce1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d2 expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.123004:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d2 expref: 174 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.123011:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:3.0:1763334963.123013:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334963.123016:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abe800, rc 0) 00000100:00100000:3.0:1763334963.123065:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52994:x1848989694384000:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 33021us (33178us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.123078:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4470 00000100:00100000:2.0:1763334963.127749:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d72d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:32239:1848989701809152:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334963.127794:0:32239:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334963.128270:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.128500:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694384256 00000100:00100000:3.0:1763334963.128512:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694384256 00010000:00010000:3.0:1763334963.128560:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499b4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af54d expref: 23 pid: 21625 timeout: 1127 lvb_type: 0 00000100:00100000:3.0:1763334963.130019:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2438 00000100:00100000:3.0:1763334963.130041:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694384256:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334963.130064:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334963.130074:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499b4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af54d expref: 23 pid: 21625 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334963.130094:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499b4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af54d expref: 23 pid: 21625 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334963.130129:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499b4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af54d expref: 23 pid: 21625 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334963.130150:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.130153:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.130159:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.130171:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334963.130955:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701809664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334963.131058:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763334963.131990:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334963.132214:0:32239:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.132229:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.132240:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.132247:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.132278:0:32239:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334963.132370:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763334963.132384:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701809280:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334963.132432:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334963.132544:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701809536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334963.132586:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.132614:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701809664 00000100:00100000:2.0:1763334963.132627:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701809664 00000100:00100000:3.0:1763334963.132645:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694384256:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 2607us (4370us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.132659:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2438 00000100:00100000:2.0:1763334963.132682:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701809280 00000100:00100000:2.0:1763334963.132686:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701809280 00000100:00100000:2.0:1763334963.132711:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4604 00000100:00100000:2.0:1763334963.132721:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3289:x1848989701809664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334963.132833:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763334963.132840:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701809408:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334963.132862:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334963.132891:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701809536 00000100:00100000:0.0:1763334963.132895:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701809536 00000100:00100000:0.0:1763334963.132917:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701809408 00000100:00100000:0.0:1763334963.132920:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701809408 00000100:00100000:0.0:1763334963.132941:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4605 00000100:00100000:0.0:1763334963.132947:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+43:3289:x1848989701809280:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334963.132976:0:6518:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:540 count 1 00010000:00010000:0.0:1763334963.133007:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.133029:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499b28 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af53f expref: 22 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.133038:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334963.133041:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334963.133045:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334963.133217:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4606 00000100:00100000:3.0:1763334963.133228:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+43:3292:x1848989701809536:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763334963.133368:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499b28 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af53f expref: 22 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.133387:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499b28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af53f expref: 22 pid: 6517 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334963.133402:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6518:1848989701809792:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334963.133430:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+45:3292:x1848989701809536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (856us total) trans 21474838280 rc 0/0 00000100:00100000:3.0:1763334963.133438:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4606 00000100:00100000:3.0:1763334963.133458:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4607 00000100:00100000:3.0:1763334963.133466:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3292:x1848989701809408:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334963.133466:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1000 going to sleep for 11 seconds 00002000:00080000:3.0:1763334963.133480:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:541 count 1 00002000:00010000:3.0:1763334963.133508:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x21d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334963.133514:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.133524:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.133526:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.133533:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763334963.133539:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeec5bb80/2, rc 0, transno 21474838280 00010000:00010000:3.0:1763334963.133549:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334963.133549:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701809536:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1763334963.133564:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.133597:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.133616:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1763334963.133675:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334963.133679:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763334963.133682:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334963.133684:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763334963.133686:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334963.133730:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+44:3289:x1848989701809664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1011us (2672us total) trans 21474838279 rc 0/0 00000100:00100000:2.0:1763334963.133738:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4604 00010000:00010000:2.0:1763334963.133762:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763334963.133770:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.133779:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334963.133784:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.133793:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.133814:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.133821:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499cef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.133842:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334963.133846:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.133851:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334963.133854:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.133861:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d04 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.133870:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d04 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.133881:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334963.133883:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334963.133884:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334963.134149:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeec5b100/2, rc 0, transno 21474838279 00000100:00100000:0.0:1763334963.134155:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701809664:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763334963.134202:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334963.134532:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+25:3290:x1848989701808640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15164us (15539us total) trans 17179870999 rc 0/0 00000100:00100000:1.0:1763334963.134542:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4600 00000004:00080000:0.0:1763334963.134559:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeece9f80/2, rc 0, transno 17179870999 00000100:00100000:0.0:1763334963.134566:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701808640:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.134691:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.134738:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694384384 00000100:00100000:1.0:1763334963.134747:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694384384 00000100:00100000:1.0:1763334963.134791:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4608 00000100:00100000:1.0:1763334963.134799:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+22:52274:x1848989694384384:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334963.134816:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334963.134835:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5d9 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334963.134857:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x222:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334963.134875:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.134878:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.134887:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d9 expref: 23 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.134903:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d9 expref: 23 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.134917:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334963.134965:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+23:52274:x1848989694384384:12345-192.168.201.60@tcp:101:bash.0 Request processed in 167us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334963.134972:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4608 00010000:00010000:3.0:1763334963.135551:0:32241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334963.135901:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+44:3292:x1848989701809408:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2434us (3035us total) trans 21474838281 rc 0/0 00000100:00100000:3.0:1763334963.135910:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4607 00000100:00100000:0.0:1763334963.136024:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000004:00080000:1.0:1763334963.136217:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac8419c00/2, rc 0, transno 21474838281 00000100:00100000:1.0:1763334963.136225:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701809408:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334963.137249:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694384512 00000100:00100000:3.0:1763334963.137269:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694384512 00000100:00100000:3.0:1763334963.137348:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4609 00000100:00100000:3.0:1763334963.137358:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694384512:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.137390:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.137412:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499d12 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5e0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334963.137486:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701809920:192.168.201.60@tcp:106: 00000100:00100000:3.0:1763334963.138027:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa65e300 going to sleep for 11 seconds 00000100:00100000:2.0:1763334963.139872:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.139949:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.139979:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694384640 00000100:00100000:2.0:1763334963.139983:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694384768 00000100:00100000:1.0:1763334963.139995:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694384640 00000100:00100000:2.0:1763334963.139996:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694384768 00010000:00010000:2.0:1763334963.140052:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499b28 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af53f expref: 24 pid: 6517 timeout: 1127 lvb_type: 0 00000100:00100000:1.0:1763334963.140068:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4610 00000100:00100000:1.0:1763334963.140082:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+24:52274:x1848989694384640:12345-192.168.201.60@tcp:101:bash.0 00000100:00100000:2.0:1763334963.140090:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2439 00000100:00100000:2.0:1763334963.140101:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694384768:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334963.140103:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.140120:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334963.140127:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499b28 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af53f expref: 24 pid: 6517 timeout: 1127 lvb_type: 0 00010000:00010000:1.0:1763334963.140138:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499d19 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5e7 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.140144:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499b28 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af53f expref: 24 pid: 6517 timeout: 1127 lvb_type: 0 00002000:00010000:1.0:1763334963.140177:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x21e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334963.140183:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.140187:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.140199:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.140202:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.140204:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.140216:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.140219:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499d19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5e7 expref: 25 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.140245:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499d19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5e7 expref: 25 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.140256:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334963.140272:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:2.0:1763334963.140353:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694384768:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 252us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334963.140363:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2439 00010000:00010000:3.0:1763334963.140391:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499b28 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af53f expref: 24 pid: 6517 timeout: 1127 lvb_type: 0 00000100:00100000:3.0:1763334963.140412:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d72680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6518:1848989701809792:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334963.140442:0:6518:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.140453:0:6518:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.140461:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.140477:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.140486:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.140509:0:6518:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334963.140594:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334963.140602:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.140611:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334963.140616:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.140625:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.140638:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.140645:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499cfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.140665:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334963.140667:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334963.140669:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334963.141944:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+23:52274:x1848989694384640:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1851us (2072us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334963.141958:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4610 00000100:00100000:2.0:1763334963.143766:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3289:x1848989701809280:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10806us (11321us total) trans 21474838282 rc 0/0 00000100:00100000:2.0:1763334963.143788:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4605 00000004:00080000:1.0:1763334963.143921:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac8418380/2, rc 0, transno 21474838282 00000100:00100000:1.0:1763334963.143929:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701809280:0@lo:6:osp-syn-0-0.0 00002000:00010000:3.0:1763334963.144168:0:32241:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb mtime: 0 -> 1763334963 00002000:00010000:3.0:1763334963.144174:0:32241:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb atime: 0 -> 1763334963 00002000:00010000:3.0:1763334963.144177:0:32241:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb ctime: 0 -> 1763334963 00000100:00100000:3.0:1763334963.144207:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e15180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701809920:192.168.201.60@tcp:106: 00010000:00010000:3.0:1763334963.144379:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499d12 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5e0 expref: 24 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334963.144411:0:32241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f8499d12 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5e0 expref: 24 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334963.144426:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168e200, rc 0) 00000100:00100000:3.0:1763334963.144488:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694384512:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7131us (8466us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334963.144495:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4609 00000100:00100000:2.0:1763334963.148080:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.148125:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.148184:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.148398:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694384896 00000100:00100000:1.0:1763334963.148411:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694384896 00002000:00010000:1.0:1763334963.148469:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/546 (0->18446744073709551615) 00002000:00100000:1.0:1763334963.148474:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5ac000 with x1848989694384896 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334963.148490:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa5ac000. 00000100:00100000:1.0:1763334963.148526:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694385024 00000100:00100000:1.0:1763334963.148529:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694385024 00002000:00010000:1.0:1763334963.148543:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/542 (0->18446744073709551615) 00002000:00100000:1.0:1763334963.148546:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5aca80 with x1848989694385024 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334963.148555:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa5aca80. 00000100:00100000:1.0:1763334963.148609:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1700 00000100:00100000:1.0:1763334963.148620:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694384896:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334963.149008:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334963.149012:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb mtime from disk: 1763334963 -> 1763334963 00002000:00010000:1.0:1763334963.149016:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb atime from disk: 1763334963 -> 0 00002000:00010000:1.0:1763334963.149019:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb ctime from disk: 1763334963 -> 1763334963 00002000:00010000:1.0:1763334963.149022:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334963.149093:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694384896:12345-192.168.201.60@tcp:10:bash.0 Request processed in 475us (1026us total) trans 17179871000 rc 0/0 00000100:00100000:1.0:1763334963.149103:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1700 00002000:00010000:1.0:1763334963.149108:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/546 (0->18446744073709551615) 00002000:00100000:1.0:1763334963.149111:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5ac000 with x1848989694384896 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334963.149115:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa5ac000. 00000100:00100000:1.0:1763334963.149135:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1701 00000100:00100000:1.0:1763334963.149143:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694385024:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334963.149331:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334963.149334:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb mtime from disk: 0 -> 1763334963 00002000:00010000:1.0:1763334963.149337:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334963.149339:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb ctime from disk: 0 -> 1763334963 00002000:00010000:1.0:1763334963.149341:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334963.149366:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694385024:12345-192.168.201.60@tcp:10:bash.0 Request processed in 222us (1239us total) trans 21474838283 rc 0/0 00000100:00100000:1.0:1763334963.149373:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1701 00002000:00010000:1.0:1763334963.149376:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/542 (0->18446744073709551615) 00002000:00100000:1.0:1763334963.149378:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5aca80 with x1848989694385024 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334963.149382:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa5aca80. 00000100:00100000:3.0:1763334963.149713:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694385280 00000100:00100000:3.0:1763334963.149722:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694385280 00000100:00100000:3.0:1763334963.149759:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1655 00000100:00100000:3.0:1763334963.149767:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52994:x1848989694385280:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334963.149968:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52994:x1848989694385280:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 201us (1782us total) trans 8589938722 rc 0/0 00000100:00100000:3.0:1763334963.149975:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1655 00000100:00100000:2.0:1763334963.154433:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.154527:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694385536 00000100:00100000:3.0:1763334963.154542:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694385536 00000100:00100000:3.0:1763334963.154651:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1656 00000100:00100000:2.0:1763334963.155373:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52274:x1848989694385536:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:2.0:1763334963.157543:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52274:x1848989694385536:12345-192.168.201.60@tcp:35:bash.0 Request processed in 2862us (3104us total) trans 8589938723 rc 0/0 00000100:00100000:2.0:1763334963.157560:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1656 00000100:00100000:1.0:1763334963.159903:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.161242:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694385664 00000100:00100000:3.0:1763334963.161272:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694385664 00000100:00100000:3.0:1763334963.161374:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4471 00000100:00100000:3.0:1763334963.161387:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52994:x1848989694385664:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.161420:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.161450:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d20 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5ee expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.161544:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499d27 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161560:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499d27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161604:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499d27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161622:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d2e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161629:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161635:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161791:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499d35 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161801:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499d35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161808:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499d35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334963.161855:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 5 00000004:00200000:3.0:1763334963.161860:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334963.161882:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499d35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161896:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499d35 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161905:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499d27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161911:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499d27 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161918:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499d27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161925:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fc00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.161929:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499d27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161937:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499d27 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161950:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334963.161954:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.161958:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499d27 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161964:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499d27 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161980:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161985:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d2e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161991:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.161996:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.161999:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.162005:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d2e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.162012:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5e600) 00010000:00010000:3.0:1763334963.162014:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.162017:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d2e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.162023:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d2e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.162059:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d20 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5ee expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.162079:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499d35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5ee expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.162086:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:3.0:1763334963.162089:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334963.162092:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168ee00, rc 0) 00000100:00100000:3.0:1763334963.162189:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52994:x1848989694385664:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 804us (2301us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.162198:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4471 00000100:00100000:0.0:1763334963.169547:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.169728:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694385920 00000100:00100000:2.0:1763334963.169743:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694385920 00000100:00100000:2.0:1763334963.169820:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4472 00000100:00100000:2.0:1763334963.169833:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52994:x1848989694385920:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334963.169867:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.169897:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499d3c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5f5 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.170029:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334963.170048:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d2 expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.170056:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499d35 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5ee expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.170065:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334963.170111:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499d35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5ee expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.170128:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499d35 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5ee expref: 178 pid: 30972 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334963.170143:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701810048:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334963.170888:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d2 expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.170903:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d2 expref: 178 pid: 30972 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334963.170916:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad88bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701810176:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334963.170956:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334963.174807:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701810048:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334963.175081:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.175147:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad88bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701810176:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334963.175187:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334963.176128:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.177157:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694386176 00000100:00100000:3.0:1763334963.177175:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694386176 00000100:00100000:2.0:1763334963.177235:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694386048 00000100:00100000:2.0:1763334963.177240:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694386048 00000100:00100000:1.0:1763334963.177372:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334963.177449:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d2 expref: 180 pid: 30972 timeout: 1127 lvb_type: 0 00000100:00100000:1.0:1763334963.177504:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2440 00000100:00100000:1.0:1763334963.177515:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+180:2359:x1848989694386176:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334963.177537:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334963.177545:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d2 expref: 180 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:1.0:1763334963.177558:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d2 expref: 180 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:1.0:1763334963.177610:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f8499ce8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d2 expref: 180 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:1.0:1763334963.177632:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:1.0:1763334963.177638:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334963.177649:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334963.177658:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334963.177734:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+179:2359:x1848989694386176:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 221us (2655us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334963.177743:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2440 00010000:00010000:2.0:1763334963.178384:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499d35 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5ee expref: 178 pid: 30972 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334963.178414:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2441 00000100:00100000:2.0:1763334963.178425:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2359:x1848989694386048:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334963.178438:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1763334963.178444:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694386304 00010000:00010000:2.0:1763334963.178445:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499d35 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5ee expref: 178 pid: 30972 timeout: 1127 lvb_type: 0 00000100:00100000:3.0:1763334963.178453:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694386304 00010000:00010000:2.0:1763334963.178461:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499d35 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5ee expref: 179 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334963.178479:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499d35 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5ee expref: 179 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334963.178495:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:2.0:1763334963.178501:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334963.178508:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4473 00010000:00010000:2.0:1763334963.178514:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334963.178522:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52995:x1848989694386304:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:2.0:1763334963.178527:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334963.178548:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.178560:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334963.178593:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d4a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af5fc expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334963.178622:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+179:2359:x1848989694386048:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 198us (2502us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334963.178630:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2441 00010000:00010000:2.0:1763334963.178662:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334963.178672:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334963.178677:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d51 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.178696:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d51 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334963.178700:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 5 00010000:00010000:3.0:1763334963.178710:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d51 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.178904:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499d3c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5f5 expref: 180 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.178920:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5f5 expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.178927:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:2.0:1763334963.178929:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334963.178932:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:2.0:1763334963.178967:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52994:x1848989694385920:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 9137us (9435us total) trans 8589938724 rc 0/0 00000100:00100000:2.0:1763334963.178975:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4472 00010000:00010000:0.0:1763334963.181130:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d5f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.181163:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.181177:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.182601:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499d66 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.182625:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5f5 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.182635:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499d66 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.182695:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5f5 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.182715:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5f5 expref: 178 pid: 32232 timeout: 1127 lvb_type: 0 00000100:00100000:0.0:1763334963.182734:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701810304:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334963.182843:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1240 going to sleep for 11 seconds 00000100:00100000:0.0:1763334963.187529:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.188663:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694386432 00000100:00100000:1.0:1763334963.188685:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694386432 00000100:00100000:1.0:1763334963.188778:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4474 00000100:00100000:1.0:1763334963.188791:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52994:x1848989694386432:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334963.188829:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334963.188863:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499d6d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af603 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.188981:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499d74 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.189006:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499d74 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.189017:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499d74 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334963.192821:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d71f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701810304:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334963.192833:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334963.192866:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499d66 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334963.192945:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694386560 00000100:00100000:1.0:1763334963.192955:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694386560 00010000:00010000:1.0:1763334963.193012:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5f5 expref: 181 pid: 32232 timeout: 1127 lvb_type: 0 00000100:00100000:1.0:1763334963.193056:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2442 00000100:00100000:1.0:1763334963.193068:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+181:2359:x1848989694386560:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334963.193090:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334963.193098:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5f5 expref: 181 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:1.0:1763334963.193109:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5f5 expref: 181 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:1.0:1763334963.193133:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f8499d43 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x18a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5f5 expref: 181 pid: 32232 timeout: 1127 lvb_type: 0 00010000:00010000:1.0:1763334963.193149:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:1.0:1763334963.193153:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499d66 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.193165:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499d66 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.193172:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499d66 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.193179:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499d74 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.193183:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499d74 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.193188:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499d74 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.193227:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334963.193258:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499d74 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.193270:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499d74 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334963.193299:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d71180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+180:2359:x1848989694386560:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 232us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334963.193311:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2442 00000004:00200000:3.0:1763334963.193365:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 5 00000004:00200000:3.0:1763334963.193371:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334963.193395:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499d74 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.193495:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499d6d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af603 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.193515:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499d74 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af603 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.193523:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:3.0:1763334963.193526:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334963.193530:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:3.0:1763334963.193609:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52994:x1848989694386432:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4821us (6099us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.193665:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4474 00010000:00010000:0.0:1763334963.195406:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499d66 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195433:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499d66 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334963.195501:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 5 00000004:00200000:0.0:1763334963.195507:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334963.195536:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499d66 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195557:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499d66 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195596:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d51 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195605:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d51 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195614:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d51 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195622:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.195628:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d51 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195636:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d51 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195653:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.195656:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.195662:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d51 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195668:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499d51 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195689:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195696:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d5f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195702:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d5f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195709:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.195712:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d5f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195718:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d5f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195725:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5e600) 00010000:00010000:0.0:1763334963.195729:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.195732:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d5f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195737:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d5f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.195790:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499d4a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5fc expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.195807:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499d66 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5fc expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.195814:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:0.0:1763334963.195817:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334963.195820:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334963.195920:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52995:x1848989694386304:12345-192.168.201.60@tcp:101:rm.0 Request processed in 17400us (18549us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.195930:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4473 00000100:00100000:2.0:1763334963.200956:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.201025:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694386816 00000100:00100000:0.0:1763334963.201040:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694386816 00000100:00100000:0.0:1763334963.201117:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4475 00000100:00100000:0.0:1763334963.201145:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52994:x1848989694386816:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334963.201176:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.201208:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499d7b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af60a expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.201380:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499d82 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.201404:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499d82 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.201419:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499d82 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334963.201435:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 5 00010000:00010000:0.0:1763334963.201681:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499d7b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af60a expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.201704:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499d82 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af60a expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.201716:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:0.0:1763334963.201719:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334963.201724:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334963.201819:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52994:x1848989694386816:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 682us (878us total) trans 8589938725 rc 0/0 00000100:00100000:0.0:1763334963.201828:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4475 00000100:00100000:2.0:1763334963.203855:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.204196:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694387072 00000100:00100000:0.0:1763334963.204211:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694387072 00000100:00100000:0.0:1763334963.204302:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4476 00000100:00100000:0.0:1763334963.204316:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52995:x1848989694387072:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:0.0:1763334963.204397:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1763334963.204434:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499d66 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5fc expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.204461:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499d74 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af603 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.204477:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f8499cb7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5c4 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.204490:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:0.0:1763334963.204496:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334963.204528:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d90 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.204546:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d90 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.204557:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d90 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.204597:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499d97 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.204607:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499d97 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.204615:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499d97 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.204774:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499d9e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.204783:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499d9e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.204790:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499d9e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00080000:0.0:1763334963.205303:0:30972:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x18a:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1763334963.205459:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499d9e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.205468:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499d9e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.205475:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499d9e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.205481:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.205485:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499d9e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.205493:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499d9e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.205503:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:0.0:1763334963.205506:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763334963.205509:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499d9e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.205514:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499d9e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.205529:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d90 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.205534:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d90 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.205540:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d90 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.205544:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.205546:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d90 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.205552:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d90 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.205558:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.205560:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.205564:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d90 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.205609:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499d90 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334963.205622:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c7e4d767 reply state 0000000065c3575e transno 8589938726 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499d97 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334963.205632:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334963.205745:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52995:x1848989694387072:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1429us (1902us total) trans 8589938726 rc 0/0 00000100:00100000:0.0:1763334963.205755:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4476 00000100:00100000:1.0:1763334963.205881:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334963.209806:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499d97 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.209832:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499d97 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.209841:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499d97 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.209848:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.209855:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499d97 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.209864:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499d97 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.209887:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd200) 00010000:00010000:1.0:1763334963.209891:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.209898:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499d97 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.209904:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499d97 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334963.211022:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694387200 00000100:00100000:0.0:1763334963.211043:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694387200 00000100:00100000:0.0:1763334963.212270:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4477 00000100:00100000:0.0:1763334963.212309:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52994:x1848989694387200:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334963.212345:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.212375:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499da5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af611 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.212461:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499da5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af611 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.212478:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499da5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af611 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.212501:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:0.0:1763334963.212505:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334963.212509:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334963.212836:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52994:x1848989694387200:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 548us (6954us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.212846:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4477 00000100:00100000:2.0:1763334963.218761:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.218904:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.218964:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694387456 00000100:00100000:0.0:1763334963.218981:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694387456 00000100:00100000:0.0:1763334963.219058:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4611 00000100:00100000:0.0:1763334963.219071:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694387456:12345-192.168.201.60@tcp:1:lfs.0 00000100:00100000:3.0:1763334963.219187:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694387328 00000100:00100000:3.0:1763334963.219193:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694387328 00000100:00100000:3.0:1763334963.219246:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4478 00000100:00100000:3.0:1763334963.219263:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52996:x1848989694387328:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.219293:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.219326:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499dac lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af618 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.219428:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499db3 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.219429:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.219453:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499db3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.219457:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d9 expref: 24 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.219471:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334963.219475:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499db3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.219475:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334963.219481:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 4/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.219496:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499dc1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219504:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219511:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.219629:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d9 expref: 24 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.219648:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d9 expref: 24 pid: 32239 timeout: 1127 lvb_type: 0 00010000:00010000:3.0:1763334963.219651:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499db3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219670:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499db3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219679:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499db3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334963.219687:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701810432:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334963.219688:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.219696:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499db3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219708:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499db3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219728:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334963.219732:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.219737:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499db3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219745:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499db3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219764:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219770:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499dc1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219776:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219781:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.219783:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219789:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499dc1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219796:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5e700) 00010000:00010000:3.0:1763334963.219798:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.219801:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499dc1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.219806:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499dc1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334963.219818:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1540 going to sleep for 11 seconds 00010000:00010000:3.0:1763334963.219850:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499dac lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af618 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.219860:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334963.219863:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.219867:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499dac lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af618 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.219878:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fc00, rc 0) 00000100:00100000:3.0:1763334963.219919:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52996:x1848989694387328:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 665us (1177us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334963.219926:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4478 00000100:00100000:1.0:1763334963.223504:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.223618:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.223671:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694387712 00000100:00100000:0.0:1763334963.223685:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694387712 00000100:00100000:2.0:1763334963.223696:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694387584 00000100:00100000:2.0:1763334963.223703:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694387584 00002000:00100000:0.0:1763334963.223754:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x222:0x0] (0->4) req@ffff9a5aef0a3480 x1848989694387712/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:9/0 lens 496/0 e 0 to 0 dl 1763334974 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334963.223768:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a3480 with x1848989694387712 ext(0->4) 00000100:00100000:2.0:1763334963.223773:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4479 00010000:00010000:0.0:1763334963.223783:0:14384:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d9 expref: 25 pid: 32239 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334963.223789:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52996:x1848989694387584:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334963.223809:0:14384:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d9 expref: 25 pid: 32239 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334963.223814:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:0.0:1763334963.223822:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a5aef0a3480 00010000:00010000:2.0:1763334963.223843:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499dc8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af61f expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334963.223851:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 66 00000100:00100000:0.0:1763334963.223863:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694387712:12345-192.168.201.60@tcp:4:bash.0 00010000:00010000:2.0:1763334963.223927:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499dcf lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.223946:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499dcf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.223960:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499dcf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.223976:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499dd6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.223983:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.223990:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224080:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499dcf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224087:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499dcf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224095:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499dcf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224102:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.224107:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499dcf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224116:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499dcf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224132:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334963.224136:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.224142:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499dcf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224148:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499dcf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224162:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224169:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499dd6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224176:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224181:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.224184:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224191:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499dd6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224198:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cabd00) 00010000:00010000:2.0:1763334963.224201:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.224204:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499dd6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224210:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499dd6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.224245:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499dc8 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af61f expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.224256:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334963.224259:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.224262:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499dc8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af61f expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.224271:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066c00, rc 0) 00000100:00100000:2.0:1763334963.224355:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52996:x1848989694387584:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 571us (867us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334963.224363:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4479 00000100:00100000:3.0:1763334963.225392:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701810432:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334963.225432:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334963.227488:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.227671:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694387840 00000100:00100000:1.0:1763334963.227686:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694387840 00000100:00100000:1.0:1763334963.227767:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4480 00000100:00100000:1.0:1763334963.227779:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52996:x1848989694387840:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334963.227808:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334963.227840:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499ddd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af626 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.227933:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499de4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.227954:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499de4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.227967:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499de4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334963.228042:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:1.0:1763334963.228047:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334963.228081:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499de4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.228119:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499ddd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af626 expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.228142:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499de4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af626 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.228154:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334963.228158:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763334963.228162:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334963.228252:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52996:x1848989694387840:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 471us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.228254:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694387712:12345-192.168.201.60@tcp:4:bash.0 Request processed in 4387us (4630us total) trans 17179871001 rc 0/0 00000100:00100000:1.0:1763334963.228268:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4480 00000100:00100000:0.0:1763334963.228274:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 66 00002000:00100000:0.0:1763334963.228302:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x222:0x0] (0->4) req@ffff9a5aef0a3480 x1848989694387712/t17179871001(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:9/0 lens 496/448 e 0 to 0 dl 1763334974 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334963.228313:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a3480 with x1848989694387712 ext(0->4) 00010000:00010000:0.0:1763334963.228324:0:14384:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d9 expref: 27 pid: 32239 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334963.228343:0:14384:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d9 expref: 27 pid: 32239 timeout: 1127 lvb_type: 0 00002000:00010000:0.0:1763334963.228352:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a5aef0a3480 00000100:00100000:2.0:1763334963.232328:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.232433:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694387968 00000100:00100000:1.0:1763334963.232450:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694387968 00000100:00100000:1.0:1763334963.232538:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4481 00000100:00100000:1.0:1763334963.232553:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52996:x1848989694387968:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334963.232624:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334963.232659:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499deb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af62d expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.232760:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499df2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.232782:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499df2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.232797:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499df2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.232816:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499df9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.232822:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499df9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.232828:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499df9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.232932:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499df2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.232940:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499df2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.232948:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499df2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.232958:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.232963:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499df2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.232972:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499df2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.232987:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334963.232990:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.232995:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499df2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.233001:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f8499df2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.233014:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499df9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.233018:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499df9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.233024:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499df9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.233029:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.233032:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499df9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.233036:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499df9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.233041:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac54f6a00) 00010000:00010000:1.0:1763334963.233044:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.233047:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499df9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.233052:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499df9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.233089:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499deb lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af62d expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.233099:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334963.233101:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.233104:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499deb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af62d expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.233116:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334963.233216:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52996:x1848989694387968:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 665us (906us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334963.233226:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4481 00000100:00100000:1.0:1763334963.235937:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.238641:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694388224 00000100:00100000:2.0:1763334963.238669:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694388224 00000100:00100000:2.0:1763334963.238761:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4482 00000100:00100000:2.0:1763334963.238778:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52996:x1848989694388224:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334963.238812:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.238817:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334963.238862:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f8499de4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af626 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.238886:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334963.238892:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334963.238910:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499e00 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af634 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.239089:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499e07 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.239109:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499e07 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.239121:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499e07 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.239137:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499e0e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.239144:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499e0e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.239150:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499e0e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.239887:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499e15 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.239898:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499e15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.239905:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499e15 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334963.239916:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18b:0x0]: returning size 0 00010000:00010000:2.0:1763334963.239946:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499e07 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.239953:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499e07 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.239961:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499e07 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.239971:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.239975:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499e07 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.239983:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499e07 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.239990:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334963.239992:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.239996:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499e07 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.240001:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499e07 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:2.0:1763334963.240010:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bc30db15 reply state 0000000091e169af transno 8589938727 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499e0e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334963.240019:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334963.240049:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499e00 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af634 expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.240062:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499e15 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af634 expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.240068:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:2.0:1763334963.240071:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334963.240073:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067c00, rc 0) 00000100:00100000:2.0:1763334963.240169:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52996:x1848989694388224:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1397us (4246us total) trans 8589938727 rc 0/0 00000100:00100000:2.0:1763334963.240181:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4482 00000100:00100000:3.0:1763334963.240372:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334963.243804:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499e0e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334963.243816:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334963.243826:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499e0e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.243838:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499e0e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.243845:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.243851:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499e0e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.243861:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499e0e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.243882:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cabd00) 00010000:00010000:0.0:1763334963.243885:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.243891:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499e0e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.243897:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499e0e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334963.244004:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694388352 00000100:00100000:2.0:1763334963.244018:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694388352 00010000:00010000:2.0:1763334963.244065:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d9 expref: 27 pid: 32239 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334963.244717:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2443 00000100:00100000:2.0:1763334963.244731:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2361:x1848989694388352:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334963.244751:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763334963.244777:0:5734:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb size from disk: 0 -> 5 00002000:00010000:2.0:1763334963.244781:0:5734:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb atime from disk: 0 -> 1763334963 00010000:00010000:2.0:1763334963.244786:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d9 expref: 27 pid: 32239 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334963.244802:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d9 expref: 27 pid: 32239 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334963.244825:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f8499d0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5d9 expref: 27 pid: 32239 timeout: 1127 lvb_type: 0 00010000:00010000:2.0:1763334963.244841:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.244844:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.244850:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.244861:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.245397:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334963.245476:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2361:x1848989694388352:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 747us (5102us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334963.245485:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2443 00000100:00100000:2.0:1763334963.245521:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694388608 00000100:00100000:2.0:1763334963.245528:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694388608 00010000:00010000:3.0:1763334963.246059:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.246073:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334963.246535:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4483 00000100:00100000:2.0:1763334963.246552:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52996:x1848989694388608:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334963.246599:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.246628:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499e23 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af63b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.246756:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.246773:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499e15 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af634 expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.246786:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.246829:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499e15 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af634 expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.246845:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499e15 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af634 expref: 182 pid: 30972 timeout: 1127 lvb_type: 0 00000100:00100000:2.0:1763334963.246860:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee93ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701810560:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334963.246951:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1763334963.247077:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.247097:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.247106:0:32241:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.247114:0:32241:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334963.247129:0:32241:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.247144:0:32241:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.247166:0:32241:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 2/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.247174:0:32241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f8499dba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334963.247260:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694387456:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 28190us (28353us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.247271:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4611 00000100:00100000:0.0:1763334963.253924:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.253983:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee93ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701810560:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334963.254009:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694388864 00000100:00100000:1.0:1763334963.254019:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694388864 00010000:00010000:2.0:1763334963.254026:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334963.254090:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4484 00000100:00100000:1.0:1763334963.254100:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52994:x1848989694388864:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334963.254855:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334963.254899:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499da5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af611 expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.254933:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:1.0:1763334963.254940:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334963.254995:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499e31 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.255013:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499e31 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.255024:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499e31 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334963.256161:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.256222:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694388992 00000100:00100000:2.0:1763334963.256236:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694388992 00010000:00010000:2.0:1763334963.256302:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499e15 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af634 expref: 183 pid: 30972 timeout: 1127 lvb_type: 0 00000040:00080000:1.0:1763334963.257013:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1042, 88 off89888 00000004:00080000:1.0:1763334963.257028:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1027890455029ns, next at 1027972226189ns, rc = 0 00000100:00100000:0.0:1763334963.257184:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2444 00000100:00100000:0.0:1763334963.257199:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:2360:x1848989694388992:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334963.257225:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.257236:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499e15 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af634 expref: 183 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334963.257264:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499e15 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af634 expref: 183 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334963.257301:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499e15 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af634 expref: 183 pid: 30972 timeout: 1127 lvb_type: 0 00010000:00010000:0.0:1763334963.257324:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:0.0:1763334963.257330:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.257344:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.257351:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.257389:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334963.257477:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2360:x1848989694388992:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 277us (1318us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.257485:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2444 00010000:00010000:0.0:1763334963.257552:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.257560:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334963.257606:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18b:0x0]: returning size 0 00000040:00080000:1.0:1763334963.258559:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1031, 88 off88824 00000004:00080000:1.0:1763334963.258584:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1027892011630ns, next at 1027972101713ns, rc = 0 00000040:00080000:1.0:1763334963.258662:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1032, 88 off88912 00000004:00080000:1.0:1763334963.258667:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1027892095017ns, next at 1027972101713ns, rc = 0 00000040:00080000:1.0:1763334963.258696:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1043, 88 off89976 00000004:00080000:1.0:1763334963.258700:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1027892127953ns, next at 1027972226189ns, rc = 0 00000004:00080000:0.0:1763334963.258823:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x220:0x0], index 0: 0 00000004:00080000:0.0:1763334963.259229:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x224:0x0], index 1: 0 00000004:00080000:0.0:1763334963.259244:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x225:0x0], index 1: 0 00000004:00080000:0.0:1763334963.259263:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x221:0x0], index 0: 0 00010000:00010000:0.0:1763334963.259496:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.259510:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.259519:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.259526:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.259532:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.259543:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.259565:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:0.0:1763334963.259569:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334963.259611:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.259618:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499e2a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.259703:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499e23 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af63b expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.259726:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.259730:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334963.259736:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499e23 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af63b expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.259746:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:0.0:1763334963.259842:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52996:x1848989694388608:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 13295us (16039us total) trans 8589938728 rc 301/301 00000100:00100000:0.0:1763334963.259853:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4483 00000100:00100000:1.0:1763334963.272006:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.272605:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694389248 00000100:00100000:3.0:1763334963.272621:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694389248 00000100:00100000:3.0:1763334963.272698:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1657 00000100:00100000:3.0:1763334963.272711:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52996:x1848989694389248:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334963.273260:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52996:x1848989694389248:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 548us (1266us total) trans 8589938730 rc 0/0 00000100:00100000:3.0:1763334963.273270:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1657 00000100:00100000:3.0:1763334963.277933:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.278077:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694389504 00000100:00100000:2.0:1763334963.278092:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694389504 00000100:00100000:2.0:1763334963.278161:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1658 00000100:00100000:2.0:1763334963.278174:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52996:x1848989694389504:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334963.278560:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52996:x1848989694389504:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 387us (639us total) trans 8589938731 rc 0/0 00000100:00100000:2.0:1763334963.278594:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1658 00000100:00100000:3.0:1763334963.283949:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.284354:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694389760 00000100:00100000:0.0:1763334963.284370:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694389760 00000100:00100000:0.0:1763334963.284449:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4485 00000100:00100000:0.0:1763334963.284461:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52274:x1848989694389760:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334963.284490:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.284533:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499e3f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af642 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.284797:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499e46 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.284814:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499e46 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.284827:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499e46 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.284843:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499e4d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.284850:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499e4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.284860:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499e4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.284961:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499e54 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.284974:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499e54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.284981:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499e54 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334963.284993:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18b:0x0]: returning size 0 00010000:00010000:0.0:1763334963.285127:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499e46 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285136:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499e46 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285143:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499e46 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285149:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.285154:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499e46 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285162:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499e46 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285175:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.285178:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.285185:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499e46 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285200:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499e46 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285216:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499e4d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285221:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499e4d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285226:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499e4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285231:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.285233:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499e4d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285239:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499e4d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285245:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334963.285248:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.285250:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499e4d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285256:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499e4d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.285316:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499e3f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af642 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.285331:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499e54 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af642 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.285343:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5ac51bd200) 00010000:00010000:0.0:1763334963.285346:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334963.285348:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:0.0:1763334963.285444:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694389760:12345-192.168.201.60@tcp:101:bash.0 Request processed in 984us (1511us total) trans 8589938732 rc 0/0 00000100:00100000:0.0:1763334963.285454:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4485 00000100:00100000:1.0:1763334963.293975:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.294371:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694390016 00000100:00100000:0.0:1763334963.294388:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694390016 00000100:00100000:0.0:1763334963.294460:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4486 00000100:00100000:0.0:1763334963.294473:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694390016:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:0.0:1763334963.294553:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.294627:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499e54 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af642 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.294655:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5ac51bd200) 00010000:00010000:0.0:1763334963.294669:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334963.295020:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499e62 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.295039:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499e62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.295052:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499e62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:0.0:1763334963.295118:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938733 00000004:00010000:0.0:1763334963.295146:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ebff6deb reply state 0000000058ea6d90 transno 8589938734 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499e62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334963.295161:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334963.295299:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694390016:12345-192.168.201.60@tcp:36:bash.0 Request processed in 814us (1328us total) trans 8589938734 rc 0/0 00000100:00100000:0.0:1763334963.295307:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4486 00000020:00080000:0.0:1763334963.295315:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763334963.300265:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334963.300499:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499e62 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.300514:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499e62 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.300523:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499e62 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.300535:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.300541:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499e62 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.300551:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499e62 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.300595:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5ac94cc600) 00010000:00010000:1.0:1763334963.300599:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.300605:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499e62 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.300612:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f8499e62 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334963.300742:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694390144 00000100:00100000:3.0:1763334963.300755:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694390144 00000100:00100000:3.0:1763334963.300823:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4487 00000100:00100000:3.0:1763334963.300835:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694390144:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334963.300860:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.300885:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499e69 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af649 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.300960:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499e69 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af649 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.300976:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499e69 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af649 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.300997:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5acbb5e600) 00010000:00010000:3.0:1763334963.301000:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334963.301003:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fc00, rc 0) 00000100:00100000:3.0:1763334963.301074:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694390144:12345-192.168.201.60@tcp:101:bash.0 Request processed in 241us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.301082:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4487 00000100:00100000:0.0:1763334963.307311:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.307410:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694390400 00000100:00100000:1.0:1763334963.307425:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694390400 00000100:00100000:1.0:1763334963.307496:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4488 00000100:00100000:1.0:1763334963.307508:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694390400:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334963.307547:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334963.307550:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334963.307615:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499e69 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af649 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.307635:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5acbb5e600) 00010000:00010000:1.0:1763334963.307649:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334963.307671:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499e70 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af650 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.307734:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499e77 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.307750:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499e77 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.307761:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499e77 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:1.0:1763334963.308273:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1033, 88 off89000 00000004:00080000:1.0:1763334963.308295:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1027941722386ns, next at 1027972101713ns, rc = 0 00000040:00080000:1.0:1763334963.308370:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1044, 88 off90064 00000004:00080000:1.0:1763334963.308377:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1027941805243ns, next at 1027972226189ns, rc = 0 00000040:00080000:1.0:1763334963.308461:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1046, 88 off90200 00000004:00080000:1.0:1763334963.308468:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1027941895771ns, next at 1027972226189ns, rc = 0 00000040:00080000:1.0:1763334963.308500:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1034, 88 off89088 00000004:00080000:1.0:1763334963.308505:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1027941932913ns, next at 1027972101713ns, rc = 0 00000001:00080000:3.0:1763334963.326262:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938729 is committed 00000001:00080000:0.0:1763334963.326262:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938728 is committed 00000004:00080000:3.0:1763334963.326296:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 688 committed 00000004:00080000:3.0:1763334963.326317:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 676 committed 00000004:00080000:3.0:1763334963.326328:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 675 committed 00000004:00080000:3.0:1763334963.326331:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 687 committed 00000100:00100000:0.0:1763334963.326530:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee93ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701810688:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334963.326667:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334963.326721:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763334963.326728:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af59faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701811072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334963.326753:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334963.326786:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701810816:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334963.326810:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334963.326829:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763334963.326834:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701810944:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334963.326856:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334963.326910:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701810688 00000100:00100000:0.0:1763334963.326919:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701810688 00000100:00100000:0.0:1763334963.326984:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701811072 00000100:00100000:0.0:1763334963.326987:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701811072 00000100:00100000:0.0:1763334963.327016:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701810816 00000100:00100000:0.0:1763334963.327019:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701810816 00000100:00100000:0.0:1763334963.327037:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701810944 00000100:00100000:0.0:1763334963.327040:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701810944 00000100:00100000:0.0:1763334963.327064:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4612 00000100:00100000:0.0:1763334963.327075:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef84bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3290:x1848989701810688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334963.327100:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4613 00000100:00100000:3.0:1763334963.327112:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3290:x1848989701811072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334963.328123:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334963.328137:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb mtime from disk: 1763334963 -> 1763334963 00002000:00010000:0.0:1763334963.328141:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334963.328143:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb ctime from disk: 1763334963 -> 1763334963 00002000:00010000:0.0:1763334963.328146:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334963.328253:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef84bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3290:x1848989701810688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1177us (1583us total) trans 21474838284 rc 0/0 00000100:00100000:0.0:1763334963.328264:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4612 00000100:00100000:0.0:1763334963.328464:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4614 00000100:00100000:0.0:1763334963.328477:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3291:x1848989701810816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334963.328481:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334963.328486:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763334963.328488:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334963.328490:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763334963.328492:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334963.328533:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3290:x1848989701811072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1423us (1777us total) trans 17179871002 rc 0/0 00000100:00100000:3.0:1763334963.328541:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4613 00000100:00100000:3.0:1763334963.328561:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4615 00000100:00100000:3.0:1763334963.328588:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3291:x1848989701810944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334963.328645:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334963.328649:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763334963.328652:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334963.328654:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763334963.328656:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334963.328696:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3291:x1848989701810816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 223us (1884us total) trans 21474838285 rc 0/0 00000100:00100000:0.0:1763334963.328704:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4614 00000100:00100000:3.0:1763334963.328739:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+27:3291:x1848989701810944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 169us (1881us total) trans 17179871003 rc 0/0 00000100:00100000:3.0:1763334963.328747:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4615 00000004:00080000:0.0:1763334963.328803:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af59faa00/2, rc 0, transno 17179871002 00000100:00100000:0.0:1763334963.328832:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af59faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701811072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334963.328850:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee93ca80/2, rc 0, transno 21474838284 00000100:00100000:0.0:1763334963.328864:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee93ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701810688:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334963.328893:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4e300/2, rc 0, transno 17179871003 00000100:00100000:0.0:1763334963.328898:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701810944:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334963.328906:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c39e6d80/2, rc 0, transno 21474838285 00000100:00100000:0.0:1763334963.328911:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701810816:0@lo:2:osp-syn-0-0.0 00000004:00010000:1.0:1763334963.330060:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000075d33421 reply state 000000006c57a9b3 transno 8589938729 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499e31 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334963.330082:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1763334963.330243:0:29627:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763334963.330272:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52994:x1848989694388864:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 76167us (76359us total) trans 8589938729 rc 0/0 00000100:00100000:1.0:1763334963.330293:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4484 00010000:00010000:2.0:1763334963.330447:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499e31 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.330458:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499e31 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.330467:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499e31 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.330474:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.330479:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499e31 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.330492:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499e31 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.330514:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:2.0:1763334963.330518:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334963.330525:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499e31 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.330532:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f8499e31 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334963.340027:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.341325:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694390528 00000100:00100000:3.0:1763334963.341347:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694390528 00000100:00100000:3.0:1763334963.341425:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4489 00000100:00100000:3.0:1763334963.341440:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52994:x1848989694390528:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.341473:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.341500:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499e7e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af657 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.341616:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499e7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af657 expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.341632:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499e7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af657 expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.341655:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:3.0:1763334963.341660:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334963.341665:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f600, rc 0) 00000100:00100000:3.0:1763334963.341750:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52994:x1848989694390528:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 314us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.341759:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4489 00000100:00100000:3.0:1763334963.349766:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.349885:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694390656 00000100:00100000:0.0:1763334963.349899:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694390656 00000100:00100000:0.0:1763334963.349975:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4490 00000100:00100000:0.0:1763334963.349988:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52994:x1848989694390656:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334963.350016:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.350045:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499e85 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af65e expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.350143:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499e8c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334963.350163:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499e8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334963.350177:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499e8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334963.350226:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18a:0x0]: returning size 5 00000004:00200000:0.0:1763334963.350231:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334963.350252:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499e8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334963.350298:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499e85 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af65e expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.350318:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499e8c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af65e expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.350327:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:0.0:1763334963.350331:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763334963.350337:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334963.350424:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52994:x1848989694390656:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 437us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.350432:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4490 00000100:00100000:3.0:1763334963.355215:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.356982:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694390784 00000100:00100000:1.0:1763334963.356999:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694390784 00000100:00100000:1.0:1763334963.357071:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4616 00000100:00100000:1.0:1763334963.357082:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694390784:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334963.357105:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334963.357133:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8499e93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af665 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334963.357164:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x222:0x0] initial LVB size: 5, mtime: 0x691a5b33, atime: 0x691a5b33, ctime: 0x691a5b33, blocks: 0x1 00010000:00010000:1.0:1763334963.357190:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.357192:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.357205:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8499e93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af665 expref: 26 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334963.357225:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8499e93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af665 expref: 26 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334963.357240:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478800, rc 0) 00000100:00100000:1.0:1763334963.357428:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694390784:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 348us (2226us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334963.357437:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4616 00000001:00080000:1.0:1763334963.385660:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938734 is committed 00000001:00080000:2.0:1763334963.385818:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938735 is committed 00000004:00080000:2.0:1763334963.385826:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 678 committed 00000004:00080000:2.0:1763334963.385843:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 690 committed 00000004:00080000:2.0:1763334963.385850:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 689 committed 00000004:00080000:2.0:1763334963.385853:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 677 committed 00000100:00100000:3.0:1763334963.386015:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701811328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334963.386118:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334963.386224:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701811328 00000100:00100000:3.0:1763334963.386235:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701811328 00000100:00100000:3.0:1763334963.386305:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4617 00000100:00100000:3.0:1763334963.386316:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+46:3291:x1848989701811328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334963.386677:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+47:3291:x1848989701811328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 361us (557us total) trans 21474838286 rc 0/0 00000100:00100000:3.0:1763334963.386685:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4617 00000004:00080000:3.0:1763334963.386740:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5574380/2, rc 0, transno 21474838286 00000100:00100000:3.0:1763334963.386746:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701811328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334963.386857:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763334963.386866:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701811456:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334963.386895:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334963.386925:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701811456 00000100:00100000:3.0:1763334963.386929:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701811456 00000100:00100000:3.0:1763334963.386953:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4618 00000100:00100000:3.0:1763334963.386959:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3291:x1848989701811456:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334963.387112:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3291:x1848989701811456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 152us (216us total) trans 17179871004 rc 0/0 00000100:00100000:3.0:1763334963.387118:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4618 00000004:00080000:3.0:1763334963.387141:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841b800/2, rc 0, transno 17179871004 00000100:00100000:3.0:1763334963.387146:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701811456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.387252:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701811200:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334963.387296:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.387319:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763334963.387324:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac721a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701811584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.387345:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334963.388018:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701811200 00000100:00100000:1.0:1763334963.388027:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701811200 00000100:00100000:1.0:1763334963.388080:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701811584 00000100:00100000:1.0:1763334963.388083:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701811584 00000100:00100000:1.0:1763334963.388107:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4619 00000100:00100000:1.0:1763334963.388115:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+47:3290:x1848989701811200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334963.388355:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+48:3290:x1848989701811200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 240us (1057us total) trans 21474838287 rc 0/0 00000100:00100000:1.0:1763334963.388362:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4619 00000100:00100000:1.0:1763334963.388380:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4620 00000100:00100000:1.0:1763334963.388387:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3290:x1848989701811584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334963.388500:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3290:x1848989701811584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 113us (1153us total) trans 17179871005 rc 0/0 00000100:00100000:1.0:1763334963.388506:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4620 00000004:00080000:1.0:1763334963.388555:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac721a300/2, rc 0, transno 17179871005 00000100:00100000:1.0:1763334963.388561:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac721a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701811584:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334963.388602:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5576680/2, rc 0, transno 21474838287 00000100:00100000:1.0:1763334963.388607:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701811200:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1763334963.388794:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499e77 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af650 expref: 176 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.388811:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:0.0:1763334963.388815:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763334963.388837:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499e70 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af650 expref: 176 pid: 30972 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763334963.388858:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499e77 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18b:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af650 expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.388892:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:0.0:1763334963.388895:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763334963.388897:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:0.0:1763334963.388952:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52274:x1848989694390400:12345-192.168.201.60@tcp:101:bash.0 Request processed in 81448us (81669us total) trans 8589938735 rc 0/0 00000100:00100000:0.0:1763334963.388960:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4488 00000100:00100000:0.0:1763334963.393778:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.393881:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694390912 00000100:00100000:3.0:1763334963.393896:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694390912 00000100:00100000:3.0:1763334963.393970:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4621 00000100:00100000:3.0:1763334963.393983:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+24:52274:x1848989694390912:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334963.394008:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.394037:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499e9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af66c expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334963.394071:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x220:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334963.394101:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.394103:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.394115:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499e9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af66c expref: 25 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.394139:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499e9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af66c expref: 25 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.394156:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168e200, rc 0) 00000100:00100000:3.0:1763334963.394244:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+25:52274:x1848989694390912:12345-192.168.201.60@tcp:101:bash.0 Request processed in 264us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.394264:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4621 00000100:00100000:1.0:1763334963.401687:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.401801:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694391040 00000100:00100000:3.0:1763334963.401814:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694391040 00000100:00100000:3.0:1763334963.401890:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4622 00000100:00100000:3.0:1763334963.401902:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+26:52274:x1848989694391040:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334963.401925:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.401956:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ea1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af673 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334963.401988:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x224:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334963.402018:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.402020:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.402032:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af673 expref: 27 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.402052:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af673 expref: 27 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.402066:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fe00, rc 0) 00000100:00100000:3.0:1763334963.402130:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+27:52274:x1848989694391040:12345-192.168.201.60@tcp:101:bash.0 Request processed in 231us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.402138:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4622 00000100:00100000:0.0:1763334963.407456:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.407513:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.408010:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694391168 00000100:00100000:1.0:1763334963.408024:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694391168 00002000:00010000:1.0:1763334963.408080:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/544 (0->18446744073709551615) 00002000:00100000:1.0:1763334963.408086:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac37cd880 with x1848989694391168 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334963.408103:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac37cd880. 00000100:00100000:1.0:1763334963.409590:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694391296 00000100:00100000:1.0:1763334963.409608:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694391296 00002000:00010000:1.0:1763334963.409656:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/548 (0->18446744073709551615) 00002000:00100000:1.0:1763334963.409662:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac37cd500 with x1848989694391296 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334963.409677:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac37cd500. 00000100:00100000:2.0:1763334963.409790:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1702 00000100:00100000:2.0:1763334963.409808:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694391168:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334963.410232:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x220:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334963.410237:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x220:0x0] updating lvb mtime from disk: 0 -> 1763334963 00002000:00010000:2.0:1763334963.410240:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x220:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334963.410242:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x220:0x0] updating lvb ctime from disk: 0 -> 1763334963 00002000:00010000:2.0:1763334963.410244:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x220:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334963.410363:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694391168:12345-192.168.201.60@tcp:10:bash.0 Request processed in 560us (2922us total) trans 21474838288 rc 0/0 00000100:00100000:2.0:1763334963.410374:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1702 00002000:00010000:2.0:1763334963.410381:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/544 (0->18446744073709551615) 00002000:00100000:2.0:1763334963.410385:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac37cd880 with x1848989694391168 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334963.410391:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac37cd880. 00000100:00100000:2.0:1763334963.410420:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1703 00000100:00100000:2.0:1763334963.410430:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694391296:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334963.410657:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x224:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334963.410660:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x224:0x0] updating lvb mtime from disk: 0 -> 1763334963 00002000:00010000:2.0:1763334963.410663:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x224:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334963.410665:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x224:0x0] updating lvb ctime from disk: 0 -> 1763334963 00002000:00010000:2.0:1763334963.410668:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x224:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334963.410690:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694391296:12345-192.168.201.60@tcp:10:bash.0 Request processed in 263us (3176us total) trans 17179871006 rc 0/0 00000100:00100000:2.0:1763334963.410698:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1703 00002000:00010000:2.0:1763334963.410701:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/548 (0->18446744073709551615) 00002000:00100000:2.0:1763334963.410704:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac37cd500 with x1848989694391296 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334963.410709:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac37cd500. 00000100:00100000:0.0:1763334963.421747:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.421850:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694391552 00000100:00100000:2.0:1763334963.421865:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694391552 00000100:00100000:2.0:1763334963.421941:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1659 00000100:00100000:2.0:1763334963.421954:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52274:x1848989694391552:12345-192.168.201.60@tcp:35:bash.0 00000001:00080000:2.0:1763334963.422435:0:29631:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938736 00000100:00100000:2.0:1763334963.422610:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52274:x1848989694391552:12345-192.168.201.60@tcp:35:bash.0 Request processed in 658us (877us total) trans 8589938737 rc 0/0 00000100:00100000:2.0:1763334963.422621:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1659 00000020:00080000:2.0:1763334963.422628:0:29631:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763334963.436048:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.436137:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694391680 00000100:00100000:3.0:1763334963.436151:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694391680 00000100:00100000:3.0:1763334963.436250:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1704 00000100:00100000:3.0:1763334963.436261:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694391680:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:3.0:1763334963.436319:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499ea8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.436340:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.436343:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.436350:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499ea8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.436366:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499ea8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.436531:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499ea8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.436541:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499ea8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.436550:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499ea8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.436557:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168ee00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334963.436562:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499ea8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.436621:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499ea8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.436648:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499ea8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.436657:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499ea8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334963.436746:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694391680:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 486us (715us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763334963.436757:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1704 00000100:00100000:0.0:1763334963.445813:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.445872:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.445963:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694391808 00000100:00100000:3.0:1763334963.445978:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694391808 00000100:00100000:3.0:1763334963.446053:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694391936 00000100:00100000:3.0:1763334963.446057:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694391936 00000100:00100000:3.0:1763334963.446097:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4491 00000100:00100000:3.0:1763334963.446109:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52994:x1848989694391808:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.446144:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.446174:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499eaf lrc: 2/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af67a expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.446223:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499eb6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.446242:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.446256:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.446416:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499eaf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af67a expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.446438:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fc00/0xcedf0054f8499eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af67a expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.446448:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:3.0:1763334963.446451:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763334963.446456:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fc00, rc 0) 00000100:00100000:3.0:1763334963.446538:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52994:x1848989694391808:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 431us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334963.446550:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4492 00000100:00100000:2.0:1763334963.446593:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52997:x1848989694391936:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:2.0:1763334963.446603:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.446618:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499ebd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af681 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.446673:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499ec4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.446684:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.446694:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.446713:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499ecb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.446722:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499ecb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.446730:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499ecb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.446905:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499ed2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.446914:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.446926:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334963.446965:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18b:0x0]: returning size 5 00000004:00200000:2.0:1763334963.446971:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334963.446992:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447007:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499ed2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447017:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499ec4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447025:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499ec4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447033:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447040:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.447044:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499ec4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447054:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499ec4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447063:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334963.447066:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.447071:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499ec4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447077:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499ec4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447090:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499ecb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447096:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499ecb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447102:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499ecb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447107:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.447110:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499ecb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447116:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499ecb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447124:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334963.447127:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.447130:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499ecb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447136:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f8499ecb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.447162:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f8499ebd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af681 expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.447173:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499ed2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af681 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.447180:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:2.0:1763334963.447183:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334963.447186:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:2.0:1763334963.447232:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52997:x1848989694391936:12345-192.168.201.60@tcp:101:rm.0 Request processed in 672us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.448116:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4491 00000100:00100000:2.0:1763334963.449011:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4492 00000100:00100000:0.0:1763334963.453320:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.453446:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694392064 00000100:00100000:1.0:1763334963.453462:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694392064 00000100:00100000:1.0:1763334963.453612:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1705 00000100:00100000:1.0:1763334963.453627:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694392064:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:1.0:1763334963.453689:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.453718:0:14385:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499c5c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a1 expref: 26 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334963.453729:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.453732:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.453736:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.453789:0:14385:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499c5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a1 expref: 26 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334963.453807:0:14385:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499c5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a1 expref: 26 pid: 32239 timeout: 1128 lvb_type: 1 00000100:00100000:1.0:1763334963.453828:0:14385:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14385:1848989701811712:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334963.453948:0:14385:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee000 going to sleep for 11 seconds 00000100:00100000:0.0:1763334963.457013:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.457367:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694392320 00000100:00100000:2.0:1763334963.457385:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694392320 00000100:00100000:2.0:1763334963.457489:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4493 00000100:00100000:2.0:1763334963.457503:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52997:x1848989694392320:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:2.0:1763334963.457613:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1763334963.457651:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499ed2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af681 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.457678:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f8499e77 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af650 expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.457691:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:2.0:1763334963.457704:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334963.457738:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ee0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.457756:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.457768:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.457786:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ee7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.457794:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.457803:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.457976:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499eee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.457986:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499eee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.457993:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499eee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334963.458247:0:14385:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a2300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14385:1848989701811712:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334963.458298:0:14385:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000040:00080000:2.0:1763334963.458661:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1035, 64 off89152 00000004:00080000:2.0:1763334963.458673:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028092099993ns, next at 1029092096998ns, rc = 0 00000040:00080000:2.0:1763334963.458725:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1047, 64 off90264 00000004:00080000:2.0:1763334963.458730:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1028092158583ns, next at 1029092157246ns, rc = 0 00000040:00080000:2.0:1763334963.458747:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1048, 64 off90328 00000040:00080000:2.0:1763334963.458761:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1036, 64 off89216 00010000:00010000:2.0:1763334963.458844:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ef5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.458855:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.458865:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ef5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.458873:0:30972:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ef5 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.458880:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ef5 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.458892:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ef5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.458918:0:30972:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334963.458944:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499eee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.458951:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499eee lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.458959:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499eee lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.458965:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334963.458967:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.458976:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499eee lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.458983:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ef5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.458988:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499eee lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.459004:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334963.459012:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5ac6cabc00) 00010000:00010000:0.0:1763334963.459013:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ef5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.459025:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763334963.459033:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499eee lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.459034:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ef5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.459065:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499eee lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18b:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.459132:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ee0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.459138:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ee0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.459147:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.459153:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.459155:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ee0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.459161:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ee0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.459167:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334963.459169:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.459172:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ee0 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.459177:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ee0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:2.0:1763334963.459185:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000202f85ee reply state 0000000010c11591 transno 8589938738 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334963.459194:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334963.459317:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52997:x1848989694392320:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1814us (2312us total) trans 8589938738 rc 0/0 00000100:00100000:2.0:1763334963.459328:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4493 00010000:00010000:0.0:1763334963.459803:0:8206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18b:0x0].0x0 (ffff9a5ac6cabc00) 00010000:00010000:0.0:1763334963.459807:0:8206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763334963.459813:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ef5 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.459820:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f8499ef5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.459845:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334963.459847:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334963.459849:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334963.460877:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.462498:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694392448 00000100:00100000:2.0:1763334963.462519:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694392448 00010000:00010000:2.0:1763334963.462600:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499c5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a1 expref: 27 pid: 32239 timeout: 1128 lvb_type: 1 00000100:00100000:1.0:1763334963.465090:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2445 00000100:00100000:1.0:1763334963.465123:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694392448:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334963.465149:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334963.465183:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499c5c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a1 expref: 27 pid: 32239 timeout: 1128 lvb_type: 1 00010000:00010000:1.0:1763334963.465203:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499c5c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a1 expref: 27 pid: 32239 timeout: 1128 lvb_type: 1 00010000:00010000:1.0:1763334963.465232:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f8499c5c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a1 expref: 27 pid: 32239 timeout: 1128 lvb_type: 1 00010000:00010000:1.0:1763334963.465253:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.465256:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.465262:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.465273:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.467511:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ee7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.467538:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ee7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.467549:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.467557:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.467563:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ee7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.467602:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ee7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.467626:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab900) 00010000:00010000:2.0:1763334963.467631:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.467638:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ee7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.467645:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ee7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.467882:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334963.467988:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88ee050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694392448:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 2875us (7109us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334963.468003:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2445 00010000:00010000:2.0:1763334963.471127:0:14385:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.471153:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334963.487020:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.487086:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694392576 00000100:00100000:1.0:1763334963.487095:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694392576 00000100:00100000:1.0:1763334963.488792:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4494 00000100:00100000:1.0:1763334963.488812:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52998:x1848989694392576:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334963.488842:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334963.488866:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499efc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af688 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.488947:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499f03 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.488964:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499f03 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.488977:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499f03 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.488990:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499f0a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.488998:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499f0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489004:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499f0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489064:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499f03 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489071:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499f03 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489078:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499f03 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489083:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.489087:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499f03 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489094:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499f03 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489107:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334963.489110:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.489828:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499f03 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489842:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f8499f03 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489856:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499f0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489862:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499f0a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489868:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499f0a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489873:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.489876:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499f0a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489882:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499f0a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489891:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa300) 00010000:00010000:1.0:1763334963.489894:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.489898:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499f0a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489904:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f8499f0a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.489942:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499efc lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af688 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.489952:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334963.489955:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.489958:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f8499efc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af688 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.489972:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334963.490044:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52998:x1848989694392576:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1238us (3033us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334963.490053:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4494 00000100:00100000:3.0:1763334963.504644:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.504681:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694392704 00000100:00100000:3.0:1763334963.504691:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694392704 00000100:00100000:3.0:1763334963.504746:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4495 00000100:00100000:3.0:1763334963.504756:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52998:x1848989694392704:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.504776:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.504796:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499f11 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af68f expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.504864:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f18 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.504878:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f18 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.504890:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f18 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.504904:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499f1f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.504912:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499f1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.504918:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499f1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.504973:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f18 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.504980:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f18 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.504987:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f18 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.504992:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ad8098a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.504996:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f18 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.505003:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f18 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.505016:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334963.505019:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.505024:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f18 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.505030:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f18 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.505041:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499f1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.505047:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499f1f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.505054:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499f1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.505059:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ad8098800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.505061:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499f1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.505067:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499f1f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.505073:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4100) 00010000:00010000:3.0:1763334963.505076:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.505078:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499f1f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.505084:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499f1f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.505113:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499f11 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af68f expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.505123:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334963.505126:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.505129:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f8499f11 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af68f expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.505139:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168ee00, rc 0) 00000100:00100000:3.0:1763334963.505192:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52998:x1848989694392704:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 437us (560us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334963.505199:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4495 00000100:00100000:1.0:1763334963.508086:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.508310:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694392832 00000100:00100000:0.0:1763334963.508324:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694392832 00000100:00100000:0.0:1763334963.508376:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4496 00000100:00100000:0.0:1763334963.508385:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52998:x1848989694392832:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334963.508403:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.508425:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499f26 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af696 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.508499:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499f2d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.508512:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499f2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.508523:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499f2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334963.508606:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:0.0:1763334963.508610:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334963.508630:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499f2d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.508655:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499f26 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af696 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.508671:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499f2d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af696 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.508681:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.508684:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763334963.508688:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334963.508746:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52998:x1848989694392832:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 362us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.508753:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4496 00000100:00100000:1.0:1763334963.517269:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.517794:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694392960 00000100:00100000:0.0:1763334963.517805:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694392960 00000100:00100000:0.0:1763334963.518264:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4497 00000100:00100000:0.0:1763334963.518287:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52998:x1848989694392960:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334963.518310:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.518335:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499f34 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af69d expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.518400:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499f3b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518415:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499f3b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518425:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499f3b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518437:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499f42 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518443:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499f42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518449:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499f42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518504:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499f3b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518511:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499f3b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518517:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499f3b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518523:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.518527:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499f3b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518534:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499f3b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518546:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.518549:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.518554:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499f3b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518559:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499f3b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518593:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499f42 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518600:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499f42 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518605:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499f42 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518610:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.518613:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499f42 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518618:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499f42 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518625:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac94cc600) 00010000:00010000:0.0:1763334963.518627:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.518630:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499f42 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518635:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f8499f42 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.518663:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499f34 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af69d expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.518672:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.518674:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.518678:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f8499f34 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af69d expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.518686:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334963.518742:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52998:x1848989694392960:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 469us (1482us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334963.518749:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4497 00000100:00100000:0.0:1763334963.525035:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.525124:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694393216 00000100:00100000:2.0:1763334963.525134:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694393216 00000100:00100000:2.0:1763334963.525202:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4498 00000100:00100000:2.0:1763334963.525216:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52998:x1848989694393216:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334963.526435:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.526440:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334963.526473:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f8499f2d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af696 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.526492:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334963.526498:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334963.526512:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499f49 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6a4 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.526653:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499f50 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.526666:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499f50 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.526676:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499f50 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.526688:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499f57 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.526694:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499f57 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.526700:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499f57 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.527115:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499f5e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.527124:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499f5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.527131:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499f5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334963.527140:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18d:0x0]: returning size 0 00010000:00010000:2.0:1763334963.527163:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499f50 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.527170:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499f50 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.527176:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499f50 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.527182:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.527186:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499f50 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.527193:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499f50 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.527201:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334963.527203:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.527207:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499f50 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.527213:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499f50 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:2.0:1763334963.527222:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b387ab43 reply state 000000008dc10c29 transno 8589938739 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499f57 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334963.527230:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334963.527254:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499f49 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6a4 expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.527267:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499f5e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6a4 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.527275:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334963.527291:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334963.527294:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:2.0:1763334963.527375:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52998:x1848989694393216:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2163us (2349us total) trans 8589938739 rc 0/0 00000100:00100000:2.0:1763334963.527384:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4498 00010000:00010000:1.0:1763334963.536306:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499f57 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.536336:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499f57 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.536347:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499f57 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.536355:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.536367:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499f57 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334963.536369:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334963.536385:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499f57 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.536412:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334963.536417:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.536423:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499f57 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334963.536430:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f8499f57 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334963.536497:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694393472 00000100:00100000:3.0:1763334963.536510:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694393472 00000100:00100000:3.0:1763334963.536902:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4499 00000100:00100000:3.0:1763334963.536913:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52998:x1848989694393472:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.536938:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.536959:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499f6c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6ab expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.537067:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.537081:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499f5e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6a4 expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.537091:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.537126:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499f5e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6a4 expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.537142:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499f5e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6a4 expref: 181 pid: 29627 timeout: 1128 lvb_type: 0 00000100:00100000:3.0:1763334963.537158:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac721b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701811840:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334963.537326:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0adf00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334963.541274:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.541512:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694393600 00000100:00100000:0.0:1763334963.541529:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694393600 00010000:00010000:0.0:1763334963.541617:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499f5e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6a4 expref: 182 pid: 29627 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334963.541656:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2446 00000100:00100000:0.0:1763334963.541666:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2359:x1848989694393600:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334963.541680:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.541687:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499f5e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6a4 expref: 182 pid: 29627 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.541700:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499f5e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6a4 expref: 182 pid: 29627 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.541722:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:0.0:1763334963.541728:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.541738:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.541745:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.541764:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334963.541818:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2359:x1848989694393600:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 153us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.541826:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2446 00010000:00010000:3.0:1763334963.542358:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499f5e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6a4 expref: 181 pid: 29627 timeout: 1128 lvb_type: 0 00000100:00100000:3.0:1763334963.542374:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac721b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701811840:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334963.542397:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.542405:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.542411:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334963.542428:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18d:0x0]: returning size 0 00000004:00080000:3.0:1763334963.544147:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x226:0x0], index 1: 0 00000004:00080000:3.0:1763334963.544165:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x222:0x0], index 0: 0 00000004:00080000:3.0:1763334963.544171:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x223:0x0], index 0: 0 00000004:00080000:3.0:1763334963.544177:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x227:0x0], index 1: 0 00010000:00010000:3.0:1763334963.546331:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.546348:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.546356:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.546362:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ad8098a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.546366:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.546373:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.546388:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:3.0:1763334963.546391:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334963.546395:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.546401:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499f73 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.546466:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499f6c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6ab expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.546476:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334963.546479:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763334963.546483:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499f6c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6ab expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.546492:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ad8098800, rc 0) 00000100:00100000:3.0:1763334963.546600:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52998:x1848989694393472:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 9661us (10221us total) trans 8589938740 rc 301/301 00000100:00100000:3.0:1763334963.546609:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4499 00000100:00100000:1.0:1763334963.553974:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.554313:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694393856 00000100:00100000:3.0:1763334963.554323:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694393856 00000100:00100000:3.0:1763334963.554385:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1660 00000100:00100000:3.0:1763334963.554395:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52998:x1848989694393856:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334963.554783:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52998:x1848989694393856:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 388us (817us total) trans 8589938741 rc 0/0 00000100:00100000:3.0:1763334963.554791:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1660 00000001:00080000:1.0:1763334963.564375:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838285 is committed 00000001:00080000:1.0:1763334963.564407:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838258 is committed 00000001:00080000:1.0:1763334963.564425:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838287 is committed 00000001:00080000:1.0:1763334963.564430:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838283 is committed 00000001:00080000:1.0:1763334963.564475:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838289 is committed 00002000:00010000:0.0:1763334963.564535:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763334963.564540:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb mtime from disk: 0 -> 1763334964 00002000:00010000:0.0:1763334963.564543:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb ctime from disk: 0 -> 1763334964 00002000:00010000:0.0:1763334963.564546:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1763334963.564563:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.564609:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.564619:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.564627:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334963.564632:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.564643:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.564674:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.564682:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f8499ed9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334963.564799:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+11:2359:x1848989694392064:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 111169us (111490us total) trans 21474838289 rc 0/0 00000100:00100000:0.0:1763334963.564810:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1705 00000100:00100000:0.0:1763334963.567089:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.568404:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694394112 00000100:00100000:3.0:1763334963.568420:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694394112 00000100:00100000:3.0:1763334963.568483:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1661 00000100:00100000:3.0:1763334963.568492:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52998:x1848989694394112:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334963.568779:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52998:x1848989694394112:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 286us (1701us total) trans 8589938742 rc 0/0 00000100:00100000:3.0:1763334963.568787:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1661 00000100:00100000:2.0:1763334963.578542:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.578975:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694394368 00000100:00100000:3.0:1763334963.578988:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694394368 00000100:00100000:0.0:1763334963.579739:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4500 00000100:00100000:0.0:1763334963.579756:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52274:x1848989694394368:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334963.579788:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.579815:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499f81 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6b2 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.580030:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499f88 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580049:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499f88 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580062:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499f88 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580082:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499f8f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580088:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499f8f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580094:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499f8f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580173:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499f96 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580182:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499f96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580189:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499f96 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334963.580200:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18d:0x0]: returning size 0 00010000:00010000:0.0:1763334963.580357:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499f88 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580365:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499f88 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580372:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499f88 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580378:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.580382:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499f88 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580390:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499f88 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580404:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.580407:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.580412:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499f88 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580419:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f8499f88 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580434:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499f8f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580439:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499f8f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580445:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499f8f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580450:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.580453:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499f8f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580459:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499f8f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580465:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac94cc600) 00010000:00010000:0.0:1763334963.580468:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.580471:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499f8f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580475:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499f8f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.580526:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499f81 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6b2 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.580542:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499f96 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6b2 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.580549:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac94ccc00) 00010000:00010000:0.0:1763334963.580552:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334963.580554:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:0.0:1763334963.580689:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52274:x1848989694394368:12345-192.168.201.60@tcp:101:bash.0 Request processed in 937us (2160us total) trans 8589938743 rc 0/0 00000100:00100000:0.0:1763334963.580698:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4500 00000100:00100000:1.0:1763334963.585564:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.585935:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694394624 00000100:00100000:3.0:1763334963.585953:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694394624 00000100:00100000:2.0:1763334963.586083:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4501 00000100:00100000:2.0:1763334963.586094:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52994:x1848989694394624:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334963.586169:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334963.586210:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f8499e8c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18a:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af65e expref: 184 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.586237:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:2.0:1763334963.586242:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334963.586331:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499fa4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.586347:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.586358:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00010000:2.0:1763334963.586599:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005754227a reply state 00000000c8bf28f5 transno 8589938744 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334963.586610:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334963.586733:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52994:x1848989694394624:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 639us (1184us total) trans 8589938744 rc 0/0 00000100:00100000:2.0:1763334963.586740:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4501 00000100:00100000:1.0:1763334963.589860:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.591352:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694394880 00000100:00100000:0.0:1763334963.591373:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694394880 00000100:00100000:0.0:1763334963.591479:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4502 00000100:00100000:0.0:1763334963.591492:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694394880:12345-192.168.201.60@tcp:36:bash.0 00000100:00100000:1.0:1763334963.593710:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.593806:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694395008 00000100:00100000:3.0:1763334963.593820:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694395008 00000100:00100000:3.0:1763334963.593898:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4623 00000100:00100000:3.0:1763334963.593909:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+11:52994:x1848989694395008:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.593933:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.593965:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499fab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6b9 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334963.593999:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x21f:0x0] initial LVB size: 4096, mtime: 0x691a5b34, atime: 0x0, ctime: 0x691a5b34, blocks: 0xb 00010000:00010000:3.0:1763334963.594026:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.594029:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.594038:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499fab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6b9 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.594066:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499fab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6b9 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.594081:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ad8098800, rc 0) 00000100:00100000:3.0:1763334963.594160:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+12:52994:x1848989694395008:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 252us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.594171:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4623 00010000:00010000:2.0:1763334963.594305:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.594316:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499fa4 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.594324:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.594331:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.594336:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.594347:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499fa4 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.594365:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:2.0:1763334963.594369:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.594373:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499fa4 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.594380:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499fa4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334963.595067:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.595097:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f8499f96 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6b2 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.595112:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac94ccc00) 00010000:00010000:0.0:1763334963.595121:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334963.595478:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499fb2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.595494:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.595505:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:0.0:1763334963.595602:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938745 00000004:00010000:0.0:1763334963.595632:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b1154663 reply state 00000000dc08a743 transno 8589938746 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334963.595643:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334963.595760:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694394880:12345-192.168.201.60@tcp:36:bash.0 Request processed in 4269us (5914us total) trans 8589938746 rc 0/0 00000100:00100000:0.0:1763334963.595771:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4502 00000020:00080000:0.0:1763334963.595779:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1763334963.597641:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.597663:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499fb2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.597671:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499fb2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.597678:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.597683:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499fb2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.597691:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499fb2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.597712:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac94cc600) 00010000:00010000:2.0:1763334963.597715:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334963.597720:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499fb2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.597725:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f8499fb2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334963.605709:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.605769:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.605776:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694395136 00000100:00100000:1.0:1763334963.605794:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694395136 00000100:00100000:0.0:1763334963.606351:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694395264 00000100:00100000:0.0:1763334963.606358:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694395264 00000100:00100000:0.0:1763334963.607880:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4503 00000100:00100000:0.0:1763334963.607913:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694395264:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334963.607962:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.608005:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499fb9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6c7 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.608107:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499fb9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c7 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.608129:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499fb9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c7 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.608157:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac51bd200) 00010000:00010000:0.0:1763334963.608161:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334963.608166:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334963.608312:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694395264:12345-192.168.201.60@tcp:101:bash.0 Request processed in 416us (2543us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.608324:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4503 00000100:00100000:1.0:1763334963.608428:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4624 00000100:00100000:1.0:1763334963.608442:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+28:52994:x1848989694395136:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334963.608452:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334963.608466:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499fc0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6c0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.608492:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f8499c63 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a8 expref: 29 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334963.608500:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.608503:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.608508:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499fc0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c0 expref: 29 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.608547:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f8499c63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a8 expref: 29 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334963.608563:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f8499c63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a8 expref: 29 pid: 6517 timeout: 1128 lvb_type: 1 00000100:00100000:1.0:1763334963.608593:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701811968:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334963.608662:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8eec00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334963.612952:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.613083:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694395648 00000100:00100000:0.0:1763334963.613096:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694395648 00000100:00100000:2.0:1763334963.614090:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4504 00000100:00100000:2.0:1763334963.614112:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694395648:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334963.614140:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.614144:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334963.614180:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f8499fb9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c7 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.614212:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac51bd200) 00010000:00010000:2.0:1763334963.614227:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334963.614250:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499fc7 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6ce expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.614340:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499fce lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.614355:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499fce lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334963.614365:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499fce lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000040:00080000:2.0:1763334963.614869:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1049, 88 off90416 00000004:00080000:2.0:1763334963.614879:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1028248306972ns, next at 1029092157246ns, rc = 0 00000040:00080000:2.0:1763334963.614923:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1037, 88 off89304 00000004:00080000:2.0:1763334963.614927:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028248355101ns, next at 1029092096998ns, rc = 0 00000040:00080000:2.0:1763334963.615001:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1038, 88 off89392 00000004:00080000:2.0:1763334963.615005:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028248433386ns, next at 1029092096998ns, rc = 0 00000040:00080000:2.0:1763334963.615024:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1050, 88 off90504 00000004:00080000:2.0:1763334963.615027:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1028248455358ns, next at 1029092157246ns, rc = 0 00000100:00100000:3.0:1763334963.616820:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e14000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701811968:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334963.616867:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499fc0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c0 expref: 29 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.616889:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:0.0:1763334963.618935:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+29:52994:x1848989694395136:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 10480us (13230us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.618952:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4624 00000100:00100000:2.0:1763334963.619084:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.619205:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694395392 00000100:00100000:0.0:1763334963.619216:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694395392 00010000:00010000:0.0:1763334963.619263:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f8499c63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a8 expref: 29 pid: 6517 timeout: 1128 lvb_type: 1 00000100:00100000:0.0:1763334963.619315:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2447 00000100:00100000:0.0:1763334963.619485:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694395392:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334963.619505:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.619533:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f8499c63 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a8 expref: 29 pid: 6517 timeout: 1128 lvb_type: 1 00010000:00010000:0.0:1763334963.619552:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f8499c63 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a8 expref: 29 pid: 6517 timeout: 1128 lvb_type: 1 00010000:00010000:0.0:1763334963.619610:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f8499c63 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5a8 expref: 29 pid: 6517 timeout: 1128 lvb_type: 1 00010000:00010000:0.0:1763334963.619631:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.619633:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.619641:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c0 expref: 28 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.619659:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c0 expref: 28 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.619712:0:5734:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c0 expref: 28 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334963.619732:0:5734:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac37cf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701812096:192.168.201.60@tcp:105: 00000100:00100000:0.0:1763334963.619814:0:5734:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1540 going to sleep for 11 seconds 00000100:00100000:1.0:1763334963.623257:0:5734:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac37cf480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701812096:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334963.623937:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334963.624022:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694395392:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4694us (4936us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334963.624037:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2447 00000100:00100000:2.0:1763334963.628760:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.628809:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.628850:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694395776 00000100:00100000:3.0:1763334963.628867:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694395776 00000100:00100000:0.0:1763334963.628916:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694395904 00000100:00100000:0.0:1763334963.628925:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694395904 00002000:00010000:3.0:1763334963.628932:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/543 (5->18446744073709551615) 00002000:00100000:3.0:1763334963.628939:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af59fa300 with x1848989694395776 ext(5->18446744073709551615) 00002000:00010000:0.0:1763334963.628949:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/547 (0->18446744073709551615) 00002000:00100000:0.0:1763334963.628955:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af59f9180 with x1848989694395904 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334963.628958:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af59fa300. 00002000:00010000:0.0:1763334963.628965:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af59f9180. 00000100:00100000:3.0:1763334963.629756:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1706 00000100:00100000:3.0:1763334963.629774:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694395776:12345-192.168.201.60@tcp:10:lfs.0 00000100:00100000:0.0:1763334963.630867:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1707 00000100:00100000:0.0:1763334963.630888:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694395904:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:0.0:1763334963.631246:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334963.631793:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb mtime from disk: 0 -> 1763334964 00002000:00010000:0.0:1763334963.631800:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334963.631803:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb ctime from disk: 0 -> 1763334964 00002000:00010000:0.0:1763334963.631806:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334963.631910:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694395904:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 1023us (3096us total) trans 17179871007 rc 0/0 00000100:00100000:0.0:1763334963.631925:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1707 00002000:00010000:0.0:1763334963.631934:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/547 (0->18446744073709551615) 00002000:00100000:0.0:1763334963.631941:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af59f9180 with x1848989694395904 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334963.631955:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af59f9180. 00002000:00010000:3.0:1763334963.632119:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763334963.632124:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb mtime from disk: 1763334964 -> 1763334964 00002000:00010000:3.0:1763334963.632126:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334963.632128:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb ctime from disk: 1763334964 -> 1763334964 00002000:00010000:3.0:1763334963.632146:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1763334963.632175:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694395776:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 2407us (3432us total) trans 21474838290 rc 0/0 00000100:00100000:3.0:1763334963.632183:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1706 00002000:00010000:3.0:1763334963.632186:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/543 (5->18446744073709551615) 00002000:00100000:3.0:1763334963.633729:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af59fa300 with x1848989694395776 ext(5->18446744073709551615) 00002000:00010000:3.0:1763334963.633754:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af59fa300. 00000100:00100000:2.0:1763334963.642005:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.642118:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694396160 00000100:00100000:1.0:1763334963.642135:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694396160 00000100:00100000:1.0:1763334963.642227:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4505 00000100:00100000:1.0:1763334963.642241:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52994:x1848989694396160:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334963.642452:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499fd5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.642478:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.642496:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:1.0:1763334963.644757:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000926684c5 reply state 000000002a48b6ea transno 8589938748 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334963.644788:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334963.644984:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52994:x1848989694396160:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 2739us (2988us total) trans 8589938748 rc 0/0 00000100:00100000:1.0:1763334963.644995:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4505 00000100:00100000:0.0:1763334963.650996:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.651434:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694396288 00000100:00100000:3.0:1763334963.651451:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694396288 00000100:00100000:3.0:1763334963.651536:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4625 00000100:00100000:3.0:1763334963.651550:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+29:52994:x1848989694396288:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.651611:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.651640:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499fdc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6d5 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.651682:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8499e93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af665 expref: 30 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334963.651692:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.651695:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.651701:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499fdc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6d5 expref: 30 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.651749:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8499e93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af665 expref: 30 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334963.651767:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8499e93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af665 expref: 30 pid: 32239 timeout: 1128 lvb_type: 1 00000100:00100000:3.0:1763334963.651785:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac721b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701812224:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334963.651925:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0ad000 going to sleep for 11 seconds 00010000:00010000:1.0:1763334963.653203:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499fd5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.653222:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499fd5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.653232:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499fd5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.653240:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.653246:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499fd5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.653254:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499fd5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.653274:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:1.0:1763334963.653290:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.653296:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499fd5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.653303:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f8499fd5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334963.655735:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac721b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701812224:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334963.655749:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.655790:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694396416 00010000:00010000:3.0:1763334963.655796:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499fdc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6d5 expref: 30 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334963.655801:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694396416 00010000:00010000:3.0:1763334963.655835:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ad8098a00, rc 0) 00010000:00010000:1.0:1763334963.655853:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8499e93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af665 expref: 31 pid: 32239 timeout: 1128 lvb_type: 1 00000100:00100000:1.0:1763334963.655898:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2448 00000100:00100000:1.0:1763334963.655910:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2359:x1848989694396416:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763334963.655928:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+31:52994:x1848989694396288:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4380us (4947us total) trans 0 rc 0/0 00010000:00010000:1.0:1763334963.655929:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1763334963.655943:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4625 00010000:00010000:1.0:1763334963.655966:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8499e93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af665 expref: 30 pid: 32239 timeout: 1128 lvb_type: 1 00010000:00010000:1.0:1763334963.655983:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8499e93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af665 expref: 30 pid: 32239 timeout: 1128 lvb_type: 1 00010000:00010000:1.0:1763334963.656018:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f8499e93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af665 expref: 30 pid: 32239 timeout: 1128 lvb_type: 1 00010000:00010000:1.0:1763334963.656035:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.656038:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.656047:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499fdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6d5 expref: 29 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.656059:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499fdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6d5 expref: 29 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.656119:0:5734:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499fdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6d5 expref: 29 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334963.656139:0:5734:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701812352:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334963.656221:0:5734:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee180 going to sleep for 11 seconds 00000100:00100000:3.0:1763334963.661119:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.661156:0:5734:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab30a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701812352:192.168.201.60@tcp:105: 00010000:00010000:0.0:1763334963.661189:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334963.661265:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694396416:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5354us (5519us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.661294:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2448 00000100:00100000:2.0:1763334963.661467:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694396544 00000100:00100000:2.0:1763334963.661477:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694396544 00000100:00100000:2.0:1763334963.661537:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4626 00000100:00100000:2.0:1763334963.661550:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694396544:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334963.661827:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763334963.661831:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb mtime from disk: 1763334963 -> 1763334963 00002000:00010000:2.0:1763334963.661834:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb atime from disk: 1763334963 -> 1763334963 00002000:00010000:2.0:1763334963.661836:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb ctime from disk: 1763334963 -> 1763334964 00002000:00010000:2.0:1763334963.661838:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334963.661868:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694396544:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 322us (766us total) trans 17179871008 rc 0/0 00000100:00100000:2.0:1763334963.661874:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4626 00000100:00100000:3.0:1763334963.664869:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.665383:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694396800 00000100:00100000:1.0:1763334963.665399:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694396800 00000100:00100000:1.0:1763334963.665481:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1662 00000100:00100000:1.0:1763334963.665493:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+189:52994:x1848989694396800:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:1.0:1763334963.665607:0:30956:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x18a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499d82 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af60a expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.665674:0:30956:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334963.665689:0:30956:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499e7e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af657 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.665701:0:30956:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334963.665746:0:30956:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499e7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af657 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.665762:0:30956:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499e7e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af657 expref: 189 pid: 29627 timeout: 1128 lvb_type: 0 00000100:00100000:1.0:1763334963.665779:0:30956:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:30956:1848989701812480:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334963.665898:0:30956:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334963.678254:0:30956:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:30956:1848989701812480:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334963.678305:0:30956:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30956 initiator: MDT0 00000100:00100000:2.0:1763334963.682827:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.682886:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694396928 00000100:00100000:2.0:1763334963.682899:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694396928 00010000:00010000:2.0:1763334963.682958:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499e7e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af657 expref: 190 pid: 29627 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334963.683005:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2449 00000100:00100000:2.0:1763334963.683016:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:2360:x1848989694396928:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334963.683033:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334963.683041:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499e7e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af657 expref: 190 pid: 29627 timeout: 1128 lvb_type: 0 00010000:00010000:2.0:1763334963.683056:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499e7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af657 expref: 190 pid: 29627 timeout: 1128 lvb_type: 0 00010000:00010000:2.0:1763334963.683084:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f8499e7e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af657 expref: 190 pid: 29627 timeout: 1128 lvb_type: 0 00010000:00010000:2.0:1763334963.683110:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:2.0:1763334963.683116:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.683128:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.683136:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.683169:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334963.683232:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2360:x1848989694396928:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 217us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334963.683241:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2449 00010000:00010000:2.0:1763334963.683290:0:30956:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.683300:0:30956:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30956 initiator: MDT0 00000040:00080000:2.0:1763334963.683896:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1051, 88 off90592 00000004:00080000:2.0:1763334963.683908:0:30956:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1028317335872ns, next at 1029092157246ns, rc = 0 00000040:00080000:2.0:1763334963.683969:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1039, 88 off89480 00000004:00080000:2.0:1763334963.683974:0:30956:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028317402348ns, next at 1029092096998ns, rc = 0 00000040:00080000:2.0:1763334963.683997:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1040, 88 off89568 00000004:00080000:2.0:1763334963.684001:0:30956:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028317429170ns, next at 1029092096998ns, rc = 0 00000040:00080000:2.0:1763334963.684015:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1052, 88 off90680 00000004:00080000:2.0:1763334963.684019:0:30956:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1028317447272ns, next at 1029092157246ns, rc = 0 00000001:00080000:2.0:1763334963.689512:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938746 is committed 00000001:00080000:2.0:1763334963.689547:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938747 is committed 00000004:00080000:2.0:1763334963.689554:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 693 committed 00000004:00080000:2.0:1763334963.689566:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 681 committed 00000004:00080000:2.0:1763334963.689593:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 680 committed 00000004:00080000:2.0:1763334963.689595:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 692 committed 00000004:00080000:2.0:1763334963.689606:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 691 committed 00000004:00080000:2.0:1763334963.689608:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 679 committed 00000100:00100000:2.0:1763334963.689848:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701812608:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.689932:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.689981:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763334963.689987:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701812992:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.690003:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.690034:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701812864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.690053:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.690067:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763334963.690071:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701812736:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.690085:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.690117:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701812608 00000100:00100000:2.0:1763334963.690126:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701812608 00000100:00100000:2.0:1763334963.690178:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701812992 00000100:00100000:2.0:1763334963.690182:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701812992 00000100:00100000:2.0:1763334963.690201:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701812864 00000100:00100000:2.0:1763334963.690204:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701812864 00000100:00100000:2.0:1763334963.690219:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701812736 00000100:00100000:2.0:1763334963.690222:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701812736 00000100:00100000:2.0:1763334963.690245:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4627 00000100:00100000:2.0:1763334963.690254:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3290:x1848989701812608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763334963.690303:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:548 count 1 00010000:00010000:2.0:1763334963.690342:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.690371:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af673 expref: 29 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.690380:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334963.690383:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334963.690387:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 4/0,1 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.690419:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af673 expref: 29 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.690434:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af673 expref: 29 pid: 32241 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334963.690446:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701813120:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334963.690522:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb6240 going to sleep for 11 seconds 00000100:00100000:2.0:1763334963.690542:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4628 00000100:00100000:2.0:1763334963.690551:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3290:x1848989701812992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.690849:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3290:x1848989701812992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 298us (843us total) trans 17179871009 rc 0/0 00000100:00100000:2.0:1763334963.690857:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4628 00000100:00100000:2.0:1763334963.690876:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4629 00000100:00100000:2.0:1763334963.690881:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3292:x1848989701812864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.690976:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3292:x1848989701812864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 94us (921us total) trans 17179871010 rc 0/0 00000100:00100000:2.0:1763334963.690986:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4629 00000100:00100000:2.0:1763334963.690996:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4630 00000100:00100000:2.0:1763334963.691002:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3292:x1848989701812736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763334963.691013:0:25383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:549 count 1 00002000:00010000:2.0:1763334963.691039:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x225:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334963.691044:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ff1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.691053:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.691055:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.691060:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.691074:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.691085:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ff1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.691094:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.691114:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334963.691357:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3292:x1848989701812736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 354us (1269us total) trans 17179871011 rc 0/0 00000100:00100000:2.0:1763334963.691364:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4630 00000004:00080000:2.0:1763334963.691440:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5b01f2dc00/2, rc 0, transno 17179871009 00000100:00100000:2.0:1763334963.691454:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701812992:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763334963.691476:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5b01f2d180/2, rc 0, transno 17179871011 00000100:00100000:2.0:1763334963.691480:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701812736:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1763334963.691489:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5b01f2fb80/2, rc 0, transno 17179871010 00000100:00100000:2.0:1763334963.691493:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701812864:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763334963.691509:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334963.691517:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.691525:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334963.691530:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ff1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.691539:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ff1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.691559:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ff1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.691567:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f8499ff1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.691607:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334963.691609:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334963.691611:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334963.691753:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701813632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334963.691788:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.691815:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763334963.691822:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701813248:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334963.691843:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.691868:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701813632 00000100:00100000:2.0:1763334963.691876:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701813632 00000100:00100000:2.0:1763334963.691907:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701813248 00000100:00100000:2.0:1763334963.691910:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701813248 00000100:00100000:2.0:1763334963.691928:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4631 00000100:00100000:2.0:1763334963.691935:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1848989701813632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334963.692128:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3289:x1848989701813632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 192us (338us total) trans 21474838291 rc 0/0 00000100:00100000:2.0:1763334963.692136:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4631 00000100:00100000:2.0:1763334963.692151:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4632 00000100:00100000:2.0:1763334963.692156:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3289:x1848989701813248:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334963.692169:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:544 count 1 00010000:00010000:2.0:1763334963.692186:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.692203:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499e9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af66c expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.692211:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334963.692213:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334963.692216:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.692243:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499e9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af66c expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.692282:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499e9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af66c expref: 12 pid: 32241 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334963.692294:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca872d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701813760:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334963.692341:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334963.692370:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701813504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334963.692403:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.692420:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763334963.692425:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701813376:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334963.692445:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.692465:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701813504 00000100:00100000:2.0:1763334963.692470:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701813504 00000100:00100000:2.0:1763334963.692491:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701813376 00000100:00100000:2.0:1763334963.692493:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701813376 00000100:00100000:2.0:1763334963.692509:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4633 00000100:00100000:2.0:1763334963.692515:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3292:x1848989701813504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334963.692682:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701813504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (277us total) trans 21474838292 rc 0/0 00000100:00100000:2.0:1763334963.692688:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4633 00000100:00100000:2.0:1763334963.692703:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4634 00000100:00100000:2.0:1763334963.692708:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3292:x1848989701813376:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334963.692719:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:545 count 1 00002000:00010000:2.0:1763334963.692741:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x221:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334963.692747:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499fff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.692756:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.692758:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.692762:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499fff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.692773:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499fff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.692782:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499fff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.692790:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499fff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.692813:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334963.693010:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701813376:12345-0@lo:6:osp-syn-0-0.0 Request processed in 302us (564us total) trans 21474838293 rc 0/0 00000100:00100000:2.0:1763334963.693017:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4634 00010000:00010000:2.0:1763334963.693034:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334963.693040:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499fff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.693048:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334963.693051:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499fff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.693059:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499fff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.693073:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499fff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.693079:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f8499fff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.693093:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334963.693095:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334963.693097:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334963.693136:0:3289:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838287 gen 2 00000004:00080000:2.0:1763334963.693141:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c39e7800, transno 21474838233 00000004:00080000:2.0:1763334963.693152:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac721a680, transno 21474838234 00000004:00080000:2.0:1763334963.693166:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d4e00, transno 21474838238 00000004:00080000:2.0:1763334963.693169:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d5180, transno 21474838239 00000004:00080000:2.0:1763334963.693171:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d6680, transno 21474838240 00000004:00080000:2.0:1763334963.693174:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d4a80, transno 21474838241 00000004:00080000:2.0:1763334963.693177:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c4000, transno 21474838242 00000004:00080000:2.0:1763334963.693180:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c5f80, transno 21474838243 00000004:00080000:2.0:1763334963.693183:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab37480, transno 21474838245 00000004:00080000:2.0:1763334963.693186:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fea00, transno 21474838246 00000004:00080000:2.0:1763334963.693189:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81ff800, transno 21474838247 00000004:00080000:2.0:1763334963.693192:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab35f80, transno 21474838248 00000004:00080000:2.0:1763334963.693195:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab34a80, transno 21474838249 00000004:00080000:2.0:1763334963.693197:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab34000, transno 21474838250 00000004:00080000:2.0:1763334963.693200:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f1f80, transno 21474838253 00000004:00080000:2.0:1763334963.693202:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f0000, transno 21474838254 00000004:00080000:2.0:1763334963.693205:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c7800, transno 21474838255 00000004:00080000:2.0:1763334963.693209:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c4700, transno 21474838256 00000004:00080000:2.0:1763334963.693211:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a22680, transno 21474838260 00000004:00080000:2.0:1763334963.693214:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a22300, transno 21474838261 00000004:00080000:2.0:1763334963.693216:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a22d80, transno 21474838262 00000004:00080000:2.0:1763334963.693219:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a23b80, transno 21474838263 00000004:00080000:2.0:1763334963.693221:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab36a00, transno 21474838265 00000004:00080000:2.0:1763334963.693224:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab35c00, transno 21474838266 00000004:00080000:2.0:1763334963.693227:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a80a80, transno 21474838267 00000004:00080000:2.0:1763334963.693230:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeef9d180, transno 21474838268 00000004:00080000:2.0:1763334963.693233:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a81c00, transno 21474838269 00000004:00080000:2.0:1763334963.693235:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a82a00, transno 21474838270 00000004:00080000:2.0:1763334963.693238:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a82d80, transno 21474838271 00000004:00080000:2.0:1763334963.693241:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a80000, transno 21474838272 00000004:00080000:2.0:1763334963.693244:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c6d80, transno 21474838274 00000004:00080000:2.0:1763334963.693246:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c7480, transno 21474838275 00000004:00080000:2.0:1763334963.693249:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c6a00, transno 21474838276 00000004:00080000:2.0:1763334963.693252:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f3480, transno 21474838277 00000004:00080000:2.0:1763334963.693255:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeec5b100, transno 21474838279 00000004:00080000:2.0:1763334963.693259:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeec5bb80, transno 21474838280 00000004:00080000:2.0:1763334963.693261:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac8419c00, transno 21474838281 00000004:00080000:2.0:1763334963.693264:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac8418380, transno 21474838282 00000004:00080000:2.0:1763334963.693267:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee93ca80, transno 21474838284 00000004:00080000:2.0:1763334963.693270:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c39e6d80, transno 21474838285 00000004:00080000:2.0:1763334963.693272:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5574380, transno 21474838286 00000004:00080000:2.0:1763334963.693289:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5576680, transno 21474838287 00000100:00100000:2.0:1763334963.693297:0:3289:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a59ca871180 x1848989701813632/t21474838291(21474838291) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334979 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763334963.693308:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca871180/2, rc 0, transno 21474838291 00000100:00100000:2.0:1763334963.693314:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701813632:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334963.693337:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca872a00/2, rc 0, transno 21474838293 00000100:00100000:2.0:1763334963.693340:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701813376:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763334963.693350:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca871880/2, rc 0, transno 21474838292 00000100:00100000:2.0:1763334963.693354:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701813504:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334963.693729:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 4 in progress, 1 in flight, 42 done 00010000:00010000:2.0:1763334963.694117:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499fce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6ce expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.694132:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac6cabd00) 00010000:00010000:2.0:1763334963.694135:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334963.694154:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f8499fc7 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6ce expref: 178 pid: 29627 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763334963.694172:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499fce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18d:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6ce expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.694211:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac6cabd00) 00010000:00010000:2.0:1763334963.694214:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334963.694216:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:2.0:1763334963.694271:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52274:x1848989694395648:12345-192.168.201.60@tcp:101:bash.0 Request processed in 80167us (81335us total) trans 8589938747 rc 0/0 00000100:00100000:2.0:1763334963.694292:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4504 00000100:00100000:0.0:1763334963.710728:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701813120:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334963.710783:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334963.711456:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca872d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701813760:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334963.711481:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334963.711622:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.712755:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.712780:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694397056 00000100:00100000:1.0:1763334963.712794:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694397056 00010000:00010000:1.0:1763334963.712851:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499e9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af66c expref: 13 pid: 32241 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334963.713160:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694397184 00000100:00100000:0.0:1763334963.713165:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694397184 00000100:00100000:1.0:1763334963.713357:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2450 00000100:00100000:1.0:1763334963.713370:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2359:x1848989694397056:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334963.713393:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334963.713400:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499e9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af66c expref: 13 pid: 32241 timeout: 1128 lvb_type: 0 00010000:00010000:1.0:1763334963.713415:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499e9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af66c expref: 13 pid: 32241 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334963.713440:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334963.713444:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168e200/0xcedf0054f8499e9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af66c expref: 13 pid: 32241 timeout: 1128 lvb_type: 0 00010000:00010000:1.0:1763334963.713465:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.713467:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.713473:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.713485:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.713516:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334963.713595:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694397312 00000100:00100000:1.0:1763334963.713596:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2359:x1848989694397056:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 228us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.713601:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694397312 00000100:00100000:1.0:1763334963.713604:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2450 00000100:00100000:3.0:1763334963.713632:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4635 00010000:00010000:1.0:1763334963.713634:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334963.713640:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+31:52274:x1848989694397312:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334963.713644:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.713654:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.713658:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334963.713663:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.713682:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099800/0xcedf0054f849a006 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6dc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.713682:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1763334963.713713:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x226:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334963.713733:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.713735:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.713743:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099800/0xcedf0054f849a006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6dc expref: 32 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.713758:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099800/0xcedf0054f849a006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6dc expref: 32 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.713770:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ad8099800, rc 0) 00000100:00100000:3.0:1763334963.713795:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+32:52274:x1848989694397312:12345-192.168.201.60@tcp:101:bash.0 Request processed in 156us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.713804:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4635 00000100:00100000:1.0:1763334963.714039:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701813248:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21881us (22193us total) trans 21474838294 rc 0/0 00000100:00100000:1.0:1763334963.714047:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4632 00010000:00010000:1.0:1763334963.714069:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334963.714076:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.714084:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334963.714088:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.714097:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.714110:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.714117:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f8499ff8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.714265:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.714267:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.714269:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763334963.714394:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca873800/2, rc 0, transno 21474838294 00000100:00100000:1.0:1763334963.714410:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701813248:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763334963.714710:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af673 expref: 31 pid: 32241 timeout: 1128 lvb_type: 0 00000100:00100000:1.0:1763334963.714741:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2451 00000100:00100000:1.0:1763334963.714749:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2359:x1848989694397184:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334963.714762:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334963.714766:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ea1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af673 expref: 31 pid: 32241 timeout: 1128 lvb_type: 0 00010000:00010000:1.0:1763334963.714777:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af673 expref: 31 pid: 32241 timeout: 1128 lvb_type: 0 00010000:00010000:1.0:1763334963.714796:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f8499ea1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af673 expref: 31 pid: 32241 timeout: 1128 lvb_type: 0 00010000:00010000:1.0:1763334963.714813:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.714815:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.714820:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.714828:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.714850:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334963.714876:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694397184:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 128us (2126us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334963.714883:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2451 00010000:00010000:1.0:1763334963.714907:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.714915:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.714924:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.714932:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.714948:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334963.716678:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3290:x1848989701812608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 26417us (26738us total) trans 17179871012 rc 0/0 00000100:00100000:1.0:1763334963.716697:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4627 00010000:00010000:1.0:1763334963.716741:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334963.716750:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.716762:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334963.716767:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.716776:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.716797:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.716806:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f8499fea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.716825:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.716827:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.716829:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763334963.717346:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5b01f2e300/2, rc 0, transno 17179871012 00000100:00100000:3.0:1763334963.717419:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.717485:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694397440 00000100:00100000:0.0:1763334963.717496:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694397440 00000100:00100000:0.0:1763334963.717559:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4636 00000100:00100000:0.0:1763334963.717590:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+12:52274:x1848989694397440:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334963.717612:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.717641:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a00d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6e3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334963.717866:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701812608:0@lo:6:osp-syn-1-0.0 00002000:00010000:0.0:1763334963.719021:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x222:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334963.719061:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.719064:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.719079:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a00d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6e3 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.719102:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a00d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6e3 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.719117:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334963.719783:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+13:52274:x1848989694397440:12345-192.168.201.60@tcp:101:bash.0 Request processed in 2209us (2362us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.719796:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4636 00000100:00100000:2.0:1763334963.722994:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.723464:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.723804:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694397568 00000100:00100000:1.0:1763334963.723818:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694397568 00002000:00010000:1.0:1763334963.723874:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/550 (0->18446744073709551615) 00002000:00100000:1.0:1763334963.723879:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5fb800 with x1848989694397568 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334963.723895:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa5fb800. 00000100:00100000:3.0:1763334963.723954:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694397696 00000100:00100000:3.0:1763334963.723959:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694397696 00002000:00010000:3.0:1763334963.723977:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/546 (0->18446744073709551615) 00002000:00100000:3.0:1763334963.723981:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5faa00 with x1848989694397696 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334963.723989:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa5faa00. 00000100:00100000:1.0:1763334963.724104:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1708 00000100:00100000:2.0:1763334963.724174:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1709 00000100:00100000:2.0:1763334963.724185:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694397696:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334963.724818:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x222:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334963.724823:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x222:0x0] updating lvb mtime from disk: 0 -> 1763334964 00002000:00010000:2.0:1763334963.724826:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x222:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334963.724828:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x222:0x0] updating lvb ctime from disk: 0 -> 1763334964 00002000:00010000:2.0:1763334963.724830:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x222:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334963.724920:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694397696:12345-192.168.201.60@tcp:10:bash.0 Request processed in 734us (1454us total) trans 21474838295 rc 0/0 00000100:00100000:1.0:1763334963.724928:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694397568:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:2.0:1763334963.724929:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1709 00002000:00010000:2.0:1763334963.724934:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/546 (0->18446744073709551615) 00002000:00100000:2.0:1763334963.724937:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5faa00 with x1848989694397696 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334963.724943:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa5faa00. 00002000:00010000:1.0:1763334963.725130:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334963.725503:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb mtime from disk: 0 -> 1763334964 00002000:00010000:1.0:1763334963.725505:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334963.725507:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb ctime from disk: 0 -> 1763334964 00002000:00010000:1.0:1763334963.725509:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x226:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334963.725541:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2359:x1848989694397568:12345-192.168.201.60@tcp:10:bash.0 Request processed in 1425us (2559us total) trans 17179871013 rc 0/0 00000100:00100000:1.0:1763334963.725756:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1708 00002000:00010000:1.0:1763334963.725761:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/550 (0->18446744073709551615) 00002000:00100000:1.0:1763334963.725763:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5fb800 with x1848989694397568 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334963.725769:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa5fb800. 00000100:00100000:1.0:1763334963.731026:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.731148:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694397952 00000100:00100000:2.0:1763334963.731162:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694397952 00000100:00100000:2.0:1763334963.731267:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1663 00000100:00100000:2.0:1763334963.731292:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52274:x1848989694397952:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:2.0:1763334963.731861:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52274:x1848989694397952:12345-192.168.201.60@tcp:35:bash.0 Request processed in 579us (846us total) trans 8589938750 rc 0/0 00000100:00100000:2.0:1763334963.731872:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1663 00000100:00100000:3.0:1763334963.738462:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.738515:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694398080 00000100:00100000:3.0:1763334963.738529:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694398080 00000100:00100000:3.0:1763334963.738613:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4506 00000100:00100000:3.0:1763334963.738625:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52999:x1848989694398080:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:3.0:1763334963.738654:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.738684:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a014 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6ea expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.738776:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f849a01b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.738793:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f849a01b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.738806:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f849a01b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.738820:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099600/0xcedf0054f849a022 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.738827:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099600/0xcedf0054f849a022 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.738835:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099600/0xcedf0054f849a022 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.738964:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a029 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.738972:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a029 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.738979:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a029 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334963.739019:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18d:0x0]: returning size 5 00000004:00200000:3.0:1763334963.739023:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334963.739043:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a029 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739055:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a029 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739065:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f849a01b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739072:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f849a01b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739079:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f849a01b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739085:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ad8098e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.739089:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f849a01b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739097:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f849a01b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739113:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334963.739116:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.739122:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f849a01b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739129:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8098e00/0xcedf0054f849a01b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739141:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099600/0xcedf0054f849a022 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739146:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099600/0xcedf0054f849a022 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739152:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099600/0xcedf0054f849a022 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739157:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ad8099600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.739159:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099600/0xcedf0054f849a022 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739164:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099600/0xcedf0054f849a022 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739170:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4800) 00010000:00010000:3.0:1763334963.739172:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.739174:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099600/0xcedf0054f849a022 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739179:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099600/0xcedf0054f849a022 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334963.739208:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a014 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6ea expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.739222:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a029 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6ea expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.739230:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac6cabd00) 00010000:00010000:3.0:1763334963.739232:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334963.739235:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fe00, rc 0) 00000100:00100000:3.0:1763334963.739323:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52999:x1848989694398080:12345-192.168.201.60@tcp:101:rm.0 Request processed in 700us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.739330:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4506 00000100:00100000:2.0:1763334963.743248:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.743567:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694398336 00000100:00100000:3.0:1763334963.743619:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694398336 00000100:00100000:3.0:1763334963.743687:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4507 00000100:00100000:3.0:1763334963.743698:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52999:x1848989694398336:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:3.0:1763334963.743780:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1763334963.743814:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a029 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6ea expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.743837:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f8499fce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6ce expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.743848:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac6cabd00) 00010000:00010000:3.0:1763334963.743860:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334963.743889:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a030 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.743906:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a030 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.743922:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a030 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.743935:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a037 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.743941:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a037 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.743947:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a037 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.744107:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a03e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.744115:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a03e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.744122:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a03e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:3.0:1763334963.746482:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1053, 64 off90744 00000040:00080000:3.0:1763334963.746533:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1041, 64 off89632 00000040:00080000:3.0:1763334963.746549:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1042, 64 off89696 00000040:00080000:3.0:1763334963.746562:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1054, 64 off90808 00010000:00010000:3.0:1763334963.746701:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a045 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.746724:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a045 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.746738:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a045 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.746753:0:30972:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a045 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.746760:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a045 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.746766:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a045 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.746794:0:30972:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763334963.746826:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a03e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.746829:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334963.746832:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a03e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.746838:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a03e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.746838:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a045 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.746845:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168ee00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.746845:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0030e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334963.746850:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a03e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.746850:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a045 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.746859:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a03e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.746859:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a045 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 30972 initiator: MDT0 00000004:00010000:2.0:1763334963.747035:0:30956:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d404f13c reply state 0000000017b0e892 transno 8589938749 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30956 initiator: MDT0 00000100:00100000:2.0:1763334963.747048:0:30956:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334963.747058:0:30956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:2.0:1763334963.747062:0:30956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334963.747073:0:30956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f8499d82 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af60a expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334963.747228:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52994:x1848989694396800:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 81736us (82374us total) trans 8589938749 rc 0/0 00000100:00100000:2.0:1763334963.747242:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1662 00000001:00080000:2.0:1763334963.747300:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938748 is committed 00000001:00080000:2.0:1763334963.747324:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938749 is committed 00000004:00080000:2.0:1763334963.747330:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 695 committed 00000004:00080000:2.0:1763334963.747341:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 683 committed 00000004:00080000:2.0:1763334963.747350:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 682 committed 00000004:00080000:2.0:1763334963.747352:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 694 committed 00010000:00010000:2.0:1763334963.747370:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.747378:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.747383:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.747389:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334963.747391:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.747397:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.747406:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:2.0:1763334963.747409:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334963.747412:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.747419:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f8499fe3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30956 initiator: MDT0 00000100:00100000:2.0:1763334963.747562:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763334963.747599:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701814016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.747659:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.747709:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701814016 00000100:00100000:2.0:1763334963.747718:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701814016 00000100:00100000:2.0:1763334963.747760:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4637 00000100:00100000:2.0:1763334963.747768:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+33:3292:x1848989701814016:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763334963.747964:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334963.747968:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb mtime from disk: 1763334964 -> 1763334964 00002000:00010000:2.0:1763334963.747971:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334963.747973:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb ctime from disk: 1763334964 -> 1763334964 00002000:00010000:2.0:1763334963.747975:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x223:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334963.748003:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3292:x1848989701814016:12345-0@lo:2:osp-syn-1-0.0 Request processed in 235us (344us total) trans 17179871014 rc 0/0 00000100:00100000:2.0:1763334963.748009:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4637 00000100:00100000:2.0:1763334963.748078:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701814272:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334963.748101:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.748116:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763334963.748121:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701813888:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.748137:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.748161:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac721a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701814144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334963.748182:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763334963.748221:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa5fb100/2, rc 0, transno 17179871014 00000100:00100000:2.0:1763334963.748231:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701814016:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.748254:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701814272 00000100:00100000:2.0:1763334963.748257:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701814272 00000100:00100000:2.0:1763334963.748293:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701813888 00000100:00100000:2.0:1763334963.748297:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701813888 00000100:00100000:2.0:1763334963.748313:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701814144 00000100:00100000:2.0:1763334963.748316:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701814144 00000100:00100000:2.0:1763334963.748333:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4638 00000100:00100000:2.0:1763334963.748341:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701814272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334963.748459:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763334963.748462:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb mtime from disk: 1763334964 -> 1763334964 00002000:00010000:2.0:1763334963.748465:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334963.748466:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb ctime from disk: 1763334964 -> 1763334964 00002000:00010000:2.0:1763334963.748469:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x21f:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1763334963.748499:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701814272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (396us total) trans 21474838296 rc 0/0 00000100:00100000:2.0:1763334963.748505:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4638 00000100:00100000:2.0:1763334963.748519:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4639 00000100:00100000:2.0:1763334963.748525:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+34:3289:x1848989701813888:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763334963.748633:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763334963.748636:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb mtime from disk: 1763334963 -> 1763334963 00002000:00010000:2.0:1763334963.748638:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb atime from disk: 1763334963 -> 1763334963 00002000:00010000:2.0:1763334963.748640:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb ctime from disk: 1763334964 -> 1763334964 00002000:00010000:2.0:1763334963.748642:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x222:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334963.748666:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+35:3289:x1848989701813888:12345-0@lo:2:osp-syn-1-0.0 Request processed in 142us (528us total) trans 17179871015 rc 0/0 00000100:00100000:2.0:1763334963.748672:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4639 00000100:00100000:2.0:1763334963.748685:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4640 00000100:00100000:2.0:1763334963.748691:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701814144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334963.748797:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334963.748800:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb mtime from disk: 1763334963 -> 1763334963 00002000:00010000:2.0:1763334963.748802:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334963.748803:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb ctime from disk: 1763334963 -> 1763334963 00002000:00010000:2.0:1763334963.748806:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x21e:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:2.0:1763334963.748834:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701814144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (650us total) trans 21474838297 rc 0/0 00000100:00100000:2.0:1763334963.748840:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4640 00000004:00080000:2.0:1763334963.748880:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa5f9880/2, rc 0, transno 17179871015 00000100:00100000:2.0:1763334963.748890:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701813888:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763334963.748902:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d4e00/2, rc 0, transno 21474838296 00000100:00100000:2.0:1763334963.748910:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701814272:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334963.748933:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac721a680/2, rc 0, transno 21474838297 00000100:00100000:2.0:1763334963.748940:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac721a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701814144:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1763334963.750523:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac81faa00) 00010000:00010000:3.0:1763334963.750534:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763334963.750549:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a03e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.750561:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a03e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.750694:0:5737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18d:0x0].0x0 (ffff9a5ac81faa00) 00010000:00010000:1.0:1763334963.750700:0:5737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763334963.750705:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a045 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.750712:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a045 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.750738:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.750741:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.750744:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334963.751458:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a030 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.751467:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a030 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.751475:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a030 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.751482:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.751486:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a030 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.751493:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a030 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.751510:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334963.751512:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.751516:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a030 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.751521:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a030 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:3.0:1763334963.751532:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dab84aa8 reply state 00000000bc6f0beb transno 8589938751 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a037 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334963.751542:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334963.752368:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52999:x1848989694398336:12345-192.168.201.60@tcp:36:rm.0 Request processed in 8662us (9126us total) trans 8589938751 rc 0/0 00000100:00100000:3.0:1763334963.752382:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4507 00010000:00010000:0.0:1763334963.757389:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a037 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.757412:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a037 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.757419:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a037 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.757426:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168f600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.757431:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a037 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.757439:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a037 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.757459:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334963.757463:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.757469:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a037 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.757478:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a037 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334963.757565:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.757847:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694398464 00000100:00100000:3.0:1763334963.757861:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694398464 00000100:00100000:3.0:1763334963.757928:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4508 00000100:00100000:3.0:1763334963.757940:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+174:52994:x1848989694398464:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.757971:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.757994:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f849a04c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6f1 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.758072:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f849a04c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6f1 expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.758087:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031800/0xcedf0054f849a04c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6f1 expref: 175 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.758107:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00010000:00010000:3.0:1763334963.758110:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334963.758113:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0031800, rc 0) 00000100:00100000:3.0:1763334963.758632:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52994:x1848989694398464:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 690us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.758641:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4508 00000100:00100000:1.0:1763334963.765699:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.765989:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694398720 00000100:00100000:2.0:1763334963.766005:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694398720 00000100:00100000:2.0:1763334963.766092:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1664 00000100:00100000:2.0:1763334963.766106:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+175:52994:x1848989694398720:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:2.0:1763334963.767056:0:30956:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x18a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763334963.767401:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1055, 64 off90872 00000040:00080000:2.0:1763334963.767438:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1043, 64 off89760 00000040:00080000:2.0:1763334963.767454:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1044, 64 off89824 00000040:00080000:2.0:1763334963.767468:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1056, 64 off90936 00000100:00100000:3.0:1763334963.767504:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334963.767602:0:30956:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a053 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.767626:0:30956:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a053 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.767641:0:30956:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a053 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.767653:0:30956:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a053 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 30956 initiator: MDT0 00010000:00010000:2.0:1763334963.767661:0:30956:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a053 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 30956 initiator: MDT0 00000100:00100000:0.0:1763334963.767667:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694398848 00010000:00010000:2.0:1763334963.767668:0:30956:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a053 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 30956 initiator: MDT0 00000100:00100000:0.0:1763334963.767680:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694398848 00010000:00010000:2.0:1763334963.767695:0:30956:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334963.767743:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4509 00000100:00100000:0.0:1763334963.767756:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:53000:x1848989694398848:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334963.767777:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.767795:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a05a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6f8 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.767840:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334963.767849:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a053 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 30956 initiator: MDT0 00010000:00010000:3.0:1763334963.767857:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334963.767861:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a053 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 30956 initiator: MDT0 00010000:00010000:3.0:1763334963.767870:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a053 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 30956 initiator: MDT0 00010000:00010000:0.0:1763334963.767880:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a061 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.767887:0:5736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18a:0x0].0x0 (ffff9a5acbb5e800) 00000100:00100000:2.0:1763334963.767891:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52994:x1848989694398720:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1787us (2207us total) trans 8589938752 rc 0/0 00010000:00010000:3.0:1763334963.767892:0:5736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763334963.767894:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a061 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.767899:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a053 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 30956 initiator: MDT0 00000100:00100000:2.0:1763334963.767903:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1664 00010000:00010000:3.0:1763334963.767908:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a053 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 30956 initiator: MDT0 00010000:00010000:0.0:1763334963.767911:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a061 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.767919:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334963.767923:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334963.767925:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334963.767931:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a068 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.767939:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a068 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.767947:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a068 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768012:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a061 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768023:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a061 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768030:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a061 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768036:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.768040:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a061 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768047:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a061 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768056:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.768059:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.768063:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a061 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768069:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a061 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768078:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a068 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768084:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a068 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768090:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a068 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768095:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.768098:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a068 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768107:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a068 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768114:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334963.768116:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.768119:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a068 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768125:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a068 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.768156:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a05a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6f8 expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.768167:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.768170:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.768174:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a05a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6f8 expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.768184:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:0.0:1763334963.768226:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+176:53000:x1848989694398848:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 474us (727us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334963.768234:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4509 00000100:00100000:3.0:1763334963.770384:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.770437:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694399104 00000100:00100000:0.0:1763334963.770450:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694399104 00000100:00100000:0.0:1763334963.771002:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4510 00000100:00100000:0.0:1763334963.771016:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52994:x1848989694399104:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334963.771047:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.771073:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a06f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af6ff expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.771181:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a076 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771197:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a076 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771210:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a076 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771224:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a07d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771231:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a07d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771238:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a07d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771335:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a076 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771344:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a076 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771352:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a076 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771358:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.771362:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a076 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771370:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a076 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771384:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.771387:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.771401:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a076 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771408:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a076 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771420:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a07d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771426:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a07d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771431:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a07d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771436:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.771438:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a07d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771444:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a07d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771451:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd200) 00010000:00010000:0.0:1763334963.771454:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.771457:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a07d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771462:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a07d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.771499:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a06f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6ff expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.771510:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.771513:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334963.771516:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a06f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6ff expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.771526:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:0.0:1763334963.771633:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52994:x1848989694399104:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 620us (1261us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334963.771642:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4510 00000100:00100000:1.0:1763334963.774707:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.774814:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694399232 00000100:00100000:3.0:1763334963.774828:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694399232 00000100:00100000:3.0:1763334963.774903:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4511 00000100:00100000:3.0:1763334963.774916:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+176:53000:x1848989694399232:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.774945:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.774973:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a084 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af706 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.775076:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a08b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775094:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a08b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775106:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a08b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775121:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a092 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775132:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a092 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775138:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a092 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775221:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a08b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775228:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a08b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775234:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a08b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775241:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0031600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.775246:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a08b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775270:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a08b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775293:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334963.775297:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.775304:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a08b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775310:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a08b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775328:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a092 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775334:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a092 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775342:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a092 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775347:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0030e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.775351:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a092 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775357:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a092 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775367:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac81faa00) 00010000:00010000:3.0:1763334963.775370:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.775373:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a092 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775379:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a092 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.775420:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a084 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af706 expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.775433:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334963.775436:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.775440:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a084 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af706 expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.775451:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0031000, rc 0) 00000100:00100000:2.0:1763334963.775955:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+176:53000:x1848989694399232:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1037us (1259us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334963.775968:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4511 00000100:00100000:2.0:1763334963.783805:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.783869:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694399360 00000100:00100000:0.0:1763334963.783888:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694399360 00000100:00100000:0.0:1763334963.783970:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4512 00000100:00100000:0.0:1763334963.783983:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+176:53000:x1848989694399360:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334963.784010:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.784037:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a099 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af70d expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.784137:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a0a0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.784154:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.784168:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334963.784244:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:0.0:1763334963.784249:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334963.784286:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a0a0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.784318:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a099 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af70d expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.784342:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a0a0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af70d expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.784352:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.784356:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763334963.784361:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334963.784448:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:53000:x1848989694399360:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 468us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.784457:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4512 00000100:00100000:3.0:1763334963.785826:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.786047:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694399616 00000100:00100000:0.0:1763334963.786059:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694399616 00000100:00100000:0.0:1763334963.786132:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4513 00000100:00100000:0.0:1763334963.786143:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:53001:x1848989694399616:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334963.786165:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.786189:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a0a7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af714 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.786301:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ae lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786317:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ae lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786329:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ae lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786348:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0b5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786354:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786360:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786441:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ae lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786449:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ae lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786456:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ae lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786462:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.786466:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ae lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786474:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ae lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786487:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.786490:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.786495:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ae lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786501:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786514:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786521:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0b5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786527:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786532:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.786534:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786540:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0b5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786546:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd200) 00010000:00010000:0.0:1763334963.786549:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.786552:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0b5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786558:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0b5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.786648:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a0a7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af714 expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.786659:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.786662:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334963.786666:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a0a7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af714 expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.786935:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334963.787155:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:53001:x1848989694399616:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1012us (1338us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334963.787165:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4513 00000100:00100000:1.0:1763334963.797903:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.803646:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694399872 00000100:00100000:0.0:1763334963.803671:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694399872 00000100:00100000:0.0:1763334963.803770:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4514 00000100:00100000:0.0:1763334963.803785:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:53000:x1848989694399872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334963.803814:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.803818:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334963.803856:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a0a0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af70d expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.803880:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.803887:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334963.803904:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a0bc lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af71b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.804104:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0c3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.804124:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0c3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.804137:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0c3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.804156:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ca lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.804163:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.804170:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.804987:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a0d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.804999:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.805007:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a0d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334963.805019:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 0 00010000:00010000:0.0:1763334963.805058:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0c3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.805067:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0c3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.805074:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0c3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.805081:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.805086:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0c3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.805095:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0c3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.805105:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334963.805108:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.805113:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0c3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.805119:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a0c3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334963.805135:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000829013fd reply state 00000000a31b2097 transno 8589938753 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334963.805145:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763334963.805181:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a0bc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af71b expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.809154:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a0d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af71b expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.809176:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334963.809183:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334963.809188:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:1.0:1763334963.809522:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53000:x1848989694399872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5736us (11629us total) trans 8589938753 rc 0/0 00000100:00100000:1.0:1763334963.809533:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4514 00010000:00010000:1.0:1763334963.810936:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.810954:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ca lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.810963:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.810970:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.810976:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.810985:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ca lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.811006:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd200) 00010000:00010000:1.0:1763334963.811009:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.811014:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ca lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.811021:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a0ca lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334963.814373:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.814417:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.814510:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694400384 00000100:00100000:2.0:1763334963.814525:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694400384 00000100:00100000:2.0:1763334963.814614:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694400128 00000100:00100000:2.0:1763334963.814618:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694400128 00000100:00100000:2.0:1763334963.814646:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4515 00000100:00100000:2.0:1763334963.814658:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53002:x1848989694400384:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334963.814689:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.814718:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a0df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af729 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.814858:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a0e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.814876:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.814888:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a0e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334963.814900:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 0 00010000:00010000:2.0:1763334963.815064:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a0df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af729 expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.815086:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af729 expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.815097:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:2.0:1763334963.815100:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334963.815105:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:2.0:1763334963.815180:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53002:x1848989694400384:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 524us (820us total) trans 8589938754 rc 0/0 00000100:00100000:2.0:1763334963.815188:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4515 00000100:00100000:2.0:1763334963.815212:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4516 00000100:00100000:2.0:1763334963.815219:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53000:x1848989694400128:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334963.815229:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.815238:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a0f4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af722 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.815293:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.815305:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a0d1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af71b expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.815313:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a0e6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af729 expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.815321:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 5/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.815358:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a0e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af729 expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.815371:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a0e6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af729 expref: 181 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334963.815385:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701814400:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334963.815450:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a0d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af71b expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.815457:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a0d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af71b expref: 181 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334963.815465:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701814528:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334963.815486:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb6840 going to sleep for 11 seconds 00000100:00100000:2.0:1763334963.822837:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.822883:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.822931:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694400640 00000100:00100000:0.0:1763334963.822944:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694400768 00000100:00100000:3.0:1763334963.822947:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694400640 00000100:00100000:2.0:1763334963.822948:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.822950:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694400768 00000100:00100000:2.0:1763334963.822984:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694400896 00000100:00100000:2.0:1763334963.822988:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694400896 00010000:00010000:2.0:1763334963.823013:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a0d1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af71b expref: 184 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.823013:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a0e6 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af729 expref: 184 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:3.0:1763334963.823028:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1665 00000100:00100000:3.0:1763334963.823041:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53002:x1848989694400640:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334963.823052:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2452 00000100:00100000:0.0:1763334963.823061:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2359:x1848989694400768:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334963.823086:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.823094:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a0e6 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af729 expref: 184 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.823111:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a0e6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af729 expref: 184 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.823143:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334963.823150:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.823162:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334963.823238:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88ee850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2359:x1848989694400768:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 177us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.823246:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2452 00000100:00100000:0.0:1763334963.823325:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2453 00000100:00100000:0.0:1763334963.823332:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2359:x1848989694400896:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334963.823342:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.823346:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a0d1 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af71b expref: 184 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.823356:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a0d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af71b expref: 184 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.823370:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334963.823374:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.823384:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.823394:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.823421:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334963.823445:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53002:x1848989694400640:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 406us (629us total) trans 8589938755 rc 0/0 00000100:00100000:0.0:1763334963.823451:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2359:x1848989694400896:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 117us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.823459:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1665 00000100:00100000:0.0:1763334963.823465:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2453 00010000:00010000:1.0:1763334963.824350:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a0e6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af729 expref: 182 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:1.0:1763334963.824373:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701814400:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334963.824388:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a0d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af71b expref: 181 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:1.0:1763334963.824399:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701814528:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334963.824431:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.824441:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.824446:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334963.824466:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 0 00000004:00080000:1.0:1763334963.824882:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x224:0x0], index 0: 0 00000004:00080000:1.0:1763334963.824893:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x228:0x0], index 1: 0 00000004:00080000:1.0:1763334963.824914:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x229:0x0], index 1: 0 00000004:00080000:1.0:1763334963.824919:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x225:0x0], index 0: 0 00010000:00010000:1.0:1763334963.825094:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.825103:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.825111:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.825117:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.825121:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.825129:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.825144:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:1.0:1763334963.825147:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334963.825151:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.825157:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a0fb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.825233:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a0f4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af722 expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.825244:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334963.825247:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334963.825252:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a0f4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af722 expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.825261:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067a00, rc 0) 00000100:00100000:1.0:1763334963.825369:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53000:x1848989694400128:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 10148us (10948us total) trans 8589938756 rc 301/301 00000100:00100000:1.0:1763334963.825379:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4516 00000100:00100000:2.0:1763334963.833702:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.833924:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694401152 00000100:00100000:3.0:1763334963.833939:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694401152 00000100:00100000:3.0:1763334963.834018:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1666 00000100:00100000:3.0:1763334963.834030:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af60e6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53000:x1848989694401152:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334963.834687:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af60e6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53000:x1848989694401152:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 655us (998us total) trans 8589938757 rc 0/0 00000100:00100000:3.0:1763334963.834699:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1666 00000100:00100000:0.0:1763334963.836271:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.837022:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694401408 00000100:00100000:1.0:1763334963.837044:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694401408 00000100:00100000:1.0:1763334963.837685:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4517 00000100:00100000:1.0:1763334963.837704:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53002:x1848989694401408:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334963.837738:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334963.837769:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a109 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af730 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.837874:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a110 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.837893:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a110 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.837907:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a110 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.837924:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a117 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.837931:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a117 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.837937:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a117 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838117:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a11e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838125:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a11e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838133:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a11e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334963.838145:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 0 00010000:00010000:1.0:1763334963.838384:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a110 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838393:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a110 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838400:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a110 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838406:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.838411:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a110 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838418:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a110 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838432:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334963.838435:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.838440:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a110 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838446:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a110 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838460:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a117 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838465:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a117 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838475:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a117 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838480:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.838483:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a117 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838488:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a117 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838494:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa300) 00010000:00010000:1.0:1763334963.838496:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.838498:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a117 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838503:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a117 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.838551:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a109 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af730 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.838567:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a11e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af730 expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.838593:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:1.0:1763334963.838595:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334963.838598:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334963.838683:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53002:x1848989694401408:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 986us (2422us total) trans 8589938758 rc 0/0 00000100:00100000:1.0:1763334963.838692:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4517 00000100:00100000:1.0:1763334963.839569:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.839719:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694401664 00000100:00100000:3.0:1763334963.839732:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694401664 00000100:00100000:3.0:1763334963.839834:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1667 00000100:00100000:3.0:1763334963.839846:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53000:x1848989694401664:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334963.840114:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53000:x1848989694401664:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 270us (549us total) trans 8589938759 rc 0/0 00000100:00100000:3.0:1763334963.840122:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1667 00000100:00100000:3.0:1763334963.844975:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.845047:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.845087:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694402048 00000100:00100000:3.0:1763334963.845102:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694402048 00000100:00100000:3.0:1763334963.845228:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4641 00000100:00100000:3.0:1763334963.845241:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694402048:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.845283:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.845314:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a12c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af73e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334963.845349:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x224:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334963.845376:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.845378:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.845394:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af73e expref: 15 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334963.845413:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af73e expref: 15 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334963.845429:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f600, rc 0) 00000100:00100000:3.0:1763334963.845497:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694402048:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 258us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.845506:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4641 00000100:00100000:0.0:1763334963.846158:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694401920 00000100:00100000:0.0:1763334963.846168:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694401920 00000100:00100000:0.0:1763334963.846225:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4518 00000100:00100000:0.0:1763334963.846235:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52274:x1848989694401920:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334963.846257:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334963.846288:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a133 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af737 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.846423:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.846442:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a11e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af730 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.846450:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.846495:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a11e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af730 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.846510:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a11e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af730 expref: 185 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334963.846525:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701814656:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334963.846666:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1c00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334963.851139:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.851219:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.851340:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694402432 00000100:00100000:2.0:1763334963.851354:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694402432 00010000:00010000:2.0:1763334963.851410:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a11e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af730 expref: 186 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334963.851463:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2454 00000100:00100000:2.0:1763334963.851474:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2360:x1848989694402432:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334963.851497:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334963.851505:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a11e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af730 expref: 186 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:2.0:1763334963.851519:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a11e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af730 expref: 186 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:2.0:1763334963.851549:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:2.0:1763334963.851556:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.851566:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.851610:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.851638:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334963.851712:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2360:x1848989694402432:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 239us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334963.851723:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2454 00000100:00100000:3.0:1763334963.851994:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694402304 00000100:00100000:3.0:1763334963.852002:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694402304 00000100:00100000:3.0:1763334963.852046:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1668 00000100:00100000:3.0:1763334963.852056:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53002:x1848989694402304:12345-192.168.201.60@tcp:35:lfs.0 00010000:00010000:0.0:1763334963.852527:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a11e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af730 expref: 187 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334963.852551:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701814656:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334963.853088:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.853102:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.853109:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334963.853128:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 0 00010000:00010000:0.0:1763334963.853473:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a133 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af737 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.853501:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af737 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.853513:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:0.0:1763334963.853516:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763334963.853520:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334963.853695:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694401920:12345-192.168.201.60@tcp:101:bash.0 Request processed in 7461us (8736us total) trans 8589938761 rc 0/0 00000100:00100000:0.0:1763334963.853706:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4518 00000100:00100000:2.0:1763334963.855741:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53002:x1848989694402304:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 3655us (4586us total) trans 8589938760 rc 0/0 00000100:00100000:2.0:1763334963.855759:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1668 00000100:00100000:0.0:1763334963.862761:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.862810:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.864067:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694402688 00000100:00100000:3.0:1763334963.864085:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694402688 00000100:00100000:1.0:1763334963.864096:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694402944 00000100:00100000:1.0:1763334963.864104:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694402944 00000100:00100000:3.0:1763334963.864164:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4519 00000100:00100000:3.0:1763334963.864176:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694402688:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:3.0:1763334963.864624:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a148 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.864646:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a148 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.864659:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a148 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000001:00080000:3.0:1763334963.864715:0:29629:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938762 00000004:00010000:3.0:1763334963.864737:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000050dcd88e reply state 00000000debfc997 transno 8589938763 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a148 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334963.864746:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334963.864860:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52274:x1848989694402688:12345-192.168.201.60@tcp:36:bash.0 Request processed in 686us (2114us total) trans 8589938763 rc 0/0 00000100:00100000:3.0:1763334963.864868:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4519 00000020:00080000:3.0:1763334963.864875:0:29629:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763334963.864892:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4520 00000100:00100000:3.0:1763334963.864899:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53002:x1848989694402944:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.864910:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.864921:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a14f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af745 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.865008:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a156 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865016:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a156 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865023:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a156 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865037:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a15d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865044:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a15d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865050:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a15d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865164:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a164 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865172:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a164 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x18/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865178:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a164 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x18/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334963.865188:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 0 00010000:00010000:3.0:1763334963.865248:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a156 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865256:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a156 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865263:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a156 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865269:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.865291:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a156 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865300:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a156 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865314:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334963.865318:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.865324:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a156 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865330:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a156 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865347:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a15d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865352:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a15d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865359:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a15d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865365:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0031000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334963.865368:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a15d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865374:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a15d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865381:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4800) 00010000:00010000:3.0:1763334963.865383:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334963.865386:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a15d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865392:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a15d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.865431:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a14f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af745 expref: 192 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.865452:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a164 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x18/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af745 expref: 191 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.865460:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:3.0:1763334963.865463:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 18 00010000:00010000:3.0:1763334963.865466:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030e00, rc 0) 00000100:00100000:3.0:1763334963.865505:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53002:x1848989694402944:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 606us (2694us total) trans 8589938764 rc 0/0 00000100:00100000:3.0:1763334963.865513:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4520 00010000:00010000:0.0:1763334963.872345:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a148 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334963.872371:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a148 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334963.872381:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a148 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334963.872390:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334963.872396:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a148 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334963.872405:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a148 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334963.872428:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:0.0:1763334963.872431:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334963.872437:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a148 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334963.872445:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a148 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:2.0:1763334963.873136:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.873217:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694403200 00000100:00100000:3.0:1763334963.873386:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694403200 00000100:00100000:3.0:1763334963.873467:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4521 00000100:00100000:3.0:1763334963.873479:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52274:x1848989694403200:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334963.873510:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.873534:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a172 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af74c expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334963.873560:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334963.873926:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a179 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.873945:0:29629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a164 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af745 expref: 191 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.873954:0:29629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a179 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334963.873996:0:29629:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a164 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af745 expref: 191 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.874013:0:29629:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a164 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af745 expref: 191 pid: 29629 timeout: 1128 lvb_type: 0 00000100:00100000:3.0:1763334963.874028:0:29629:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701814784:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334963.874262:0:29629:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0ad900 going to sleep for 11 seconds 00000100:00100000:1.0:1763334963.876038:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694403456 00000100:00100000:1.0:1763334963.876062:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694403456 00000100:00100000:1.0:1763334963.876161:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1669 00000100:00100000:1.0:1763334963.876173:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53002:x1848989694403456:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334963.876692:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53002:x1848989694403456:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 519us (3130us total) trans 8589938765 rc 0/0 00000100:00100000:1.0:1763334963.876702:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1669 00000100:00100000:1.0:1763334963.878005:0:29629:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701814784:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334963.878046:0:29629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a179 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334963.883890:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.883943:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.884042:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694403712 00000100:00100000:1.0:1763334963.884055:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694403712 00010000:00010000:1.0:1763334963.884109:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a164 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af745 expref: 193 pid: 29629 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334963.884112:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694403584 00000100:00100000:0.0:1763334963.884119:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694403584 00000100:00100000:0.0:1763334963.884176:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1670 00000100:00100000:0.0:1763334963.884188:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53002:x1848989694403584:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:0.0:1763334963.884399:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53002:x1848989694403584:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 211us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.884408:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1670 00000100:00100000:1.0:1763334963.884493:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2455 00000100:00100000:1.0:1763334963.884504:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2359:x1848989694403712:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334963.884518:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334963.884526:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a164 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af745 expref: 193 pid: 29629 timeout: 1128 lvb_type: 0 00010000:00010000:1.0:1763334963.884540:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a164 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af745 expref: 193 pid: 29629 timeout: 1128 lvb_type: 0 00010000:00010000:1.0:1763334963.884568:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a164 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af745 expref: 193 pid: 29629 timeout: 1128 lvb_type: 0 00010000:00010000:1.0:1763334963.884630:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:1.0:1763334963.884637:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a179 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334963.884650:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a179 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334963.884659:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a179 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334963.884693:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334963.884719:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2359:x1848989694403712:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 217us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334963.884728:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2455 00010000:00010000:0.0:1763334963.884739:0:29629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a179 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334963.884750:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a179 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000040:00080000:0.0:1763334963.885255:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1045, 88 off89912 00000004:00080000:0.0:1763334963.885267:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028518694467ns, next at 1029092096998ns, rc = 0 00000040:00080000:0.0:1763334963.885514:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1057, 88 off91024 00000004:00080000:0.0:1763334963.885520:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1028518947934ns, next at 1029092157246ns, rc = 0 00000040:00080000:0.0:1763334963.885547:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1058, 88 off91112 00000004:00080000:0.0:1763334963.885551:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1028518979156ns, next at 1029092157246ns, rc = 0 00000040:00080000:0.0:1763334963.885567:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1046, 88 off90000 00000004:00080000:0.0:1763334963.885718:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028519145279ns, next at 1029092096998ns, rc = 0 00000100:00100000:3.0:1763334963.907940:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.908083:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694403968 00000100:00100000:1.0:1763334963.908098:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694403968 00000100:00100000:1.0:1763334963.908165:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4522 00000100:00100000:1.0:1763334963.908176:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53003:x1848989694403968:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334963.908202:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334963.908230:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a180 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af753 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.908348:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a187 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908368:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a187 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908384:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a187 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908402:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a18e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908410:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a18e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908417:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a18e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908653:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a195 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908663:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a195 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908672:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a195 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334963.908685:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 2 00010000:00010000:1.0:1763334963.908853:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a195 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908862:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a195 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908869:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a195 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908877:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.908881:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a195 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908892:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a195 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908907:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:1.0:1763334963.908911:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1763334963.908918:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a195 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908925:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a195 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908942:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a187 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908949:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a187 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908955:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a187 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908960:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.908963:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a187 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908969:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a187 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908977:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334963.908980:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.908984:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a187 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.908990:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a187 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.909000:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a18e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.909006:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a18e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.909012:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a18e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.909016:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.909020:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a18e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.909025:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a18e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.909032:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa300) 00010000:00010000:1.0:1763334963.909034:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.909037:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a18e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.909043:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a18e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.909088:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a180 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af753 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.909098:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334963.909100:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334963.909104:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a180 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af753 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.909118:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478000, rc 0) 00000100:00100000:1.0:1763334963.909200:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53003:x1848989694403968:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1025us (1273us total) trans 8589938767 rc 301/301 00000100:00100000:1.0:1763334963.909209:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4522 00000100:00100000:0.0:1763334963.912528:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.912847:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694404096 00000100:00100000:2.0:1763334963.912863:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694404096 00000100:00100000:2.0:1763334963.912938:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4523 00000100:00100000:2.0:1763334963.912951:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53003:x1848989694404096:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334963.912979:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.913008:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849a1a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af75a expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.913161:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.913178:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af737 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.913186:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a179 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334963.913198:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 5/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334963.913220:0:30972:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a179 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334963.913251:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af737 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.913266:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af737 expref: 195 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334963.913292:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701814912:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334963.913406:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1763334963.920316:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.920610:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694404224 00000100:00100000:3.0:1763334963.920624:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694404224 00010000:00010000:3.0:1763334963.920681:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af737 expref: 196 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334963.920934:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2456 00000100:00100000:0.0:1763334963.920949:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694404224:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334963.920968:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.920976:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af737 expref: 196 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.920994:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af737 expref: 196 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.921027:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:0.0:1763334963.921036:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.921048:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.921054:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334963.921062:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334963.921145:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694404224:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 199us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.921160:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2456 00010000:00010000:2.0:1763334963.923545:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a13a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af737 expref: 195 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334963.923596:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701814912:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334963.923630:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:2.0:1763334963.945849:0:32264:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938766 is committed 00000004:00080000:2.0:1763334963.945868:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 685 committed 00000004:00080000:2.0:1763334963.945888:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 697 committed 00000004:00080000:2.0:1763334963.945899:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 696 committed 00000004:00080000:2.0:1763334963.945901:0:32264:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 684 committed 00010000:00010000:3.0:1763334963.946230:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a179 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af74c expref: 178 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.946249:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:3.0:1763334963.946252:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334963.946256:0:29629:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.946267:0:29629:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.946284:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.946347:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a172 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af74c expref: 178 pid: 29629 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1763334963.946351:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701815040:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763334963.946376:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a179 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af74c expref: 177 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.946413:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334963.946420:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334963.946447:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00200000:3.0:1763334963.946472:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 2 00000004:00200000:3.0:1763334963.946477:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000100:00100000:2.0:1763334963.946490:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701815552:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1763334963.946504:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334963.946510:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763334963.946537:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849a1a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af75a expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334963.946537:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763334963.946542:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701815424:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763334963.946549:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af75a expref: 177 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.946557:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:3.0:1763334963.946560:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00000100:00100000:2.0:1763334963.946561:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763334963.946562:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:3.0:1763334963.946670:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:53003:x1848989694404096:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 33721us (34155us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.946681:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4523 00000100:00100000:0.0:1763334963.947706:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701815296:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334963.947770:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701815168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334963.947800:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701815936:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334963.949402:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701815040 00000100:00100000:3.0:1763334963.949426:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701815040 00000100:00100000:3.0:1763334963.949517:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701815552 00000100:00100000:3.0:1763334963.949522:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701815552 00000100:00100000:3.0:1763334963.949542:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701815424 00000100:00100000:3.0:1763334963.949545:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701815424 00000100:00100000:3.0:1763334963.949600:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4642 00000100:00100000:3.0:1763334963.949612:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3290:x1848989701815040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334963.949657:0:25383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:550 count 1 00010000:00010000:3.0:1763334963.949696:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.949723:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099800/0xcedf0054f849a006 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6dc expref: 30 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.949733:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334963.949735:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334963.949740:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.949786:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099800/0xcedf0054f849a006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6dc expref: 30 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.949803:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099800/0xcedf0054f849a006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6dc expref: 30 pid: 6517 timeout: 1128 lvb_type: 0 00000100:00100000:3.0:1763334963.949821:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeef9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701816576:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334963.949898:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701816064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334963.951398:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0ad9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334963.951442:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4643 00000100:00100000:3.0:1763334963.951458:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3290:x1848989701815552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.951600:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334963.951642:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701816064 00000100:00100000:0.0:1763334963.951651:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701816064 00000100:00100000:2.0:1763334963.951655:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4644 00000100:00100000:2.0:1763334963.951664:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+37:3290:x1848989701815424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763334963.951681:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:547 count 1 00000100:00100000:0.0:1763334963.951701:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4645 00010000:00010000:2.0:1763334963.951704:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334963.951708:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3290:x1848989701816064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334963.951720:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:542 count 1 00010000:00010000:2.0:1763334963.951725:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499fc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c0 expref: 30 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.951732:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334963.951735:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334963.951737:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.951738:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.951750:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499d19 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5e7 expref: 14 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.951756:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334963.951757:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334963.951760:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.951772:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c0 expref: 30 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.951778:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499d19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5e7 expref: 14 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.951785:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c0 expref: 30 pid: 32241 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.951786:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499d19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5e7 expref: 14 pid: 32239 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334963.951806:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701816704:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334963.951807:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab31500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701816832:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334963.951844:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ae1ae3780 going to sleep for 11 seconds 00000100:00100000:2.0:1763334963.951860:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334963.951915:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701815936 00000100:00100000:1.0:1763334963.951920:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701815936 00000100:00100000:1.0:1763334963.951950:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4646 00000100:00100000:1.0:1763334963.951958:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701815936:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763334963.951969:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:547 count 1 00002000:00010000:1.0:1763334963.951999:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x223:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334963.952004:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a1c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.952013:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.952015:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334963.952019:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a1c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.952033:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a1c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.952043:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a1c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.952330:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a1c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.952357:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334963.952411:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334963.952694:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701816448:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334963.952736:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.952769:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701816448 00000100:00100000:2.0:1763334963.952774:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701816448 00000100:00100000:2.0:1763334963.952804:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4647 00000100:00100000:2.0:1763334963.952812:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701816448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334963.953015:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3289:x1848989701816448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 202us (277us total) trans 21474838298 rc 0/0 00000100:00100000:2.0:1763334963.953024:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4647 00000100:00100000:2.0:1763334963.953057:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.953083:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701815680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.953213:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.953229:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701816192:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334963.953253:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334963.953287:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701815168 00000100:00100000:2.0:1763334963.953291:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701815168 00000100:00100000:2.0:1763334963.953308:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701815680 00000100:00100000:2.0:1763334963.953311:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701815680 00000100:00100000:2.0:1763334963.953322:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701816192 00000100:00100000:2.0:1763334963.953324:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701816192 00000100:00100000:2.0:1763334963.953336:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4648 00000100:00100000:2.0:1763334963.953342:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3291:x1848989701815168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763334963.953361:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:551 count 1 00002000:00010000:2.0:1763334963.953388:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x227:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334963.953476:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a1cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.953490:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.953492:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.953497:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a1cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.953512:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a1cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763334963.953516:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77f800/2, rc 0, transno 21474838298 00010000:00010000:2.0:1763334963.953524:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a1cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334963.953527:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701816448:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1763334963.953539:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a1cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.953590:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763334963.953806:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3290:x1848989701815552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2352us (7292us total) trans 17179871016 rc 0/0 00000100:00100000:3.0:1763334963.953819:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4643 00000100:00100000:3.0:1763334963.953847:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4649 00000100:00100000:2.0:1763334963.953847:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+40:3291:x1848989701815168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 503us (787us total) trans 17179871017 rc 0/0 00000100:00100000:2.0:1763334963.953858:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4648 00000100:00100000:3.0:1763334963.953863:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3291:x1848989701815680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.953880:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4650 00000100:00100000:2.0:1763334963.953890:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3291:x1848989701816192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334963.953906:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:543 count 1 00010000:00010000:2.0:1763334963.953921:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.953940:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499fab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6b9 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.953948:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334963.953949:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334963.953953:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.953988:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499fab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6b9 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.954004:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499fab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6b9 expref: 14 pid: 6517 timeout: 1128 lvb_type: 0 00000100:00100000:3.0:1763334963.954008:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3291:x1848989701815680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (895us total) trans 17179871018 rc 0/0 00000100:00100000:3.0:1763334963.954023:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4649 00000100:00100000:2.0:1763334963.954030:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701816960:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334963.954088:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ae1ae3480 going to sleep for 11 seconds 00010000:00010000:0.0:1763334963.954170:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763334963.954179:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a1c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.954189:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334963.954195:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a1c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.954206:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a1c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763334963.954207:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab35f80/2, rc 0, transno 17179871017 00000100:00100000:2.0:1763334963.954218:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701815168:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763334963.954233:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a1c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.954243:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a1c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.954267:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334963.954280:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a1cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.954292:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334963.954295:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a1cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.954302:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a1cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.954312:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a1cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.954319:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a1cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.954391:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334963.954392:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334963.954394:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334963.955242:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c7800/2, rc 0, transno 17179871018 00000100:00100000:2.0:1763334963.955255:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701815680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334963.956435:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3289:x1848989701815936:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4471us (4566us total) trans 21474838299 rc 0/0 00000100:00100000:1.0:1763334963.956450:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4646 00000100:00100000:2.0:1763334963.956468:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334963.956489:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701815296 00000100:00100000:1.0:1763334963.956499:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701815296 00000100:00100000:2.0:1763334963.956517:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701815808:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334963.956547:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4651 00000100:00100000:1.0:1763334963.956557:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef84b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3292:x1848989701815296:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.956566:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:1.0:1763334963.956607:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:546 count 1 00000100:00100000:2.0:1763334963.956612:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701816320:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763334963.956638:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334963.956640:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1763334963.956664:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499fdc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6d5 expref: 30 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.956673:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334963.956676:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1763334963.956679:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701815808 00010000:00010000:1.0:1763334963.956680:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 4/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334963.956685:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701815808 00000100:00100000:2.0:1763334963.956713:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701816320 00000100:00100000:2.0:1763334963.956716:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701816320 00010000:00010000:1.0:1763334963.956721:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499fdc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6d5 expref: 30 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334963.956732:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4652 00010000:00010000:1.0:1763334963.956737:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6d5 expref: 30 pid: 32241 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334963.956742:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3292:x1848989701815808:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334963.956759:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701817088:192.168.201.60@tcp:104: 00002000:00080000:2.0:1763334963.956766:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:546 count 1 00010000:00010000:2.0:1763334963.956786:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.956802:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a00d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6e3 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.956810:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334963.956811:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334963.956815:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334963.956822:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee300 going to sleep for 11 seconds 00010000:00010000:2.0:1763334963.956838:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a00d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6e3 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.956840:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334963.956852:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a00d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6e3 expref: 14 pid: 6519 timeout: 1128 lvb_type: 0 00000100:00100000:1.0:1763334963.956858:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4653 00000100:00100000:2.0:1763334963.956871:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5574380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701817216:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334963.956872:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3292:x1848989701816320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334963.956903:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ae1ae33c0 going to sleep for 11 seconds 00002000:00010000:1.0:1763334963.957132:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334963.957136:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763334963.957139:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334963.957141:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763334963.957143:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334963.957199:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3292:x1848989701816320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 330us (557us total) trans 21474838300 rc 0/0 00000100:00100000:1.0:1763334963.957206:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4653 00000004:00080000:1.0:1763334963.957251:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77ed80/2, rc 0, transno 21474838299 00000100:00100000:1.0:1763334963.957258:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701815936:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334963.957942:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334963.958010:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000004:00080000:3.0:1763334963.958087:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c5f80/2, rc 0, transno 17179871016 00000100:00100000:3.0:1763334963.958095:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701815552:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334963.958125:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeef9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701816576:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334963.958153:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.958205:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ad8099400, rc 0) 00000100:00100000:3.0:1763334963.958257:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+176:52274:x1848989694403200:12345-192.168.201.60@tcp:101:bash.0 Request processed in 84779us (85131us total) trans 8589938766 rc 0/0 00000100:00100000:3.0:1763334963.958267:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4521 00000100:00100000:3.0:1763334963.958392:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694404480 00000100:00100000:3.0:1763334963.958399:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694404480 00000100:00100000:3.0:1763334963.958445:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4524 00000100:00100000:3.0:1763334963.958455:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+176:53003:x1848989694404480:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334963.958476:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.958498:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a1e9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af761 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.958554:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a1e9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af761 expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.958604:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a1e9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af761 expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.958625:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:3.0:1763334963.958629:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334963.958633:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030e00, rc 0) 00000100:00100000:3.0:1763334963.958664:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:53003:x1848989694404480:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 209us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.958670:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4524 00000100:00100000:0.0:1763334963.958956:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694404352 00000100:00100000:0.0:1763334963.958962:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694404352 00010000:00010000:0.0:1763334963.958989:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099800/0xcedf0054f849a006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6dc expref: 31 pid: 6517 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334963.959013:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2457 00000100:00100000:0.0:1763334963.959020:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694404352:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334963.959030:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.959035:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099800/0xcedf0054f849a006 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6dc expref: 31 pid: 6517 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.959053:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099800/0xcedf0054f849a006 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6dc expref: 31 pid: 6517 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.959080:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099800/0xcedf0054f849a006 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6dc expref: 31 pid: 6517 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.959096:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.959098:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.959103:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.959114:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.959139:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334963.959167:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694404352:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 147us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.959174:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2457 00000004:00080000:2.0:1763334963.961586:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77d180/2, rc 0, transno 21474838300 00000100:00100000:2.0:1763334963.961606:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701816320:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1763334963.968413:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.968451:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.968467:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.968481:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.968512:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334963.968606:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701816704:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334963.968650:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334963.970397:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab31500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701816832:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334963.970433:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334963.970825:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+41:3290:x1848989701815040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 21210us (24372us total) trans 17179871019 rc 0/0 00000100:00100000:3.0:1763334963.970846:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4642 00010000:00010000:3.0:1763334963.970901:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334963.970911:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.970923:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ad8099600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334963.970928:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.970942:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.970969:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.970977:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8099600/0xcedf0054f849a1b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.971000:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334963.971002:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334963.971004:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334963.971464:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab34a80/2, rc 0, transno 17179871019 00000100:00100000:2.0:1763334963.971476:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701815040:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334963.972475:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.972503:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.972535:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694404608 00000100:00100000:0.0:1763334963.972545:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694404608 00010000:00010000:0.0:1763334963.972623:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c0 expref: 30 pid: 32241 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334963.972656:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694404864 00000100:00100000:0.0:1763334963.972659:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694404864 00010000:00010000:0.0:1763334963.972675:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499fab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6b9 expref: 15 pid: 6517 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334963.972698:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2458 00000100:00100000:0.0:1763334963.972708:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2361:x1848989694404608:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334963.972726:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.972732:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499fc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c0 expref: 30 pid: 32241 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.972747:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499fc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c0 expref: 30 pid: 32241 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.972775:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f8499fc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6c0 expref: 30 pid: 32241 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.972793:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.972795:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.972802:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.972813:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.972846:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334963.972906:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2361:x1848989694404608:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 199us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.972913:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2458 00000100:00100000:0.0:1763334963.972933:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2459 00000100:00100000:0.0:1763334963.972941:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2361:x1848989694404864:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334963.972954:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.972958:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499fab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6b9 expref: 15 pid: 6517 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.972968:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499fab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6b9 expref: 15 pid: 6517 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.972985:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.972986:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.972990:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.972998:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.973010:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334963.973028:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2361:x1848989694404864:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 89us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.973035:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2459 00000100:00100000:0.0:1763334963.973118:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.973193:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.973322:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.973355:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.973378:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694405120 00000100:00100000:0.0:1763334963.973382:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694405120 00010000:00010000:0.0:1763334963.973407:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a00d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6e3 expref: 15 pid: 6519 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334963.973422:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694404736 00000100:00100000:0.0:1763334963.973425:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694404736 00010000:00010000:0.0:1763334963.973434:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499d19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5e7 expref: 16 pid: 32239 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334963.973444:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694404992 00000100:00100000:0.0:1763334963.973447:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694404992 00010000:00010000:0.0:1763334963.973462:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499fdc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6d5 expref: 29 pid: 32241 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334963.973473:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2460 00000100:00100000:0.0:1763334963.973480:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694405120:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334963.973487:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.973491:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a00d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6e3 expref: 16 pid: 6519 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.973500:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a00d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6e3 expref: 16 pid: 6519 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.973513:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.973515:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.973519:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.973527:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.973544:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334963.973596:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694405120:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 115us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.973603:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2460 00000100:00100000:0.0:1763334963.973618:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2461 00000100:00100000:0.0:1763334963.973623:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2361:x1848989694404736:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334963.973633:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.973638:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499d19 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5e7 expref: 15 pid: 32239 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.973645:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499d19 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5e7 expref: 15 pid: 32239 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.973656:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f8499d19 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af5e7 expref: 15 pid: 32239 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.973667:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.973668:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.973671:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.973678:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.973693:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334963.973710:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694404736:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 86us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.973717:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2461 00000100:00100000:0.0:1763334963.973730:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2462 00000100:00100000:0.0:1763334963.973735:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2361:x1848989694404992:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334963.973743:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334963.973747:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499fdc lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6d5 expref: 29 pid: 32241 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.973756:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499fdc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6d5 expref: 29 pid: 32241 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334963.973770:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.973771:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334963.973774:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.973781:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334963.973792:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334963.973811:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2361:x1848989694404992:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 76us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334963.973817:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2462 00010000:00010000:3.0:1763334963.973976:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a00d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6e3 expref: 13 pid: 6519 timeout: 1128 lvb_type: 0 00000100:00100000:3.0:1763334963.973989:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5574380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701817216:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334963.974021:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.974040:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.974047:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.974060:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.974069:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.974100:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334963.974539:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3292:x1848989701815808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17798us (17972us total) trans 21474838301 rc 0/0 00000100:00100000:3.0:1763334963.974549:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4652 00000100:00100000:3.0:1763334963.974601:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694405248 00000100:00100000:3.0:1763334963.974608:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694405248 00000100:00100000:3.0:1763334963.974641:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4654 00000100:00100000:3.0:1763334963.974649:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+13:52274:x1848989694405248:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334963.974667:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334963.974686:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af768 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.974713:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a12c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af73e expref: 14 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334963.974726:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.974728:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334963.974733:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 14 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.974769:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a12c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af73e expref: 14 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334963.974784:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a12c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af73e expref: 14 pid: 6517 timeout: 1128 lvb_type: 1 00000100:00100000:3.0:1763334963.974799:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeef9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701817344:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334963.974864:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0adc00 going to sleep for 11 seconds 00000004:00080000:3.0:1763334963.974910:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77d880/2, rc 0, transno 21474838301 00000100:00100000:3.0:1763334963.974917:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701815808:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763334963.975188:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ad8098a00/0xcedf0054f8499fdc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6d5 expref: 28 pid: 32241 timeout: 1128 lvb_type: 0 00000100:00100000:1.0:1763334963.975202:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701817088:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334963.975220:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975237:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975245:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975254:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975262:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975296:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763334963.975626:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef84b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+41:3292:x1848989701815296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19070us (19159us total) trans 17179871020 rc 0/0 00000100:00100000:1.0:1763334963.975635:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4651 00010000:00010000:1.0:1763334963.975663:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763334963.975673:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975682:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334963.975686:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975697:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975721:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975729:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a1e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975749:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334963.975752:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975759:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334963.975762:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975769:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975780:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975788:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a1db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975801:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.975803:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.975805:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763334963.975830:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab37480/2, rc 0, transno 17179871020 00000100:00100000:1.0:1763334963.975836:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701815296:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763334963.975856:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975865:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975874:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975880:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.975896:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334963.976101:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701816064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24393us (24528us total) trans 21474838302 rc 0/0 00000100:00100000:1.0:1763334963.976109:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4645 00010000:00010000:1.0:1763334963.976131:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334963.976136:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.976143:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334963.976146:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.976154:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.976172:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.976178:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a1bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.976192:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.976193:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.976195:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763334963.976219:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77c000/2, rc 0, transno 21474838302 00000100:00100000:1.0:1763334963.976224:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701816064:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763334963.976754:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ad8098800/0xcedf0054f8499fab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af6b9 expref: 14 pid: 6517 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334963.976771:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701816960:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334963.976796:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.976807:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.976815:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.976824:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.976831:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.976863:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334963.977184:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701816192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23295us (23928us total) trans 21474838303 rc 0/0 00000100:00100000:2.0:1763334963.977195:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4650 00000004:00080000:2.0:1763334963.977250:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77dc00/2, rc 0, transno 21474838303 00000100:00100000:2.0:1763334963.977256:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701816192:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763334963.977289:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.977299:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.977308:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.977314:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.977330:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763334963.977514:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+41:3290:x1848989701815424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 25851us (30951us total) trans 17179871021 rc 0/0 00000100:00100000:2.0:1763334963.977521:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4644 00010000:00010000:1.0:1763334963.978109:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763334963.978119:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.978129:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334963.978134:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.978143:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.978163:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.978172:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a1d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.978194:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334963.978198:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.978205:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334963.978208:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.978215:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.978226:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.978233:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a1b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.978248:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.978250:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.978252:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334963.978260:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763334963.978305:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c4000/2, rc 0, transno 17179871021 00000100:00100000:1.0:1763334963.978313:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701815424:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334963.978432:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.978478:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334963.978565:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334963.978647:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694405504 00000100:00100000:1.0:1763334963.978658:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694405504 00000100:00100000:1.0:1763334963.978711:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1671 00000100:00100000:1.0:1763334963.978721:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+177:53003:x1848989694405504:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334963.978991:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53003:x1848989694405504:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 270us (561us total) trans 8589938768 rc 0/0 00000100:00100000:1.0:1763334963.978999:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1671 00000100:00100000:3.0:1763334963.979286:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694405632 00000100:00100000:3.0:1763334963.979292:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694405632 00000100:00100000:3.0:1763334963.979410:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 385 00000100:00100000:3.0:1763334963.979420:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2362:x1848989694405632:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334963.979433:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334963.979458:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a1e9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af761 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334963.979477:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:3.0:1763334963.979481:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334963.979507:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:2362:x1848989694405632:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 90us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.979513:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 385 00000100:00100000:0.0:1763334963.979808:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.980015:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694405760 00000100:00100000:2.0:1763334963.980022:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694405760 00010000:00010000:2.0:1763334963.980048:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a12c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af73e expref: 14 pid: 6517 timeout: 1128 lvb_type: 1 00000100:00100000:2.0:1763334963.980084:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2463 00000100:00100000:2.0:1763334963.980092:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694405760:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334963.980102:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334963.980106:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a12c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af73e expref: 14 pid: 6517 timeout: 1128 lvb_type: 1 00010000:00010000:2.0:1763334963.980119:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a12c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af73e expref: 14 pid: 6517 timeout: 1128 lvb_type: 1 00010000:00010000:2.0:1763334963.980140:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.980142:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.980153:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 14 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.980163:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 14 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.980215:0:6532:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 14 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334963.980234:0:6532:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6532:1848989701817472:192.168.201.60@tcp:105: 00000100:00100000:2.0:1763334963.980319:0:6532:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ae1ae33c0 going to sleep for 11 seconds 00010000:00010000:2.0:1763334963.980917:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a12c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af73e expref: 14 pid: 6517 timeout: 1128 lvb_type: 1 00000100:00100000:2.0:1763334963.980939:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeef9ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701817344:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334963.980969:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 13 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.980980:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0031000, rc 0) 00000100:00100000:2.0:1763334963.981023:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+13:52274:x1848989694405248:12345-192.168.201.60@tcp:101:bash.0 Request processed in 6374us (7667us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334963.981031:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4654 00000100:00100000:2.0:1763334963.982134:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.982412:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694405888 00000100:00100000:1.0:1763334963.982427:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694405888 00000100:00100000:1.0:1763334963.982502:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4525 00000100:00100000:1.0:1763334963.982515:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+177:53003:x1848989694405888:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334963.982547:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334963.982612:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a1f7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af76f expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.982729:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a1fe lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.982749:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a1fe lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.982766:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a1fe lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.982784:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a205 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.982791:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a205 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.982803:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a205 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.982995:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849a20c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983010:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849a20c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983017:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849a20c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334963.983066:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 2 00000004:00200000:1.0:1763334963.983072:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334963.983094:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849a20c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983107:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849a20c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983116:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a1fe lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983124:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a1fe lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983130:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a1fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983137:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.983142:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a1fe lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983150:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a1fe lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983163:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334963.983167:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.983172:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a1fe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983180:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a1fe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983194:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a205 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983200:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a205 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983204:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a205 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983209:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334963.983212:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a205 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983217:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a205 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983224:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa100) 00010000:00010000:1.0:1763334963.983226:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334963.983229:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a205 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983234:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a205 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334963.983290:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a1f7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af76f expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.983306:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849a20c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af76f expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334963.983318:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:1.0:1763334963.983321:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334963.983324:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478800, rc 0) 00000100:00100000:1.0:1763334963.983412:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53003:x1848989694405888:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 899us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334963.983421:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4525 00000100:00100000:0.0:1763334963.984179:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334963.984329:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694406016 00000100:00100000:2.0:1763334963.984341:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694406016 00000100:00100000:2.0:1763334963.984406:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4655 00000100:00100000:2.0:1763334963.984418:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+28:52274:x1848989694406016:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334963.984437:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334963.984461:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f849a213 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af776 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334963.984493:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x228:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334963.984517:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.984520:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334963.984532:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f849a213 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af776 expref: 29 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.984549:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f849a213 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af776 expref: 29 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334963.984569:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066c00, rc 0) 00000100:00100000:2.0:1763334963.984644:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+29:52274:x1848989694406016:12345-192.168.201.60@tcp:101:bash.0 Request processed in 227us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334963.984651:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4655 00000100:00100000:3.0:1763334963.985058:0:6532:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6532:1848989701817472:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334963.985086:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334963.985116:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2359:x1848989694405760:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5024us (5308us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334963.985125:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2463 00000100:00100000:3.0:1763334963.991392:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334963.991957:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694406144 00000100:00100000:1.0:1763334963.991973:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694406144 00000100:00100000:2.0:1763334963.992276:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334963.992362:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694406272 00000100:00100000:0.0:1763334963.992367:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694406272 00002000:00010000:0.0:1763334963.992427:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/552 (0->18446744073709551615) 00002000:00100000:0.0:1763334963.992433:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a1f80 with x1848989694406272 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334963.992452:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aef0a1f80. 00000100:00100000:0.0:1763334963.992747:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1710 00000100:00100000:0.0:1763334963.992761:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694406272:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:0.0:1763334963.993159:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334963.993163:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb mtime from disk: 0 -> 1763334964 00002000:00010000:0.0:1763334963.993166:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334963.993169:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb ctime from disk: 0 -> 1763334964 00002000:00010000:0.0:1763334963.993171:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334963.993261:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694406272:12345-192.168.201.60@tcp:10:bash.0 Request processed in 501us (994us total) trans 17179871022 rc 0/0 00000100:00100000:0.0:1763334963.993280:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1710 00002000:00010000:0.0:1763334963.993286:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/552 (0->18446744073709551615) 00002000:00100000:0.0:1763334963.993289:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a1f80 with x1848989694406272 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334963.993294:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aef0a1f80. 00002000:00010000:0.0:1763334963.996656:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/548 (0->18446744073709551615) 00002000:00100000:0.0:1763334963.996675:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeef9df80 with x1848989694406144 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334963.996693:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeef9df80. 00000100:00100000:0.0:1763334963.996762:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1711 00000100:00100000:0.0:1763334963.996784:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694406144:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:0.0:1763334963.997251:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334963.997256:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb mtime from disk: 0 -> 1763334964 00002000:00010000:0.0:1763334963.997259:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334963.997262:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb ctime from disk: 0 -> 1763334964 00002000:00010000:0.0:1763334963.997265:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334963.997375:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694406144:12345-192.168.201.60@tcp:10:bash.0 Request processed in 601us (5998us total) trans 21474838304 rc 0/0 00000100:00100000:0.0:1763334963.997384:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1711 00002000:00010000:0.0:1763334963.997388:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/548 (0->18446744073709551615) 00002000:00100000:0.0:1763334963.997391:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeef9df80 with x1848989694406144 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334963.997397:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeef9df80. 00000100:00100000:2.0:1763334964.006440:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.006621:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694406528 00000100:00100000:1.0:1763334964.006636:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694406528 00000100:00080000:3.0:1763334964.006713:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1763334964.006742:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4526 00000100:00100000:1.0:1763334964.006755:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53004:x1848989694406528:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.006783:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.006811:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a21a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af77d expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.007003:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a221 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.007022:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a221 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.007036:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a221 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334964.007050:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 2 00010000:00010000:1.0:1763334964.007233:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a21a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af77d expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.007263:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a221 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af77d expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.007288:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:1.0:1763334964.007291:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763334964.007297:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334964.007388:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53004:x1848989694406528:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 635us (963us total) trans 8589938769 rc 0/0 00000100:00100000:1.0:1763334964.007396:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4526 00000100:00100000:1.0:1763334964.012344:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.012431:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694406784 00000100:00100000:2.0:1763334964.012447:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694406784 00000100:00100000:2.0:1763334964.012534:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1672 00000100:00100000:2.0:1763334964.012547:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01d13450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52274:x1848989694406784:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:3.0:1763334964.012707:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.012954:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694407040 00000100:00100000:0.0:1763334964.012960:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694407040 00000100:00100000:0.0:1763334964.013004:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4527 00000100:00100000:0.0:1763334964.013012:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53004:x1848989694407040:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334964.013029:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.013056:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a22f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af784 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.013148:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334964.013166:0:29629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af75a expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.013175:0:29629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849a20c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af76f expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.013184:0:29629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334964.013231:0:29629:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849a20c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af76f expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.013256:0:29629:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849a20c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af76f expref: 182 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334964.013288:0:29629:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af59f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701817600:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334964.013418:0:29629:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af75a expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.013430:0:29629:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af75a expref: 183 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334964.013441:0:29629:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af59f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701817728:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334964.013469:0:29629:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1180 going to sleep for 11 seconds 00000100:00100000:2.0:1763334964.013956:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01d13450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52274:x1848989694406784:12345-192.168.201.60@tcp:35:bash.0 Request processed in 1410us (1630us total) trans 8589938770 rc 0/0 00000100:00100000:2.0:1763334964.013968:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1672 00000100:00100000:0.0:1763334964.014944:0:29629:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af59f8380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701817600:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334964.015443:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.015530:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694407168 00000100:00100000:2.0:1763334964.015539:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694407168 00010000:00010000:2.0:1763334964.015620:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849a20c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af76f expref: 183 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334964.015655:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2464 00000100:00100000:2.0:1763334964.015668:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:2359:x1848989694407168:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334964.015684:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334964.015691:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849a20c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af76f expref: 183 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:2.0:1763334964.015703:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849a20c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af76f expref: 183 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:2.0:1763334964.015741:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849a20c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af76f expref: 183 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:2.0:1763334964.015760:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:2.0:1763334964.015766:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.015775:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.015781:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334964.015844:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2359:x1848989694407168:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 179us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.015851:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2464 00000100:00100000:0.0:1763334964.017779:0:29629:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af59f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701817728:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334964.017829:0:29629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334964.018280:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.018532:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694407296 00000100:00100000:0.0:1763334964.018543:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694407296 00010000:00010000:0.0:1763334964.018609:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af75a expref: 182 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334964.018645:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2465 00000100:00100000:0.0:1763334964.018655:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2359:x1848989694407296:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334964.018672:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334964.018680:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af75a expref: 182 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334964.018692:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af75a expref: 182 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334964.018720:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a1aa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af75a expref: 182 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334964.018738:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:0.0:1763334964.018744:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334964.018755:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334964.018764:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334964.018799:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334964.019518:0:29629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.019536:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334964.019567:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 2 00010000:00010000:2.0:1763334964.019902:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a22f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af784 expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.019932:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af784 expref: 182 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.019942:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:2.0:1763334964.019946:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334964.019950:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334964.019965:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2359:x1848989694407296:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1307us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.019976:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2465 00000100:00100000:0.0:1763334964.023491:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.023548:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53004:x1848989694407040:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 10530us (10834us total) trans 8589938771 rc 0/0 00000100:00100000:2.0:1763334964.023565:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4527 00000100:00100000:2.0:1763334964.023637:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694407424 00000100:00100000:2.0:1763334964.023653:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694407424 00000100:00100000:2.0:1763334964.023738:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4528 00000100:00100000:2.0:1763334964.023749:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53005:x1848989694407424:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:2.0:1763334964.023787:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.023818:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a244 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af78b expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.023945:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a24b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.023964:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a24b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.023979:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a24b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.023996:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a252 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.024003:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a252 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.024009:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a252 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.024162:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.024177:0:29629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af784 expref: 182 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.024187:0:29629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.024238:0:29629:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af784 expref: 182 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.024254:0:29629:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af784 expref: 182 pid: 29629 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334964.024285:0:29629:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac37cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701817856:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334964.024416:0:29629:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb6180 going to sleep for 11 seconds 00000100:00100000:0.0:1763334964.025900:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.026127:0:29629:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac37cc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701817856:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334964.026167:0:29629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334964.026463:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694407552 00000100:00100000:3.0:1763334964.026474:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694407552 00000100:00100000:3.0:1763334964.026551:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4529 00000100:00100000:3.0:1763334964.026564:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53004:x1848989694407552:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334964.026620:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.026645:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a260 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af792 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.026759:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a267 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.026777:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a267 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.026786:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a267 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334964.026966:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.027017:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694407680 00000100:00100000:0.0:1763334964.027022:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694407680 00010000:00010000:0.0:1763334964.027050:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af784 expref: 185 pid: 29629 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334964.029763:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2466 00000100:00100000:0.0:1763334964.029797:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:2362:x1848989694407680:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334964.029822:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334964.029835:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af784 expref: 185 pid: 29629 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334964.029857:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af784 expref: 185 pid: 29629 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334964.029889:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a236 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x18f:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af784 expref: 185 pid: 29629 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334964.029917:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:0.0:1763334964.029924:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334964.029936:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334964.029944:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334964.029953:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a267 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.029959:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a267 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.029965:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a267 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.030014:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334964.030104:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2362:x1848989694407680:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 325us (3138us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.030114:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2466 00010000:00010000:3.0:1763334964.030363:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a267 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.030374:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a267 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334964.030439:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 5 00000004:00200000:3.0:1763334964.030446:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334964.030471:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a267 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.030510:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a260 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af792 expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.030529:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a267 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af792 expref: 183 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.030536:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:3.0:1763334964.030539:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334964.030542:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030e00, rc 0) 00010000:00010000:2.0:1763334964.030675:0:29629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030686:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:2.0:1763334964.030709:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 5 00000004:00200000:2.0:1763334964.030712:0:29629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334964.030724:0:29629:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030735:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030745:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a24b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030751:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a24b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030758:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a24b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030765:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.030770:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a24b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030777:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a24b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030788:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.030791:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.030795:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a24b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030800:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a24b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030811:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a252 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030816:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a252 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030821:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a252 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030826:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.030829:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a252 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030835:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a252 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030842:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cabe00) 00010000:00010000:2.0:1763334964.030845:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.030848:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a252 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030853:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a252 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.030882:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a244 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af78b expref: 184 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.030892:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af78b expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.030899:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:2.0:1763334964.030902:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334964.030904:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:3.0:1763334964.031555:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53004:x1848989694407552:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4987us (5658us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.031565:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53005:x1848989694407424:12345-192.168.201.60@tcp:101:rm.0 Request processed in 7815us (8091us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.031595:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4529 00000100:00100000:2.0:1763334964.031897:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4528 00000100:00100000:1.0:1763334964.037876:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.038510:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.039142:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694407808 00000100:00100000:0.0:1763334964.039159:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694407808 00000100:00100000:2.0:1763334964.039454:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694408064 00000100:00100000:2.0:1763334964.039460:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694408064 00000100:00100000:1.0:1763334964.039503:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.039506:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1673 00000100:00100000:2.0:1763334964.039518:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53004:x1848989694408064:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334964.039537:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694408320 00000100:00100000:1.0:1763334964.039541:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694408320 00000100:00100000:1.0:1763334964.039601:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4530 00000100:00100000:1.0:1763334964.039610:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53005:x1848989694408320:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:1.0:1763334964.039648:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1763334964.039683:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a267 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af792 expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.039708:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ad8099400/0xcedf0054f849a179 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af74c expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.039719:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:1.0:1763334964.039726:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334964.039759:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a26e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.039775:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a26e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.039784:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a26e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.039799:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a275 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.039806:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a275 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.039812:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a275 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334964.039879:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53004:x1848989694408064:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 363us (1371us total) trans 8589938772 rc 0/0 00000100:00100000:2.0:1763334964.039888:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1673 00010000:00010000:1.0:1763334964.039974:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.039985:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a221 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af77d expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.039993:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af78b expref: 182 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.040000:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 5/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00100000:1.0:1763334964.040028:0:29627:0:(ldlm_lockd.c:2634:ldlm_cancel_hpreq_lock_match()) @@@ Prio raised by lock 0xcedf0054f849a259 req@ffff9a5afa77f100 x1848989694407808/t0(0) o103->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:10/0 lens 328/0 e 0 to 0 dl 1763334975 ref 1 fl New:/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1763334964.040067:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af78b expref: 182 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.040084:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af78b expref: 182 pid: 29629 timeout: 1128 lvb_type: 0 00000100:00100000:1.0:1763334964.040100:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701817984:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334964.040169:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a221 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af77d expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.040178:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a221 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af77d expref: 182 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:1.0:1763334964.040185:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701818112:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334964.040204:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee600 going to sleep for 11 seconds 00000100:00100000:3.0:1763334964.040411:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2467 00000100:00100000:3.0:1763334964.040424:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2362:x1848989694407808:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334964.040436:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334964.040442:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af78b expref: 182 pid: 29629 timeout: 1128 lvb_type: 0 00010000:00010000:3.0:1763334964.040453:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af78b expref: 182 pid: 29629 timeout: 1128 lvb_type: 0 00010000:00010000:3.0:1763334964.040468:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:3.0:1763334964.040472:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.040478:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.040484:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334964.040525:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2362:x1848989694407808:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 104us (2666us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.040532:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2467 00000100:00100000:1.0:1763334964.043286:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.043441:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701818112:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334964.043554:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694408448 00000100:00100000:0.0:1763334964.043565:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694408448 00010000:00010000:3.0:1763334964.043653:0:29627:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.60@tcp) returned -22 from blocking AST (req@00000000e960433b x1848989701817984) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 1/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af78b expref: 182 pid: 29629 timeout: 1128 lvb_type: 0 00010000:00010000:3.0:1763334964.043677:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a259 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af78b expref: 182 pid: 29629 timeout: 1128 lvb_type: 0 00000100:00100000:3.0:1763334964.043693:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701817984:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334964.043723:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:3.0:1763334964.043728:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.043736:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.043746:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.043844:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a221 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af77d expref: 181 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:0.0:1763334964.043874:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2468 00000100:00100000:0.0:1763334964.043883:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53004:x1848989694408448:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:0.0:1763334964.043902:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334964.043908:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a221 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af77d expref: 181 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334964.043919:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a221 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af77d expref: 181 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334964.043940:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a221 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af77d expref: 181 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:0.0:1763334964.043950:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:0.0:1763334964.043954:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.043961:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.043968:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.044000:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334964.044397:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.044406:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334964.044756:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53004:x1848989694408448:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 871us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.044766:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2468 00000004:00080000:1.0:1763334964.045052:0:29627:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x18f:0x0] is inserted into orphan list, open count = 1 00010000:00010000:1.0:1763334964.045213:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.045222:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.045234:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.045240:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.045244:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.045261:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.045299:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:1.0:1763334964.045303:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763334964.045307:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.045314:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a27c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.046616:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a26e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.046636:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a26e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.046643:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a26e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.046648:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.046652:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a26e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.046658:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a26e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.046678:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.046681:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.046686:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a26e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.046692:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a26e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:1.0:1763334964.046709:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004bb00006 reply state 00000000dd8cf1eb transno 8589938773 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a275 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334964.046719:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334964.046842:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53005:x1848989694408320:12345-192.168.201.60@tcp:36:rm.0 Request processed in 7229us (7336us total) trans 8589938773 rc 0/0 00000100:00100000:1.0:1763334964.046852:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4530 00000100:00100000:1.0:1763334964.055634:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.055988:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694408704 00000100:00100000:3.0:1763334964.056004:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694408704 00000100:00100000:3.0:1763334964.056085:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4531 00000100:00100000:3.0:1763334964.056097:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53004:x1848989694408704:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334964.056135:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.056166:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a283 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af799 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.056311:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a28a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.056329:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a28a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.056343:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a28a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334964.056358:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 5 00010000:00010000:3.0:1763334964.056553:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a283 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af799 expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.056617:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a28a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af799 expref: 183 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.056630:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:3.0:1763334964.056633:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763334964.056638:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0030e00, rc 0) 00000100:00100000:3.0:1763334964.056723:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53004:x1848989694408704:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 626us (1103us total) trans 8589938774 rc 0/0 00000100:00100000:3.0:1763334964.056731:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4531 00010000:00010000:0.0:1763334964.056873:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a275 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.056884:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a275 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.056891:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a275 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.056897:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.056910:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a275 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.056920:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a275 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.056933:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa100) 00010000:00010000:0.0:1763334964.056936:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.056941:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a275 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.056947:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a275 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334964.066460:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.066622:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.066728:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694408832 00000100:00100000:3.0:1763334964.066742:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694408832 00000100:00100000:3.0:1763334964.067103:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694408960 00000100:00100000:3.0:1763334964.067108:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694408960 00000100:00100000:2.0:1763334964.067523:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4532 00000100:00100000:2.0:1763334964.067539:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53004:x1848989694408832:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.067602:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.067632:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a298 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7a0 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.067717:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a298 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7a0 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.067737:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a298 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7a0 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.067760:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:2.0:1763334964.067764:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334964.067769:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067c00, rc 0) 00000100:00100000:2.0:1763334964.067844:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53004:x1848989694408832:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 310us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.067853:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4532 00000100:00100000:2.0:1763334964.067879:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4533 00000100:00100000:2.0:1763334964.067886:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53006:x1848989694408960:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.067894:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.067905:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a29f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7a7 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.067972:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2a6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.067984:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2a6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.067994:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2a6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068010:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a2ad lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068017:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a2ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068024:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a2ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068108:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2a6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068116:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2a6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068124:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068131:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.068136:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068145:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2a6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068157:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.068160:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.068165:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2a6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068173:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2a6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068188:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a2ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068195:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a2ad lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068201:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a2ad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068206:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.068209:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a2ad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068215:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a2ad lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068222:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cabe00) 00010000:00010000:2.0:1763334964.068225:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.068228:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a2ad lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.068234:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a2ad lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.070462:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a29f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7a7 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.070490:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.070494:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.070500:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a29f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7a7 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.070516:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:2.0:1763334964.070724:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53006:x1848989694408960:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2834us (4098us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334964.070735:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4533 00010000:00010000:1.0:1763334964.070850:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334964.075178:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.075383:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694409088 00000100:00100000:0.0:1763334964.075399:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694409088 00000100:00080000:3.0:1763334964.076625:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1763334964.076929:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.077024:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694409216 00000100:00100000:2.0:1763334964.077035:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694409216 00000100:00100000:2.0:1763334964.077109:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4534 00000100:00100000:2.0:1763334964.077123:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53006:x1848989694409216:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.077152:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.077180:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a2b4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7ae expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.078473:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a2bb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078498:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a2bb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078513:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a2bb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078533:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a2c2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078547:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078560:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078678:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a2bb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078686:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a2bb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078693:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a2bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078699:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.078703:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a2bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078711:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a2bb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078725:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.078728:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.078734:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a2bb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078739:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a2bb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078755:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078761:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a2c2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078766:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078771:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.078774:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078780:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a2c2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078787:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa900) 00010000:00010000:1.0:1763334964.078789:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.078791:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a2c2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078797:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a2c2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.078847:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a2b4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7ae expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.078859:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.078861:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.078865:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a2b4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7ae expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.078875:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:1.0:1763334964.078966:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53006:x1848989694409216:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1845us (2042us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334964.078976:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4534 00000100:00100000:1.0:1763334964.080754:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4656 00000100:00100000:1.0:1763334964.080783:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2359:x1848989694409088:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334964.080853:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.080876:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 13 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.080886:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334964.080889:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334964.080893:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.081058:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 13 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.081077:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 13 pid: 26564 timeout: 1128 lvb_type: 0 00000100:00100000:1.0:1763334964.081098:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701818240:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334964.081530:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334964.083279:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.083382:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694409344 00000100:00100000:0.0:1763334964.083400:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694409344 00000100:00100000:0.0:1763334964.083480:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4535 00000100:00100000:0.0:1763334964.083493:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53006:x1848989694409344:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334964.083523:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.083554:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849a2d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7b5 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.083696:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a2d7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.083712:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.083726:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334964.083808:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:0.0:1763334964.083814:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334964.083840:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a2d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.083872:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849a2d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7b5 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.083894:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a2d7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7b5 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.083904:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334964.083908:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763334964.083912:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334964.083977:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53006:x1848989694409344:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 487us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.083988:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4535 00000100:00100000:2.0:1763334964.085999:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701818240:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334964.086035:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334964.086101:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.086347:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694409472 00000100:00100000:2.0:1763334964.086360:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694409472 00002000:00100000:2.0:1763334964.086435:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x224:0x0] (0->4) req@ffff9a5af59f8380 x1848989694409472/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:10/0 lens 496/0 e 0 to 0 dl 1763334975 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334964.086446:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af59f8380 with x1848989694409472 ext(0->4) 00010000:00010000:2.0:1763334964.086458:0:14384:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 14 pid: 26564 timeout: 1128 lvb_type: 0 00010000:00010000:2.0:1763334964.086475:0:14384:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 14 pid: 26564 timeout: 1128 lvb_type: 0 00002000:00010000:2.0:1763334964.086485:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a5af59f8380 00000100:00100000:2.0:1763334964.086526:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 67 00000100:00100000:2.0:1763334964.086538:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694409472:12345-192.168.201.60@tcp:4:bash.0 00000100:00100000:2.0:1763334964.087159:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694409472:12345-192.168.201.60@tcp:4:bash.0 Request processed in 620us (1055us total) trans 21474838305 rc 0/0 00000100:00100000:2.0:1763334964.087169:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 67 00002000:00100000:2.0:1763334964.087176:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x224:0x0] (0->4) req@ffff9a5af59f8380 x1848989694409472/t21474838305(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:10/0 lens 496/448 e 0 to 0 dl 1763334975 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334964.087185:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af59f8380 with x1848989694409472 ext(0->4) 00010000:00010000:2.0:1763334964.087192:0:14384:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 16 pid: 26564 timeout: 1128 lvb_type: 0 00010000:00010000:2.0:1763334964.087205:0:14384:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 16 pid: 26564 timeout: 1128 lvb_type: 0 00002000:00010000:2.0:1763334964.087212:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a5af59f8380 00000100:00100000:2.0:1763334964.088879:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.089081:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694409600 00000100:00100000:3.0:1763334964.089094:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694409600 00000100:00100000:2.0:1763334964.090025:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4536 00000100:00100000:2.0:1763334964.090048:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53006:x1848989694409600:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.090077:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.090112:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a2de lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7bc expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.090668:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2e5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090687:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2e5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090700:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2e5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090716:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a2ec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090723:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a2ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090729:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a2ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090813:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2e5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090819:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2e5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090826:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090833:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.090838:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2e5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090846:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2e5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090861:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.090865:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.090871:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090878:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a2e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090892:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a2ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.090897:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a2ec lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.091151:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a2ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.091157:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.091160:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a2ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.091167:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a2ec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.091176:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cabe00) 00010000:00010000:2.0:1763334964.091178:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.091181:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a2ec lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.091186:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a2ec lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.091229:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a2de lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7bc expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.091241:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.091244:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.091248:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a2de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7bc expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.091338:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:2.0:1763334964.091408:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53006:x1848989694409600:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1369us (2541us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334964.091417:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4536 00000100:00100000:0.0:1763334964.091459:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.091699:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694409728 00000100:00100000:3.0:1763334964.091710:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694409728 00010000:00010000:3.0:1763334964.091834:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 16 pid: 26564 timeout: 1128 lvb_type: 0 00000100:00100000:3.0:1763334964.091997:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2469 00000100:00100000:3.0:1763334964.092008:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694409728:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334964.092023:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1763334964.092046:0:11727:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb size from disk: 0 -> 5 00010000:00010000:3.0:1763334964.092052:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 16 pid: 26564 timeout: 1128 lvb_type: 0 00010000:00010000:3.0:1763334964.092065:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 16 pid: 26564 timeout: 1128 lvb_type: 0 00010000:00010000:3.0:1763334964.092091:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a1f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af768 expref: 16 pid: 26564 timeout: 1128 lvb_type: 0 00010000:00010000:3.0:1763334964.092106:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.092108:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.092113:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.092125:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.092166:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334964.092277:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.092287:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.092318:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.092328:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.092335:0:7819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.092340:0:7819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334964.092344:0:7819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.092350:0:7819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.092361:0:7819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.092367:0:7819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a2c9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334964.092400:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694409728:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 394us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.092409:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2469 00000100:00100000:1.0:1763334964.092417:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694409088:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 11646us (17254us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.092426:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4656 00000100:00100000:0.0:1763334964.093905:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.094024:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694409984 00000100:00100000:2.0:1763334964.094037:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694409984 00000100:00100000:2.0:1763334964.094106:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4537 00000100:00100000:2.0:1763334964.094117:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53006:x1848989694409984:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.094140:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.094143:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334964.094173:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a2d7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7b5 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.094192:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.094196:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334964.094215:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a2f3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7c3 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.094405:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f849a2fa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.094422:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f849a2fa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.094436:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f849a2fa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.094451:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a301 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.094459:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a301 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.094465:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a301 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.095206:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a308 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.095224:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a308 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.095233:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a308 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334964.095245:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x190:0x0]: returning size 0 00010000:00010000:2.0:1763334964.095290:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f849a2fa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.095297:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f849a2fa lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.095305:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f849a2fa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.095312:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.095317:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f849a2fa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.095326:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f849a2fa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.095336:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.095339:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.095343:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f849a2fa lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.095350:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f849a2fa lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:2.0:1763334964.095363:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d404f13c reply state 000000001269d3a8 transno 8589938775 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a301 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334964.095372:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334964.095406:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a2f3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7c3 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.095420:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a308 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7c3 expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.095428:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334964.095430:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334964.095433:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:2.0:1763334964.095521:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53006:x1848989694409984:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1406us (1626us total) trans 8589938775 rc 0/0 00000100:00100000:2.0:1763334964.095531:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4537 00000100:00100000:0.0:1763334964.096637:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.096723:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694410240 00000100:00100000:1.0:1763334964.096737:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694410240 00000100:00100000:1.0:1763334964.096794:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4538 00000100:00100000:1.0:1763334964.096805:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53004:x1848989694410240:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334964.096865:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334964.096891:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a298 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7a0 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.096910:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:1.0:1763334964.096915:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334964.096949:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a316 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.096962:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a316 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.096970:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a316 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:1.0:1763334964.097450:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1047, 88 off90088 00000004:00080000:1.0:1763334964.097464:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028730891365ns, next at 1029092096998ns, rc = 0 00000040:00080000:1.0:1763334964.097537:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1059, 88 off91200 00000004:00080000:1.0:1763334964.097545:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1028730972795ns, next at 1029092157246ns, rc = 0 00000040:00080000:1.0:1763334964.097607:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1060, 88 off91288 00000004:00080000:1.0:1763334964.097613:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1028731041039ns, next at 1029092157246ns, rc = 0 00000040:00080000:1.0:1763334964.097677:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1049, 88 off90200 00000004:00080000:1.0:1763334964.097682:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028731110775ns, next at 1029092096998ns, rc = 0 00000100:00100000:3.0:1763334964.101717:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334964.102234:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a301 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334964.102639:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694410496 00000100:00100000:3.0:1763334964.102657:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694410496 00000100:00100000:3.0:1763334964.102903:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4539 00000100:00100000:3.0:1763334964.102918:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53006:x1848989694410496:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.103147:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a301 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.103157:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a301 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.103160:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.103164:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.103171:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a301 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.103180:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a301 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.103188:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a31d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7ca expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.103201:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab600) 00010000:00010000:2.0:1763334964.103204:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.103212:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a301 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.103218:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a301 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.103339:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.103361:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a308 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7c3 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.103370:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.103417:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a308 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7c3 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.103435:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a308 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7c3 expref: 187 pid: 32232 timeout: 1128 lvb_type: 0 00000100:00100000:3.0:1763334964.103454:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeef9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701818368:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334964.104480:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0adf00 going to sleep for 11 seconds 00000100:00100000:3.0:1763334964.107750:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeef9c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701818368:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334964.107791:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334964.107851:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.108145:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694410624 00000100:00100000:3.0:1763334964.108156:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694410624 00010000:00010000:3.0:1763334964.108549:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a308 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7c3 expref: 188 pid: 32232 timeout: 1128 lvb_type: 0 00000100:00100000:3.0:1763334964.108615:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2470 00000100:00100000:3.0:1763334964.108628:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:2359:x1848989694410624:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334964.108648:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334964.108657:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a308 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7c3 expref: 188 pid: 32232 timeout: 1128 lvb_type: 0 00010000:00010000:3.0:1763334964.108673:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a308 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7c3 expref: 188 pid: 32232 timeout: 1128 lvb_type: 0 00010000:00010000:3.0:1763334964.108704:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a308 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7c3 expref: 188 pid: 32232 timeout: 1128 lvb_type: 0 00010000:00010000:3.0:1763334964.108727:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:3.0:1763334964.108734:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.108746:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.108756:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.108792:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334964.108872:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:2359:x1848989694410624:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 246us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.108881:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2470 00010000:00010000:0.0:1763334964.109334:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.109345:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334964.109370:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x190:0x0]: returning size 0 00000004:00080000:0.0:1763334964.110070:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22a:0x0], index 1: 0 00000004:00080000:0.0:1763334964.110085:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x226:0x0], index 0: 0 00000004:00080000:0.0:1763334964.110092:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x227:0x0], index 0: 0 00000004:00080000:0.0:1763334964.110097:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22b:0x0], index 1: 0 00010000:00010000:0.0:1763334964.110344:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.110359:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.110367:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.110374:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac0031600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.110380:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.110389:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.110406:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:0.0:1763334964.110409:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334964.110414:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.110419:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031600/0xcedf0054f849a324 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.110497:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a31d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7ca expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.110508:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334964.110510:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334964.110515:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031000/0xcedf0054f849a31d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7ca expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.110524:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac0031000, rc 0) 00000100:00100000:0.0:1763334964.110702:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53006:x1848989694410496:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7786us (8999us total) trans 8589938777 rc 301/301 00000100:00100000:0.0:1763334964.110711:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4539 00000100:00100000:1.0:1763334964.115243:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.115564:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694410880 00000100:00100000:2.0:1763334964.115623:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694410880 00000100:00100000:2.0:1763334964.115700:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1674 00000100:00100000:2.0:1763334964.115712:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53006:x1848989694410880:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334964.116251:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53006:x1848989694410880:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 538us (1020us total) trans 8589938778 rc 0/0 00000100:00100000:2.0:1763334964.116262:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1674 00000100:00100000:1.0:1763334964.119207:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.119376:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694411136 00000100:00100000:0.0:1763334964.119464:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694411136 00000100:00100000:2.0:1763334964.119795:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1675 00000100:00100000:2.0:1763334964.119812:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53006:x1848989694411136:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334964.120136:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53006:x1848989694411136:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 328us (940us total) trans 8589938779 rc 0/0 00000100:00100000:2.0:1763334964.120144:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1675 00000100:00100000:0.0:1763334964.129813:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.129963:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694411392 00000100:00100000:1.0:1763334964.129979:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694411392 00000100:00100000:1.0:1763334964.130045:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4540 00000100:00100000:1.0:1763334964.130057:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694411392:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334964.130087:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.130119:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a332 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7d1 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.130389:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a339 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130408:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a339 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130423:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a339 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130439:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a340 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130445:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a340 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130452:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a340 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130545:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a347 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130554:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a347 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130560:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a347 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334964.130609:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x190:0x0]: returning size 0 00010000:00010000:1.0:1763334964.130749:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a339 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130758:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a339 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130765:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a339 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130770:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.130775:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a339 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130783:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a339 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130796:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.130799:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.130805:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a339 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130811:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a339 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130824:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a340 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130830:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a340 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130836:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a340 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130840:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.130843:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a340 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130852:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a340 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130858:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa900) 00010000:00010000:1.0:1763334964.130861:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.130864:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a340 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130870:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a340 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.130915:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a332 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7d1 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.130928:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a347 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7d1 expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.130935:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5ad28fa700) 00010000:00010000:1.0:1763334964.130937:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334964.130940:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:1.0:1763334964.131024:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52274:x1848989694411392:12345-192.168.201.60@tcp:101:bash.0 Request processed in 968us (1229us total) trans 8589938780 rc 0/0 00000100:00100000:1.0:1763334964.131035:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4540 00000100:00100000:2.0:1763334964.134978:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.135057:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694411648 00000100:00100000:1.0:1763334964.135073:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694411648 00000100:00100000:1.0:1763334964.135145:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4541 00000100:00100000:1.0:1763334964.135159:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52274:x1848989694411648:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1763334964.135236:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334964.135871:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a347 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7d1 expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.135893:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5ad28fa700) 00010000:00010000:1.0:1763334964.135905:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334964.136318:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a355 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.136337:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a355 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.136350:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a355 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:1.0:1763334964.136419:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938781 00000004:00010000:1.0:1763334964.136447:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dba22d28 reply state 000000004ba65d24 transno 8589938782 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a355 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334964.136457:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1763334964.136562:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938776 is committed 00000004:00080000:0.0:1763334964.136612:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 687 committed 00000004:00080000:0.0:1763334964.136627:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 699 committed 00000004:00080000:0.0:1763334964.136636:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 698 committed 00000004:00080000:0.0:1763334964.136639:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 686 committed 00000100:00100000:1.0:1763334964.136660:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694411648:12345-192.168.201.60@tcp:36:bash.0 Request processed in 1502us (1696us total) trans 8589938782 rc 0/0 00000100:00100000:1.0:1763334964.136671:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4541 00000020:00080000:1.0:1763334964.136678:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000004:00010000:1.0:1763334964.136718:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bee7e768 reply state 0000000088543844 transno 8589938776 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a316 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334964.136727:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1763334964.136771:0:30972:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763334964.136785:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53004:x1848989694410240:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 39983us (40157us total) trans 8589938776 rc 0/0 00000100:00100000:1.0:1763334964.136793:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4538 00010000:00010000:0.0:1763334964.136849:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a316 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334964.136852:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701818624:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763334964.136859:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a316 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.136868:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a316 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.136874:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.136879:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a316 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.136888:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a316 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.136900:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:0.0:1763334964.136903:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334964.136909:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a316 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.136914:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a316 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334964.136923:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334964.136940:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701818496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334964.136971:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334964.137365:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763334964.137374:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701818880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334964.137454:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.137719:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701818624 00000100:00100000:1.0:1763334964.137729:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701818624 00000100:00100000:0.0:1763334964.137732:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701818752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334964.137758:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.137785:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701818496 00000100:00100000:1.0:1763334964.137788:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701818496 00000100:00100000:0.0:1763334964.137788:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701818880 00000100:00100000:0.0:1763334964.137791:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701818880 00000100:00100000:1.0:1763334964.137804:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701818752 00000100:00100000:1.0:1763334964.137807:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701818752 00000100:00100000:0.0:1763334964.137824:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4657 00000100:00100000:0.0:1763334964.137834:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+42:3291:x1848989701818624:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1763334964.137865:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1763334964.137870:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1763334964.137986:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4658 00000100:00100000:1.0:1763334964.137994:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+42:3290:x1848989701818496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334964.138172:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334964.138176:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb mtime from disk: 1763334964 -> 1763334964 00002000:00010000:1.0:1763334964.138178:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334964.138180:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb ctime from disk: 1763334964 -> 1763334964 00002000:00010000:1.0:1763334964.138182:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334964.138223:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+43:3290:x1848989701818496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 230us (1251us total) trans 17179871023 rc 0/0 00000100:00100000:1.0:1763334964.138229:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4658 00000100:00100000:1.0:1763334964.138246:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4659 00000100:00100000:1.0:1763334964.138262:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3290:x1848989701818880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334964.138367:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+43:3291:x1848989701818624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 534us (1443us total) trans 17179871024 rc 0/0 00000100:00100000:0.0:1763334964.138375:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4657 00000100:00100000:1.0:1763334964.138381:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3290:x1848989701818880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (927us total) trans 21474838306 rc 0/0 00000100:00100000:1.0:1763334964.138386:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4659 00000100:00100000:0.0:1763334964.138389:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4660 00000100:00100000:0.0:1763334964.138668:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3292:x1848989701818752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334964.138797:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3292:x1848989701818752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (1037us total) trans 21474838307 rc 0/0 00000100:00100000:0.0:1763334964.138803:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4660 00000004:00080000:3.0:1763334964.138851:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5574380/2, rc 0, transno 21474838307 00000100:00100000:3.0:1763334964.138858:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701818752:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334964.138922:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa5fb480/2, rc 0, transno 17179871024 00000100:00100000:1.0:1763334964.138929:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701818624:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334964.138951:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5576680/2, rc 0, transno 21474838306 00000100:00100000:1.0:1763334964.138954:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701818880:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334964.138965:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa5f8700/2, rc 0, transno 17179871023 00000100:00100000:1.0:1763334964.138968:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701818496:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763334964.139951:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a355 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.139969:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a355 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.139978:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a355 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.139985:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.139991:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a355 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.140000:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a355 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.140021:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:0.0:1763334964.140025:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.140031:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a355 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.140043:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a355 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x190:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334964.140436:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.140526:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.140626:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694411776 00000100:00100000:1.0:1763334964.140640:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694411776 00000100:00100000:1.0:1763334964.140696:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694411904 00000100:00100000:1.0:1763334964.140700:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694411904 00000100:00100000:0.0:1763334964.140704:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4542 00000100:00100000:0.0:1763334964.140717:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52274:x1848989694411776:12345-192.168.201.60@tcp:101:bash.0 00000100:00100000:1.0:1763334964.140719:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4543 00000100:00100000:1.0:1763334964.140724:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53004:x1848989694411904:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.140744:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.140744:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.140765:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a35c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7df expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.140765:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a363 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7d8 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.140830:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a35c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7df expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.140830:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a363 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7d8 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.140846:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a35c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7df expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.140846:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a363 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7d8 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.140864:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:0.0:1763334964.140864:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5ac51bd000) 00010000:00010000:1.0:1763334964.140867:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334964.140867:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334964.140871:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00010000:00010000:0.0:1763334964.140871:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793800, rc 0) 00000100:00100000:1.0:1763334964.140926:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53004:x1848989694411904:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 201us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.140933:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4543 00000100:00100000:0.0:1763334964.141144:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52274:x1848989694411776:12345-192.168.201.60@tcp:101:bash.0 Request processed in 429us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.141151:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4542 00000100:00100000:2.0:1763334964.143821:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.143913:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.143943:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694412032 00000100:00100000:0.0:1763334964.143957:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694412032 00000100:00100000:0.0:1763334964.144080:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694412288 00000100:00100000:0.0:1763334964.144085:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694412288 00000100:00100000:1.0:1763334964.144124:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4544 00000100:00100000:1.0:1763334964.144139:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53004:x1848989694412032:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.144166:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.144194:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a36a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7e6 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.144305:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a371 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.144325:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a371 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334964.144326:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4545 00000100:00100000:3.0:1763334964.144337:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52274:x1848989694412288:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334964.144339:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a371 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.144345:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.144348:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334964.144375:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a363 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7d8 expref: 184 pid: 32232 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1763334964.144392:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x18f:0x0]: returning size 5 00000004:00200000:1.0:1763334964.144397:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334964.144420:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a371 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.144449:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a36a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7e6 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.144464:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a371 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7e6 expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.144475:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:1.0:1763334964.144479:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763334964.144483:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334964.144569:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53004:x1848989694412032:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 434us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.144603:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4544 00010000:00010000:3.0:1763334964.144776:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5ac51bd000) 00010000:00010000:3.0:1763334964.144791:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334964.144806:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a378 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7ed expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.144851:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a37f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.144861:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a37f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.144871:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a37f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334964.148285:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000040:00080000:2.0:1763334964.148662:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1061, 88 off91376 00000004:00080000:2.0:1763334964.148682:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1028782108911ns, next at 1029092157246ns, rc = 0 00000040:00080000:2.0:1763334964.148786:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1050, 88 off90288 00000004:00080000:2.0:1763334964.148792:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028782219941ns, next at 1029092096998ns, rc = 0 00000040:00080000:2.0:1763334964.148827:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1051, 88 off90376 00000004:00080000:2.0:1763334964.148832:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028782260396ns, next at 1029092096998ns, rc = 0 00000040:00080000:2.0:1763334964.148847:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1062, 88 off91464 00000004:00080000:2.0:1763334964.148850:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1028782278381ns, next at 1029092157246ns, rc = 0 00000100:00100000:3.0:1763334964.149135:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694412416 00000100:00100000:3.0:1763334964.149149:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694412416 00000100:00100000:3.0:1763334964.149219:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4661 00000100:00100000:3.0:1763334964.149234:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694412416:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334964.149266:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.149305:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a386 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7f4 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334964.149335:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x224:0x0] initial LVB size: 5, mtime: 0x691a5b34, atime: 0x0, ctime: 0x691a5b34, blocks: 0x1 00010000:00010000:3.0:1763334964.149364:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.149366:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.149381:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a386 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7f4 expref: 15 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334964.149488:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a386 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7f4 expref: 15 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334964.149508:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168ee00, rc 0) 00000100:00100000:3.0:1763334964.149629:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2361:x1848989694412416:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 398us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.149638:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4661 00000001:00080000:3.0:1763334964.209937:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938777 is committed 00000001:00080000:3.0:1763334964.209978:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938782 is committed 00000001:00080000:0.0:1763334964.210172:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938783 is committed 00000004:00080000:0.0:1763334964.210179:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 701 committed 00000004:00080000:0.0:1763334964.210201:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 689 committed 00010000:00010000:1.0:1763334964.210208:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a37f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x190:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7ed expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763334964.210213:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 688 committed 00000004:00080000:0.0:1763334964.210216:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 700 committed 00010000:00010000:1.0:1763334964.210238:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5acbb5ee00) 00010000:00010000:1.0:1763334964.210243:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334964.210284:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a378 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x190:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7ed expref: 178 pid: 29627 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763334964.210314:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a37f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x190:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7ed expref: 177 pid: 29627 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334964.210362:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1763334964.210370:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5acbb5ee00) 00010000:00010000:1.0:1763334964.210373:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334964.210376:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f600, rc 0) 00000100:00100000:0.0:1763334964.210390:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701819008:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334964.210472:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334964.210483:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701819136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334964.210483:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:52274:x1848989694412288:12345-192.168.201.60@tcp:101:bash.0 Request processed in 66146us (66567us total) trans 8589938783 rc 0/0 00000100:00100000:1.0:1763334964.210494:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4545 00000100:00100000:1.0:1763334964.210548:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763334964.210560:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af68cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701819264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334964.210959:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334964.211179:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701819392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334964.211205:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334964.212357:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701819008 00000100:00100000:2.0:1763334964.212375:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701819008 00000100:00100000:1.0:1763334964.212440:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.212478:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701819392 00000100:00100000:0.0:1763334964.212480:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701819264 00000100:00100000:1.0:1763334964.212483:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701819392 00000100:00100000:0.0:1763334964.212484:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701819264 00000100:00100000:0.0:1763334964.212522:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4662 00000100:00100000:0.0:1763334964.212533:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+19:3289:x1848989701819008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334964.212652:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4663 00000100:00100000:1.0:1763334964.212660:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+44:3291:x1848989701819264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334964.213047:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4664 00000100:00100000:3.0:1763334964.213057:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3289:x1848989701819392:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334964.214672:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.216021:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+46:3291:x1848989701819264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3348us (3570us total) trans 17179871025 rc 0/0 00000100:00100000:1.0:1763334964.216041:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4663 00000100:00100000:1.0:1763334964.216103:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701819136 00000100:00100000:1.0:1763334964.216116:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701819136 00000100:00100000:1.0:1763334964.216179:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4665 00000100:00100000:1.0:1763334964.216190:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3292:x1848989701819136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334964.216416:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+21:3289:x1848989701819008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3883us (5455us total) trans 21474838308 rc 0/0 00000100:00100000:0.0:1763334964.216425:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4662 00000100:00100000:1.0:1763334964.216584:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3292:x1848989701819136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 381us (1912us total) trans 21474838309 rc 0/0 00000100:00100000:1.0:1763334964.216592:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4665 00000004:00080000:0.0:1763334964.216626:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5b01f2c700/2, rc 0, transno 21474838308 00000100:00100000:0.0:1763334964.216633:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701819008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334964.216642:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af68cd500/2, rc 0, transno 17179871025 00000100:00100000:1.0:1763334964.216647:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af68cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701819264:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334964.216920:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+45:3289:x1848989701819392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3863us (5711us total) trans 17179871026 rc 0/0 00000100:00100000:3.0:1763334964.216930:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4664 00000004:00080000:1.0:1763334964.217038:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d5180/2, rc 0, transno 17179871026 00000100:00100000:1.0:1763334964.217044:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701819392:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763334964.217188:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5b01f2c380/2, rc 0, transno 21474838309 00000100:00100000:2.0:1763334964.217194:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701819136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334964.217402:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.217709:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694412544 00000100:00100000:2.0:1763334964.217717:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694412544 00000100:00100000:2.0:1763334964.217779:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4666 00000100:00100000:2.0:1763334964.217787:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+30:52274:x1848989694412544:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334964.217803:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.217829:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a38d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af7fb expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334964.217860:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334964.217888:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334964.217891:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334964.217904:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a38d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7fb expref: 31 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.217925:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a38d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7fb expref: 31 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.217942:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067400, rc 0) 00000100:00100000:2.0:1763334964.218013:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+31:52274:x1848989694412544:12345-192.168.201.60@tcp:101:bash.0 Request processed in 226us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.218019:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4666 00000100:00080000:3.0:1763334964.218089:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1763334964.223082:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.223218:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694412672 00000100:00100000:0.0:1763334964.223233:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694412672 00000100:00100000:0.0:1763334964.223349:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1712 00000100:00100000:0.0:1763334964.223361:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694412672:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334964.223440:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a394 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.223460:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.223463:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.223471:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a394 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.223487:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a394 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.223679:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a394 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.223689:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a394 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.223697:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.223705:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334964.223710:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.223721:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a394 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.223740:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a394 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.223748:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a394 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334964.223832:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694412672:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 472us (772us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334964.223845:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1712 00000100:00100000:1.0:1763334964.224198:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.225412:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694412800 00000100:00100000:0.0:1763334964.225426:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694412800 00000100:00100000:0.0:1763334964.226048:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4667 00000100:00100000:0.0:1763334964.226111:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+15:52274:x1848989694412800:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334964.226138:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.226169:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a39b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af802 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334964.226204:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x226:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334964.226228:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.226230:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.226241:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a39b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af802 expref: 16 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.226257:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a39b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af802 expref: 16 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.226279:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334964.227049:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+16:52274:x1848989694412800:12345-192.168.201.60@tcp:101:bash.0 Request processed in 982us (2845us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.227060:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4667 00000100:00100000:3.0:1763334964.230769:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.231560:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694412928 00000100:00100000:2.0:1763334964.231689:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694412928 00000100:00100000:2.0:1763334964.231805:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4546 00000100:00100000:2.0:1763334964.231817:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+177:53004:x1848989694412928:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.231847:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.231873:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a3a2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af809 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.231918:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a3a9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.231936:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.231955:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a3a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.232159:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a3a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af809 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.232180:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067a00/0xcedf0054f849a3a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af809 expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.232190:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:2.0:1763334964.232194:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1763334964.232198:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067a00, rc 0) 00000100:00100000:2.0:1763334964.232377:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53004:x1848989694412928:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 561us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.232386:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4546 00000100:00100000:1.0:1763334964.234895:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.234955:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694413184 00000100:00100000:2.0:1763334964.234968:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694413184 00002000:00010000:2.0:1763334964.235024:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/550 (0->18446744073709551615) 00002000:00100000:2.0:1763334964.235030:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa3ad880 with x1848989694413184 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334964.235046:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa3ad880. 00000100:00100000:1.0:1763334964.235564:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.236243:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694413056 00000100:00100000:2.0:1763334964.236255:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694413056 00002000:00010000:2.0:1763334964.236309:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/554 (0->18446744073709551615) 00002000:00100000:2.0:1763334964.236315:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa3ac700 with x1848989694413056 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334964.236329:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa3ac700. 00000100:00100000:3.0:1763334964.236331:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1713 00000100:00100000:3.0:1763334964.236348:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694413184:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:2.0:1763334964.236360:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1714 00000100:00100000:2.0:1763334964.236367:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694413056:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334964.236827:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x226:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334964.236828:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334964.236832:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22a:0x0] updating lvb mtime from disk: 0 -> 1763334964 00002000:00010000:3.0:1763334964.236833:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x226:0x0] updating lvb mtime from disk: 0 -> 1763334964 00002000:00010000:3.0:1763334964.236836:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x226:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334964.236836:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334964.236839:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x226:0x0] updating lvb ctime from disk: 0 -> 1763334964 00002000:00010000:2.0:1763334964.236839:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22a:0x0] updating lvb ctime from disk: 0 -> 1763334964 00002000:00010000:2.0:1763334964.236842:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22a:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:3.0:1763334964.236843:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x226:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334964.237129:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694413184:12345-192.168.201.60@tcp:10:bash.0 Request processed in 782us (2242us total) trans 21474838310 rc 0/0 00000100:00100000:3.0:1763334964.237140:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1713 00002000:00010000:3.0:1763334964.237146:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/550 (0->18446744073709551615) 00002000:00100000:3.0:1763334964.237149:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa3ad880 with x1848989694413184 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334964.237156:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa3ad880. 00000100:00100000:3.0:1763334964.237196:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.237309:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694413312 00000100:00100000:0.0:1763334964.237317:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694413312 00000100:00100000:0.0:1763334964.237360:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1715 00000100:00100000:0.0:1763334964.237370:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2360:x1848989694413312:12345-192.168.201.60@tcp:4:lfs.0 00002000:00010000:0.0:1763334964.237422:0:6522:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x229:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334964.237432:0:6522:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a3b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.237450:0:6522:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.237453:0:6522:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.237460:0:6522:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.237476:0:6522:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334964.239323:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+35:2360:x1848989694413056:12345-192.168.201.60@tcp:10:bash.0 Request processed in 2935us (3741us total) trans 17179871027 rc 0/0 00000100:00100000:2.0:1763334964.239341:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1714 00002000:00010000:2.0:1763334964.239348:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/554 (0->18446744073709551615) 00002000:00100000:2.0:1763334964.239352:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa3ac700 with x1848989694413056 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334964.239367:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa3ac700. 00000100:00100000:2.0:1763334964.251940:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.256666:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694413568 00000100:00100000:1.0:1763334964.256693:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694413568 00000100:00100000:1.0:1763334964.256784:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1676 00000100:00100000:1.0:1763334964.256798:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52274:x1848989694413568:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:1.0:1763334964.257469:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52274:x1848989694413568:12345-192.168.201.60@tcp:35:bash.0 Request processed in 669us (5544us total) trans 8589938784 rc 0/0 00000100:00100000:1.0:1763334964.257481:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1676 00000100:00100000:1.0:1763334964.275212:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.275741:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694413696 00000100:00100000:3.0:1763334964.275757:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694413696 00000100:00100000:3.0:1763334964.275832:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4547 00000100:00100000:3.0:1763334964.275845:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53007:x1848989694413696:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:3.0:1763334964.275938:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.275969:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a3b7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af810 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.276066:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a3be lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276085:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a3be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276098:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a3be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276115:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a3c5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276123:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276134:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276306:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a3cc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276316:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a3cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276323:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a3cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334964.276371:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x190:0x0]: returning size 5 00000004:00200000:3.0:1763334964.276376:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334964.276399:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a3cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276412:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a3cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276420:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a3be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276427:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a3be lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276434:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a3be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276440:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168fe00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.276444:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a3be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276453:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a3be lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276468:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334964.276472:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.276478:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a3be lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276483:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a3be lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276499:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276505:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a3c5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276510:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a3c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276515:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.276518:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a3c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276523:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a3c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276530:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac81fa200) 00010000:00010000:3.0:1763334964.276532:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.276534:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a3c5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276539:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a3c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.276614:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a3b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af810 expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.276631:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a3cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af810 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.276639:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5acbb5ee00) 00010000:00010000:3.0:1763334964.276642:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334964.276645:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c6e00, rc 0) 00000100:00100000:3.0:1763334964.276725:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53007:x1848989694413696:12345-192.168.201.60@tcp:101:rm.0 Request processed in 882us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.276733:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4547 00000100:00100000:0.0:1763334964.282137:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.282421:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694413952 00000100:00100000:2.0:1763334964.282436:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694413952 00000100:00100000:2.0:1763334964.282508:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4548 00000100:00100000:2.0:1763334964.282520:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53007:x1848989694413952:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:2.0:1763334964.282621:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1763334964.282661:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a3cc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x190:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af810 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.282686:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a37f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x190:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7ed expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.282698:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5acbb5ee00) 00010000:00010000:2.0:1763334964.282711:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334964.282744:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a3d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.282763:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a3d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.282774:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a3d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.282789:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a3da lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.282797:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a3da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.282803:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a3da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.282952:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a3e1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.282960:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a3e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.282968:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a3e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:2.0:1763334964.283607:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1063, 64 off91528 00000040:00080000:2.0:1763334964.283663:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1052, 64 off90440 00000040:00080000:2.0:1763334964.283680:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1053, 64 off90504 00000040:00080000:2.0:1763334964.283694:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1064, 64 off91592 00010000:00010000:2.0:1763334964.283777:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a3e8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x190:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.283789:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a3e8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.283803:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a3e8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.283811:0:30972:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a3e8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.283818:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a3e8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.283825:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a3e8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.283846:0:30972:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334964.283873:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a3e1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.283879:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a3e1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.283886:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a3e1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.283893:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.283898:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a3e1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.283907:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a3e1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.283917:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5ac6cab700) 00010000:00010000:2.0:1763334964.283919:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763334964.283924:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a3e1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.283933:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a3e1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x190:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.284005:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a3d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.284011:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a3d3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.284016:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a3d3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.284021:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.284024:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a3d3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.284030:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a3d3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.284037:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.284039:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.284042:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a3d3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.284048:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a3d3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:2.0:1763334964.284057:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000062fd2c0 reply state 00000000ea70c0c7 transno 8589938785 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a3da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334964.284067:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334964.284182:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53007:x1848989694413952:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1661us (2059us total) trans 8589938785 rc 0/0 00000100:00100000:2.0:1763334964.284197:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4548 00010000:00010000:1.0:1763334964.284562:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334964.284590:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a3e8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.284597:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334964.284601:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a3e8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.284607:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a3e8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.284618:0:5737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x190:0x0].0x0 (ffff9a5ac6cab700) 00010000:00010000:1.0:1763334964.284621:0:5737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763334964.284624:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a3e8 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.284630:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a3e8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x190:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.284645:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.284648:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.284650:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334964.287409:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a3da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.287429:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a3da lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.287437:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a3da lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.287443:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.287448:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a3da lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.287455:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a3da lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.287472:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334964.287475:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.287479:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a3da lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.287486:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a3da lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334964.302234:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.302717:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694414080 00000100:00100000:3.0:1763334964.302732:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694414080 00000100:00100000:3.0:1763334964.302806:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4549 00000100:00100000:3.0:1763334964.302819:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53008:x1848989694414080:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334964.302849:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.302878:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a3ef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af817 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.302965:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a3f6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.302983:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a3f6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.302996:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a3f6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303013:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a3fd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303024:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a3fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303031:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a3fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303113:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a3f6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303120:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a3f6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303127:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a3f6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303134:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.303138:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a3f6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303147:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a3f6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303160:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334964.303164:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.303169:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a3f6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303175:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a3f6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303190:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a3fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303196:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a3fd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303202:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a3fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303206:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.303209:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a3fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303214:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a3fd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303220:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac81fa200) 00010000:00010000:3.0:1763334964.303223:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.303225:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a3fd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303230:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a3fd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.303277:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a3ef lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af817 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.303289:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334964.303291:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.303295:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a3ef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af817 expref: 180 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.303305:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7800, rc 0) 00000100:00100000:3.0:1763334964.303391:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53008:x1848989694414080:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 574us (1172us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334964.303401:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4549 00000100:00100000:1.0:1763334964.308391:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.308904:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694414208 00000100:00100000:2.0:1763334964.308921:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694414208 00000100:00100000:2.0:1763334964.308988:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4550 00000100:00100000:2.0:1763334964.309001:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53008:x1848989694414208:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.309027:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.309055:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a404 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af81e expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.309218:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a40b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309236:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a40b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309248:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a40b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309439:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a412 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309447:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309455:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309539:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a40b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309547:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a40b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309555:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a40b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309562:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.309567:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a40b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309617:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a40b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309632:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.309636:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.309642:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a40b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309648:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a40b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309663:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a412 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309669:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a412 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309676:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a412 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309681:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.309684:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a412 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309690:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a412 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309698:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab700) 00010000:00010000:2.0:1763334964.309700:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.309703:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a412 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309709:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a412 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.309750:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a404 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af81e expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.309761:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.309764:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.309767:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a404 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af81e expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.309779:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:2.0:1763334964.309868:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53008:x1848989694414208:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 869us (1498us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334964.309877:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4550 00000100:00100000:1.0:1763334964.313220:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.313481:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694414336 00000100:00100000:3.0:1763334964.313499:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694414336 00000100:00100000:3.0:1763334964.313794:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4551 00000100:00100000:3.0:1763334964.313807:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53008:x1848989694414336:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334964.313836:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.313865:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a419 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af825 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.313993:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a420 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.314013:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a420 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.314028:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a420 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334964.314108:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334964.314113:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334964.314139:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a420 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.314172:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a419 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af825 expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.314193:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a420 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af825 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.314203:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334964.314207:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334964.314211:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7800, rc 0) 00000100:00100000:3.0:1763334964.314319:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53008:x1848989694414336:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 514us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.314327:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4551 00000100:00100000:0.0:1763334964.318192:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.318422:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694414464 00000100:00100000:3.0:1763334964.318436:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694414464 00000100:00100000:3.0:1763334964.318502:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4552 00000100:00100000:3.0:1763334964.318513:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53008:x1848989694414464:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334964.318538:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.318565:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a427 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af82c expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.318707:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a42e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318726:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a42e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318738:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a42e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318755:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a435 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318762:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a435 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318769:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a435 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318856:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a42e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318865:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a42e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318873:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a42e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318879:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.318885:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a42e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318894:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a42e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318910:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334964.318913:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.318920:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a42e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318928:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a42e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318942:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a435 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318948:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a435 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318954:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a435 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318959:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c6e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.318962:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a435 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318968:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a435 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318976:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5ee00) 00010000:00010000:3.0:1763334964.318978:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.318981:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a435 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.318988:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a435 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.319027:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a427 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af82c expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.319038:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334964.319041:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.319045:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a427 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af82c expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.319056:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7200, rc 0) 00000100:00100000:3.0:1763334964.319142:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53008:x1848989694414464:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 630us (965us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334964.319151:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4552 00000100:00100000:0.0:1763334964.322509:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.322666:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694414720 00000001:00080000:1.0:1763334964.322679:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871028 is committed 00000100:00100000:2.0:1763334964.322681:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694414720 00000001:00080000:1.0:1763334964.322695:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871024 is committed 00000100:00100000:2.0:1763334964.322746:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4553 00000001:00080000:1.0:1763334964.322746:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871025 is committed 00000100:00100000:2.0:1763334964.322755:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53008:x1848989694414720:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.322780:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.322783:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334964.322816:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a420 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af825 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.322841:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.322847:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00080000:1.0:1763334964.322849:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871026 is committed 00010000:00010000:2.0:1763334964.322861:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a43c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af833 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.323039:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a443 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.323056:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a443 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00002000:00010000:0.0:1763334964.323083:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763334964.323087:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb mtime from disk: 0 -> 1763334964 00002000:00010000:0.0:1763334964.323090:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb ctime from disk: 0 -> 1763334964 00002000:00010000:0.0:1763334964.323092:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1763334964.323105:0:6522:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a3b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.323116:0:6522:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a3b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.323125:0:6522:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a3b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.323132:0:6522:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334964.323137:0:6522:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a3b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.323147:0:6522:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a3b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.323165:0:6522:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a3b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.323178:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a3b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.323650:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a443 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.323672:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a44a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.323679:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a44a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.323685:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a44a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334964.324031:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694413312:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 86657us (86829us total) trans 17179871028 rc 0/0 00000100:00100000:0.0:1763334964.324043:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1715 00010000:00010000:2.0:1763334964.324484:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a451 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.324495:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a451 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.324504:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a451 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334964.324516:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x192:0x0]: returning size 0 00010000:00010000:2.0:1763334964.324552:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a443 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.324559:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a443 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.324566:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a443 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.324592:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.324596:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a443 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.324602:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a443 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.324614:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.324617:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.324620:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a443 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.324627:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a443 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:2.0:1763334964.324641:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000afeac16c reply state 000000009c8407ed transno 8589938786 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a44a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334964.324651:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334964.324690:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a43c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af833 expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.324706:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a451 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af833 expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.324718:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334964.324721:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334964.324723:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:2.0:1763334964.324779:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53008:x1848989694414720:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2024us (2284us total) trans 8589938786 rc 0/0 00000100:00100000:2.0:1763334964.324786:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4553 00010000:00010000:2.0:1763334964.328359:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a44a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.328382:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a44a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.328444:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a44a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.328452:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.328458:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a44a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.328467:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a44a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.328489:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab700) 00010000:00010000:2.0:1763334964.328492:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.328498:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a44a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.328504:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a44a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334964.328862:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.329035:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694414976 00000100:00100000:2.0:1763334964.329049:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694414976 00000100:00100000:2.0:1763334964.329253:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4554 00000100:00100000:2.0:1763334964.329275:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53008:x1848989694414976:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.329381:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.329404:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a45f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af83a expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.329685:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x192:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.329700:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a451 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af833 expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.329710:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.329749:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a451 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af833 expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.329764:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a451 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af833 expref: 182 pid: 29627 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334964.329779:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701819520:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334964.329885:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad82cc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334964.333064:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701819520:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334964.333110:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334964.334396:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.334525:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694415104 00000100:00100000:2.0:1763334964.334535:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694415104 00010000:00010000:2.0:1763334964.334616:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a451 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af833 expref: 183 pid: 29627 timeout: 1128 lvb_type: 0 00000100:00100000:2.0:1763334964.334667:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2471 00000100:00100000:2.0:1763334964.334679:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:2360:x1848989694415104:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334964.334698:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334964.334706:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a451 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af833 expref: 183 pid: 29627 timeout: 1128 lvb_type: 0 00010000:00010000:2.0:1763334964.334718:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a451 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af833 expref: 183 pid: 29627 timeout: 1128 lvb_type: 0 00010000:00010000:2.0:1763334964.334746:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a451 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af833 expref: 183 pid: 29627 timeout: 1128 lvb_type: 0 00010000:00010000:2.0:1763334964.334765:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334964.334771:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.334782:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.334789:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.334818:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334964.334892:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2360:x1848989694415104:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 216us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.334901:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2471 00010000:00010000:0.0:1763334964.334979:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.334988:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:0.0:1763334964.335014:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x192:0x0]: returning size 0 00000004:00080000:0.0:1763334964.335487:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x228:0x0], index 0: 0 00000004:00080000:0.0:1763334964.335498:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22c:0x0], index 1: 0 00000004:00080000:0.0:1763334964.335504:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22d:0x0], index 1: 0 00000004:00080000:0.0:1763334964.335510:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x229:0x0], index 0: 0 00010000:00010000:0.0:1763334964.335732:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.335742:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.335751:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.335757:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.335763:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.335775:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.335788:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:0.0:1763334964.335791:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334964.335796:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.335802:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a466 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.335881:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a45f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af83a expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.335892:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334964.335894:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334964.335898:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a45f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af83a expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334964.336150:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.336379:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694415360 00000100:00100000:3.0:1763334964.336392:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694415360 00000100:00100000:3.0:1763334964.336456:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4555 00010000:00010000:0.0:1763334964.336458:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067c00, rc 0) 00000100:00100000:3.0:1763334964.336467:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53004:x1848989694415360:12345-192.168.201.60@tcp:36:lfs.0 00000100:00100000:0.0:1763334964.336525:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53008:x1848989694414976:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7260us (7669us total) trans 8589938787 rc 301/301 00000100:00100000:0.0:1763334964.336532:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4554 00010000:00010000:3.0:1763334964.336624:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334964.336643:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a371 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x18f:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7e6 expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.336666:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:3.0:1763334964.336670:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334964.336736:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a474 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.336751:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a474 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.336762:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a474 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:3.0:1763334964.336980:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000099cac3fe reply state 000000000743849c transno 8589938788 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a474 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334964.336992:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334964.337062:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53004:x1848989694415360:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 598us (913us total) trans 8589938788 rc 0/0 00000100:00100000:3.0:1763334964.337069:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4555 00000100:00100000:1.0:1763334964.338560:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.339127:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694415616 00000100:00100000:2.0:1763334964.339144:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694415616 00000100:00100000:1.0:1763334964.339153:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.339187:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694415744 00000100:00100000:1.0:1763334964.339190:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694415744 00000100:00100000:2.0:1763334964.339202:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1677 00000100:00100000:2.0:1763334964.339214:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53008:x1848989694415616:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334964.339225:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4668 00000100:00100000:1.0:1763334964.339231:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+19:53004:x1848989694415744:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.339246:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.339417:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849a47b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af841 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334964.339449:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x229:0x0] initial LVB size: 4096, mtime: 0x691a5b34, atime: 0x0, ctime: 0x691a5b34, blocks: 0xb 00010000:00010000:1.0:1763334964.339472:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.339474:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.339484:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849a47b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af841 expref: 20 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.339501:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849a47b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af841 expref: 20 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.339515:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478800, rc 0) 00000100:00100000:1.0:1763334964.339737:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:53004:x1848989694415744:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 504us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.339745:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4668 00010000:00010000:3.0:1763334964.339765:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a474 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.339774:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a474 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.339781:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a474 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.339788:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.339792:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a474 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.339806:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a474 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.339826:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:3.0:1763334964.339829:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.339834:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a474 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.339840:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a474 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334964.339991:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53008:x1848989694415616:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 779us (1442us total) trans 8589938789 rc 0/0 00000100:00100000:2.0:1763334964.340000:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1677 00000100:00100000:1.0:1763334964.341187:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.341411:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694415872 00000100:00100000:2.0:1763334964.341426:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694415872 00000100:00100000:2.0:1763334964.341499:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4669 00000100:00100000:2.0:1763334964.341510:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:53004:x1848989694415872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.341533:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.341564:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a482 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af848 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334964.341701:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x225:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334964.341782:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334964.341786:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334964.341796:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a482 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af848 expref: 18 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.341816:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a482 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af848 expref: 18 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.341832:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:2.0:1763334964.341905:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:53004:x1848989694415872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 397us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.341913:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4669 00000100:00100000:0.0:1763334964.342193:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.342292:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694416128 00000100:00100000:2.0:1763334964.342299:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694416128 00000100:00100000:2.0:1763334964.342343:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1678 00000100:00100000:2.0:1763334964.342351:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01d13050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53008:x1848989694416128:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334964.342645:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01d13050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53008:x1848989694416128:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 294us (452us total) trans 8589938790 rc 0/0 00000100:00100000:2.0:1763334964.342653:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1678 00000100:00100000:1.0:1763334964.345336:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.345405:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.345759:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694416256 00000100:00100000:2.0:1763334964.345775:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694416256 00002000:00010000:2.0:1763334964.345837:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/553 (5->18446744073709551615) 00002000:00100000:2.0:1763334964.345843:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fca80 with x1848989694416256 ext(5->18446744073709551615) 00002000:00010000:2.0:1763334964.345862:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1fca80. 00000100:00100000:2.0:1763334964.345885:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694416384 00000100:00100000:2.0:1763334964.345888:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694416384 00002000:00010000:2.0:1763334964.345901:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/549 (0->18446744073709551615) 00002000:00100000:2.0:1763334964.345904:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fc380 with x1848989694416384 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334964.345911:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afb1fc380. 00000100:00100000:2.0:1763334964.346362:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1716 00000100:00100000:2.0:1763334964.346375:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694416256:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:2.0:1763334964.346820:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:2.0:1763334964.346825:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb mtime from disk: 1763334964 -> 1763334965 00002000:00010000:2.0:1763334964.346828:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334964.346830:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb ctime from disk: 1763334964 -> 1763334965 00002000:00010000:2.0:1763334964.346833:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1763334964.346907:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694416256:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 535us (1586us total) trans 17179871029 rc 0/0 00000100:00100000:2.0:1763334964.346915:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1716 00002000:00010000:2.0:1763334964.346920:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/553 (5->18446744073709551615) 00002000:00100000:2.0:1763334964.346923:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fca80 with x1848989694416256 ext(5->18446744073709551615) 00002000:00010000:2.0:1763334964.346928:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1fca80. 00000100:00100000:2.0:1763334964.346951:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1717 00000100:00100000:2.0:1763334964.346957:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694416384:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:2.0:1763334964.347156:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x225:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334964.347160:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x225:0x0] updating lvb mtime from disk: 0 -> 1763334965 00002000:00010000:2.0:1763334964.347162:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x225:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334964.347164:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x225:0x0] updating lvb ctime from disk: 0 -> 1763334965 00002000:00010000:2.0:1763334964.347166:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x225:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334964.347189:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694416384:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 232us (1784us total) trans 21474838311 rc 0/0 00000100:00100000:2.0:1763334964.347196:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1717 00002000:00010000:2.0:1763334964.347198:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/549 (0->18446744073709551615) 00002000:00100000:2.0:1763334964.347201:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fc380 with x1848989694416384 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334964.347206:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afb1fc380. 00000100:00100000:1.0:1763334964.349239:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.349333:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694416640 00000100:00100000:3.0:1763334964.349350:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694416640 00000100:00100000:3.0:1763334964.349495:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4556 00000100:00100000:3.0:1763334964.349508:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52274:x1848989694416640:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334964.349872:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.349903:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a489 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af84f expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334964.349949:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.350012:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694416896 00000100:00100000:0.0:1763334964.350018:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694416896 00000100:00100000:0.0:1763334964.350117:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4557 00000100:00100000:0.0:1763334964.350126:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53004:x1848989694416896:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334964.350156:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a490 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350179:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a490 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.350181:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a497 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.350190:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a497 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.350191:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a490 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.350198:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a497 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.350208:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a49e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350213:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a49e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350218:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a49e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350309:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a4a5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350318:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350325:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a4a5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334964.350337:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x192:0x0]: returning size 0 00010000:00010000:2.0:1763334964.350463:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a490 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350471:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a490 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350479:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a490 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350490:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.350494:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a490 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350503:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a490 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350517:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.350521:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.350527:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a490 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350533:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a490 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350546:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a49e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350551:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a49e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350557:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a49e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350562:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.350565:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a49e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350605:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a49e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350614:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334964.350617:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.350620:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a49e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.350626:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a49e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334964.350675:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004037db26 reply state 000000003d1ea832 transno 8589938792 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a497 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.350680:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a489 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af84f expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334964.350686:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334964.350696:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a4a5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af84f expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.350704:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5ac6cabd00) 00010000:00010000:2.0:1763334964.350706:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334964.350709:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:0.0:1763334964.350907:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53004:x1848989694416896:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 781us (957us total) trans 8589938792 rc 0/0 00000100:00100000:0.0:1763334964.350916:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4557 00000100:00100000:2.0:1763334964.350995:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694416640:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1491us (1771us total) trans 8589938791 rc 0/0 00000100:00100000:2.0:1763334964.351001:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4556 00010000:00010000:2.0:1763334964.353119:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a497 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.353142:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a497 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334964.353143:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334964.353151:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a497 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.353157:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.353163:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a497 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.353176:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a497 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334964.353185:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334964.353196:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:2.0:1763334964.353199:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.353204:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a497 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.353211:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a497 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334964.353300:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694417024 00000100:00100000:3.0:1763334964.353313:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694417024 00000100:00100000:3.0:1763334964.353386:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4670 00000100:00100000:3.0:1763334964.353397:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:53004:x1848989694417024:12345-192.168.201.60@tcp:101:lfs.0 00000100:00100000:0.0:1763334964.353405:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694417280 00000100:00100000:0.0:1763334964.353411:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694417280 00010000:00010000:3.0:1763334964.353420:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.353443:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a4b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af856 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334964.353451:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4558 00000100:00100000:0.0:1763334964.353458:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694417280:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:3.0:1763334964.353475:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a386 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7f4 expref: 20 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334964.353484:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.353486:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.353491:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a4b3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af856 expref: 20 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.353516:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334964.353534:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a386 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7f4 expref: 20 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334964.353536:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a4a5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af84f expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.353548:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5ac6cabd00) 00010000:00010000:3.0:1763334964.353551:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a386 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7f4 expref: 20 pid: 26216 timeout: 1128 lvb_type: 1 00010000:00010000:0.0:1763334964.353557:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334964.353567:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeef9ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21625:1848989701819648:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334964.353690:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ae1ae3480 going to sleep for 11 seconds 00010000:00010000:0.0:1763334964.353907:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a4ba lrc: 3/0,1 mode: --/PW res: [0x200000404:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.353921:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a4ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.353933:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a4ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:0.0:1763334964.353996:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938793 00000004:00010000:0.0:1763334964.354023:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000282226fe reply state 0000000005194023 transno 8589938794 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a4ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334964.354033:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334964.354123:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694417280:12345-192.168.201.60@tcp:36:bash.0 Request processed in 663us (934us total) trans 8589938794 rc 0/0 00000100:00100000:0.0:1763334964.354131:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4558 00000020:00080000:0.0:1763334964.354137:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1763334964.355799:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a4ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.355822:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a4ba lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.355830:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a4ba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.355838:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.355843:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a4ba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.355852:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a4ba lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.355870:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5ad99df000) 00010000:00010000:0.0:1763334964.355873:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.355878:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a4ba lrc: 2/0,0 mode: --/PW res: [0x200000404:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.355889:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a4ba lrc: 0/0,0 mode: --/PW res: [0x200000404:0x192:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334964.356700:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.356739:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.356789:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694417536 00000100:00100000:1.0:1763334964.356799:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694417536 00000100:00100000:0.0:1763334964.356799:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694417408 00000100:00100000:0.0:1763334964.356803:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694417408 00010000:00010000:1.0:1763334964.356842:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a386 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7f4 expref: 21 pid: 26216 timeout: 1128 lvb_type: 1 00000100:00100000:1.0:1763334964.356878:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2472 00000100:00100000:1.0:1763334964.356889:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694417536:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1763334964.356892:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4559 00000100:00100000:0.0:1763334964.356898:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694417408:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334964.356906:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334964.356923:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.356934:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a386 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7f4 expref: 21 pid: 26216 timeout: 1128 lvb_type: 1 00010000:00010000:1.0:1763334964.356947:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a386 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7f4 expref: 21 pid: 26216 timeout: 1128 lvb_type: 1 00010000:00010000:0.0:1763334964.356947:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a4c1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af85d expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.356969:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a386 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7f4 expref: 21 pid: 26216 timeout: 1128 lvb_type: 1 00010000:00010000:1.0:1763334964.356984:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.356986:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.356994:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a4b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af856 expref: 20 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.357004:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a4b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af856 expref: 20 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.357009:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a4c1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af85d expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.357023:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a4c1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af85d expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.357040:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5ad99df600) 00010000:00010000:1.0:1763334964.357043:0:11727:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a4b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af856 expref: 20 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.357043:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334964.357046:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:1.0:1763334964.357058:0:11727:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11727:1848989701819776:192.168.201.60@tcp:105: 00000100:00100000:2.0:1763334964.357113:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeef9ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21625:1848989701819648:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334964.357115:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694417408:12345-192.168.201.60@tcp:101:bash.0 Request processed in 216us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.357123:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4559 00010000:00010000:2.0:1763334964.357148:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a4b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af856 expref: 20 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.357162:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f600, rc 0) 00000100:00100000:1.0:1763334964.357604:0:11727:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee840 going to sleep for 11 seconds 00000100:00100000:2.0:1763334964.357677:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:53004:x1848989694417024:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4280us (4536us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.357685:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4670 00000100:00100000:2.0:1763334964.359971:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.360415:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694417792 00000100:00100000:0.0:1763334964.360432:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694417792 00000100:00100000:3.0:1763334964.360548:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4560 00000100:00100000:3.0:1763334964.360563:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694417792:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334964.360637:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.360641:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334964.360678:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a4c1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af85d expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.360702:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5ad99df600) 00010000:00010000:3.0:1763334964.360715:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334964.360715:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334964.360735:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a4c8 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af864 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334964.360757:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694417920 00000100:00100000:2.0:1763334964.360761:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694417920 00000100:00100000:2.0:1763334964.360795:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4671 00000100:00100000:2.0:1763334964.360801:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694417920:12345-192.168.201.60@tcp:2:lfs.0 00010000:00010000:3.0:1763334964.360804:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a4cf lrc: 3/0,1 mode: --/EX res: [0x200000404:0x192:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.360824:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a4cf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.360833:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a4cf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00002000:00010000:2.0:1763334964.361038:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763334964.361042:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb mtime from disk: 1763334964 -> 1763334964 00002000:00010000:2.0:1763334964.361045:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb atime from disk: 0 -> 1763334964 00002000:00010000:2.0:1763334964.361048:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb ctime from disk: 1763334964 -> 1763334965 00002000:00010000:2.0:1763334964.361050:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334964.361129:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694417920:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 327us (412us total) trans 21474838312 rc 0/0 00000100:00100000:2.0:1763334964.361137:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4671 00000100:00100000:1.0:1763334964.361620:0:11727:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fd880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11727:1848989701819776:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334964.361644:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334964.361717:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694417536:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4829us (4975us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.361727:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2472 00000040:00080000:3.0:1763334964.362196:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1054, 88 off90592 00000004:00080000:3.0:1763334964.362209:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028995636210ns, next at 1029092096998ns, rc = 0 00000040:00080000:3.0:1763334964.362653:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1065, 88 off91680 00000004:00080000:3.0:1763334964.362661:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1028996089535ns, next at 1029092157246ns, rc = 0 00000040:00080000:3.0:1763334964.362696:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1066, 88 off91768 00000004:00080000:3.0:1763334964.362701:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1028996129801ns, next at 1029092157246ns, rc = 0 00000040:00080000:3.0:1763334964.362720:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1055, 88 off90680 00000004:00080000:3.0:1763334964.362723:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1028996151336ns, next at 1029092096998ns, rc = 0 00000100:00100000:2.0:1763334964.362908:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.363057:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694418176 00000100:00100000:1.0:1763334964.363067:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694418176 00000100:00100000:1.0:1763334964.363117:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1679 00000100:00100000:1.0:1763334964.363126:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53004:x1848989694418176:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:1.0:1763334964.363199:0:29631:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x18f:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a28a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af799 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.363260:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334964.363285:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a35c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7df expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.363295:0:29631:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334964.363339:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a35c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7df expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.363354:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a35c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7df expref: 189 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:1.0:1763334964.363371:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701819904:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334964.363454:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8eed80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334964.368198:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.368288:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fd880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701819904:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334964.368324:0:29631:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:3.0:1763334964.370015:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694418304 00000100:00100000:3.0:1763334964.370032:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694418304 00010000:00010000:3.0:1763334964.370090:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a35c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7df expref: 191 pid: 30972 timeout: 1128 lvb_type: 0 00000100:00100000:3.0:1763334964.370136:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2473 00000100:00100000:3.0:1763334964.370147:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:2360:x1848989694418304:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334964.370165:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334964.370172:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a35c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7df expref: 191 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:3.0:1763334964.370189:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a35c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7df expref: 191 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:3.0:1763334964.370226:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a35c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7df expref: 191 pid: 30972 timeout: 1128 lvb_type: 0 00010000:00010000:3.0:1763334964.370244:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:3.0:1763334964.370455:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334964.370468:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334964.370475:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334964.370507:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334964.370623:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:2360:x1848989694418304:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 475us (2439us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.370631:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2473 00010000:00010000:1.0:1763334964.370807:0:29631:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334964.370816:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000040:00080000:1.0:1763334964.371522:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1056, 88 off90768 00000004:00080000:1.0:1763334964.371536:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1029004963706ns, next at 1029092096998ns, rc = 0 00000040:00080000:1.0:1763334964.371625:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1067, 88 off91856 00000004:00080000:1.0:1763334964.371631:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1029005059621ns, next at 1029092157246ns, rc = 0 00000040:00080000:1.0:1763334964.371664:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1068, 88 off91944 00000004:00080000:1.0:1763334964.371669:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1029005097158ns, next at 1029092157246ns, rc = 0 00000040:00080000:1.0:1763334964.371689:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1057, 88 off90856 00000004:00080000:1.0:1763334964.371694:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1029005122366ns, next at 1029092096998ns, rc = 0 00000001:00080000:3.0:1763334964.402119:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938794 is committed 00000001:00080000:1.0:1763334964.402226:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938795 is committed 00000004:00080000:1.0:1763334964.402233:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 691 committed 00000004:00080000:1.0:1763334964.402242:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 703 committed 00000004:00080000:1.0:1763334964.402248:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 702 committed 00000004:00080000:1.0:1763334964.402250:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 690 committed 00000100:00100000:1.0:1763334964.402445:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701820032:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334964.402548:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.402623:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701820416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334964.402653:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334964.402668:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701820288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334964.402679:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701820928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.402713:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.402746:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763334964.402749:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.402754:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701820544:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334964.402780:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701820800:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.402788:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334964.402816:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.402824:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701820160:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334964.402866:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.402891:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701820672:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.402913:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334964.402914:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701820032 00000100:00100000:3.0:1763334964.402924:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701820032 00000100:00100000:1.0:1763334964.402942:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701820416 00000100:00100000:1.0:1763334964.402945:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701820416 00000100:00100000:3.0:1763334964.402973:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701820928 00000100:00100000:1.0:1763334964.402973:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701820288 00000100:00100000:3.0:1763334964.402976:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701820928 00000100:00100000:1.0:1763334964.402976:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701820288 00000100:00100000:3.0:1763334964.402985:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701820544 00000100:00100000:1.0:1763334964.402986:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701820800 00000100:00100000:3.0:1763334964.402988:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701820544 00000100:00100000:1.0:1763334964.402988:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701820800 00000100:00100000:3.0:1763334964.402996:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701820672 00000100:00100000:1.0:1763334964.402996:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701820160 00000100:00100000:3.0:1763334964.402998:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701820672 00000100:00100000:1.0:1763334964.402998:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701820160 00000100:00100000:1.0:1763334964.403013:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4672 00000100:00100000:1.0:1763334964.403021:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+24:3290:x1848989701820032:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763334964.403057:0:25383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:550 count 1 00010000:00010000:1.0:1763334964.403092:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.403117:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a39b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af802 expref: 19 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.403127:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334964.403130:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334964.403134:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.403165:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a39b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af802 expref: 19 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.403182:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a39b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af802 expref: 19 pid: 25383 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.403194:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701821056:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334964.403289:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee600 going to sleep for 11 seconds 00010000:00010000:0.0:1763334964.403442:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a4cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x192:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af864 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.403462:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5acbb5ee00) 00010000:00010000:0.0:1763334964.403466:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763334964.403487:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a4c8 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x192:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af864 expref: 179 pid: 30972 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763334964.403507:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a4cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x192:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af864 expref: 178 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.403563:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5acbb5ee00) 00010000:00010000:0.0:1763334964.403566:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763334964.403596:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7200, rc 0) 00000100:00100000:0.0:1763334964.403636:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52274:x1848989694417792:12345-192.168.201.60@tcp:101:bash.0 Request processed in 43076us (43679us total) trans 8589938795 rc 0/0 00000100:00100000:0.0:1763334964.403645:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4560 00000100:00100000:3.0:1763334964.407865:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4673 00000100:00100000:3.0:1763334964.407901:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3289:x1848989701820416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334964.407983:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4674 00000100:00100000:1.0:1763334964.407995:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3292:x1848989701820288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334964.408044:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4675 00000100:00100000:2.0:1763334964.408061:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701820928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334964.408130:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4676 00000100:00100000:0.0:1763334964.408346:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4677 00000100:00100000:3.0:1763334964.408757:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3289:x1848989701820416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 872us (6100us total) trans 21474838314 rc 0/0 00000100:00100000:1.0:1763334964.408757:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3292:x1848989701820288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 762us (6007us total) trans 21474838313 rc 0/0 00000100:00100000:3.0:1763334964.408767:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4673 00000100:00100000:1.0:1763334964.408900:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4674 00000100:00100000:3.0:1763334964.408905:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4678 00000100:00100000:3.0:1763334964.408914:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3291:x1848989701820160:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334964.408917:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4679 00002000:00080000:3.0:1763334964.408932:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:551 count 1 00002000:00010000:3.0:1763334964.408967:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x227:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334964.408978:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a4e4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.408997:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.409000:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.409007:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a4e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334964.409052:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701820544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334964.409070:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:554 count 1 00010000:00010000:0.0:1763334964.409087:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.409105:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a38d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7fb expref: 20 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.409113:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334964.409115:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334964.409119:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.409160:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a38d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7fb expref: 20 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.409174:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a38d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7fb expref: 20 pid: 21625 timeout: 1129 lvb_type: 0 00000100:00100000:0.0:1763334964.409189:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701821184:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334964.409551:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a4e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.409566:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a4e4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.409600:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a4e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.409630:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334964.409684:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701820928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1627us (6967us total) trans 17179871030 rc 0/0 00000100:00100000:2.0:1763334964.409694:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4675 00000100:00100000:3.0:1763334964.409916:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3291:x1848989701820160:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1002us (7048us total) trans 21474838315 rc 0/0 00000100:00100000:3.0:1763334964.409929:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4678 00000100:00100000:1.0:1763334964.409946:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701820672:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763334964.409965:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334964.409972:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a4e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.409981:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c6e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334964.409986:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a4e4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1763334964.409990:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeec5b100/2, rc 0, transno 21474838314 00000004:00080000:2.0:1763334964.409991:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afc8c3100/2, rc 0, transno 21474838315 00010000:00010000:1.0:1763334964.409995:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a4e4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334964.410005:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701820416:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763334964.410016:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a4e4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.410023:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a4e4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334964.410034:0:3289:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871026 gen 2 00000004:00080000:3.0:1763334964.410039:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c39e5f80, transno 17179870977 00010000:00010000:1.0:1763334964.410042:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.410043:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.410046:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334964.410049:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c39e6300, transno 17179870978 00000004:00080000:3.0:1763334964.410052:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c39e4380, transno 17179870979 00000004:00080000:3.0:1763334964.410054:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fc380, transno 17179870980 00000004:00080000:3.0:1763334964.410058:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab36300, transno 17179870982 00000004:00080000:3.0:1763334964.410061:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab35880, transno 17179870983 00000004:00080000:3.0:1763334964.410064:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a82680, transno 17179870984 00000004:00080000:3.0:1763334964.410067:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a83100, transno 17179870985 00000004:00080000:3.0:1763334964.410069:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a81180, transno 17179870986 00000004:00080000:3.0:1763334964.410071:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a80380, transno 17179870987 00000004:00080000:3.0:1763334964.410075:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a82300, transno 17179870988 00000004:00080000:3.0:1763334964.410077:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a81500, transno 17179870989 00000004:00080000:3.0:1763334964.410080:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d6a00, transno 17179870991 00000004:00080000:3.0:1763334964.410083:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6bed180, transno 17179870992 00000004:00080000:3.0:1763334964.410086:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6beea00, transno 17179870993 00000004:00080000:3.0:1763334964.410088:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6beca80, transno 17179870994 00000004:00080000:3.0:1763334964.410091:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeece9180, transno 17179870996 00000004:00080000:3.0:1763334964.410094:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeecead80, transno 17179870997 00000004:00080000:3.0:1763334964.410096:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeece8000, transno 17179870998 00000004:00080000:3.0:1763334964.410099:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeece9f80, transno 17179870999 00000004:00080000:3.0:1763334964.410102:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af59faa00, transno 17179871002 00000004:00080000:3.0:1763334964.410106:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4e300, transno 17179871003 00000004:00080000:3.0:1763334964.410109:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841b800, transno 17179871004 00000004:00080000:3.0:1763334964.410112:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac721a300, transno 17179871005 00000004:00080000:3.0:1763334964.410115:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5b01f2dc00, transno 17179871009 00000004:00080000:3.0:1763334964.410118:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5b01f2fb80, transno 17179871010 00000004:00080000:3.0:1763334964.410121:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5b01f2d180, transno 17179871011 00000004:00080000:3.0:1763334964.410123:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5b01f2e300, transno 17179871012 00000004:00080000:3.0:1763334964.410127:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5fb100, transno 17179871014 00000004:00080000:3.0:1763334964.410130:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5f9880, transno 17179871015 00000004:00080000:3.0:1763334964.410133:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c5f80, transno 17179871016 00000004:00080000:3.0:1763334964.410135:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab35f80, transno 17179871017 00000004:00080000:3.0:1763334964.410138:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c7800, transno 17179871018 00000004:00080000:3.0:1763334964.410141:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab34a80, transno 17179871019 00000004:00080000:3.0:1763334964.410144:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab37480, transno 17179871020 00000004:00080000:3.0:1763334964.410146:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c4000, transno 17179871021 00000004:00080000:3.0:1763334964.410149:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5f8700, transno 17179871023 00000004:00080000:3.0:1763334964.410151:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5fb480, transno 17179871024 00000004:00080000:3.0:1763334964.410154:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af68cd500, transno 17179871025 00000004:00080000:3.0:1763334964.410156:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d5180, transno 17179871026 00000100:00100000:3.0:1763334964.410163:0:3289:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a59c58c6a00 x1848989701820928/t17179871030(17179871030) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334980 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763334964.410172:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c6a00/2, rc 0, transno 17179871030 00000100:00100000:3.0:1763334964.410177:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701820928:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334964.410211:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1480 going to sleep for 11 seconds 00000004:00080000:1.0:1763334964.410242:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d4a80/2, rc 0, transno 21474838313 00000100:00100000:2.0:1763334964.410528:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701820160:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334964.410653:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701820288:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334964.410686:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 4 in progress, 3 in flight, 40 done 00002000:00080000:1.0:1763334964.410689:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:555 count 1 00002000:00010000:1.0:1763334964.410724:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334964.410733:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a4f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.410748:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.410751:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.410756:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a4f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.410773:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a4f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.410781:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a4f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.410788:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a4f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.410813:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334964.410828:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334964.410835:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a4f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.410842:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334964.411561:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a4f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.411600:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a4f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.411617:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a4f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.411625:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a4f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.411651:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.411653:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.411655:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334964.413291:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3292:x1848989701820800:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334964.413720:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701820800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5579us (10903us total) trans 17179871031 rc 0/0 00000100:00100000:0.0:1763334964.413732:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4676 00000004:00080000:2.0:1763334964.414047:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c4700/2, rc 0, transno 17179871031 00000100:00100000:2.0:1763334964.414074:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701820800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334964.418625:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.418672:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.418740:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.418788:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694418432 00000100:00100000:1.0:1763334964.418790:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701821056:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334964.418797:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694418432 00010000:00010000:1.0:1763334964.418832:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.418849:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a39b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af802 expref: 20 pid: 25383 timeout: 1129 lvb_type: 0 00000100:00100000:3.0:1763334964.418893:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694418560 00000100:00100000:3.0:1763334964.418898:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694418560 00000100:00100000:1.0:1763334964.418901:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2474 00000100:00100000:1.0:1763334964.418914:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694418432:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334964.418917:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a38d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7fb expref: 21 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.418933:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334964.418940:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a39b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af802 expref: 20 pid: 25383 timeout: 1129 lvb_type: 0 00000100:00100000:3.0:1763334964.418944:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2475 00000100:00100000:3.0:1763334964.418953:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2362:x1848989694418560:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334964.418962:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334964.418963:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a39b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af802 expref: 20 pid: 25383 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.418967:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a38d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7fb expref: 21 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.418979:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a38d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7fb expref: 21 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.418998:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a39b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af802 expref: 20 pid: 25383 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.419000:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.419003:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.419009:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.419016:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.419018:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.419022:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.419034:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.419034:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.419058:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334964.419061:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334964.419121:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694418432:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 209us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.419130:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2474 00010000:00010000:1.0:1763334964.419160:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.419167:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.419179:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.419193:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.419214:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334964.419284:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2362:x1848989694418560:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 331us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.419291:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2475 00010000:00010000:3.0:1763334964.419335:0:7819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067400/0xcedf0054f849a38d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af7fb expref: 20 pid: 21625 timeout: 1129 lvb_type: 0 00000100:00100000:3.0:1763334964.419348:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701821184:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334964.419362:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.419371:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.419377:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.419385:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.419392:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.419407:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763334964.419453:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694418688 00000100:00100000:3.0:1763334964.419458:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694418688 00000100:00100000:3.0:1763334964.419493:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4680 00000100:00100000:3.0:1763334964.419501:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+19:52274:x1848989694418688:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334964.419521:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.419547:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a4f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af86b expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334964.419602:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x228:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334964.419622:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.419624:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.419631:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a4f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af86b expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.419646:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a4f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af86b expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.419659:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7600, rc 0) 00000100:00100000:3.0:1763334964.419689:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+20:52274:x1848989694418688:12345-192.168.201.60@tcp:101:bash.0 Request processed in 188us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.419697:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4680 00010000:00010000:0.0:1763334964.419822:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763334964.419834:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.419845:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334964.419851:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.419863:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334964.419871:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+25:3290:x1848989701820032:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16846us (17320us total) trans 21474838316 rc 0/0 00000100:00100000:1.0:1763334964.419881:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4672 00010000:00010000:0.0:1763334964.419883:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.419894:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a4dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.419903:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:3.0:1763334964.419906:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afc8c1180/2, rc 0, transno 21474838316 00010000:00010000:1.0:1763334964.419910:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.419916:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.419918:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc16f8b40) 00000100:00100000:3.0:1763334964.419920:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701820032:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763334964.419921:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.419923:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.419927:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.419934:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.419947:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.419954:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849a4eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.419971:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.419973:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.419977:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334964.421970:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701820672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13036us (19046us total) trans 17179871032 rc 0/0 00000100:00100000:3.0:1763334964.421971:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701820544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13608us (19174us total) trans 17179871033 rc 0/0 00000100:00100000:1.0:1763334964.421984:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4679 00000100:00100000:3.0:1763334964.421989:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4677 00000004:00080000:0.0:1763334964.422009:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c4a80/2, rc 0, transno 17179871033 00000004:00080000:2.0:1763334964.422011:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c6d80/2, rc 0, transno 17179871032 00000100:00100000:2.0:1763334964.422028:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701820672:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334964.422028:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701820544:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334964.423500:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.424362:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694418816 00000100:00100000:0.0:1763334964.424378:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694418816 00000100:00100000:0.0:1763334964.424440:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4681 00000100:00100000:0.0:1763334964.424451:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+20:52274:x1848989694418816:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334964.424475:0:7819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.424505:0:7819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f849a500 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af872 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334964.424538:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334964.424566:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.424586:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.424598:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f849a500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af872 expref: 21 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.424619:0:7819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f849a500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af872 expref: 21 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.424634:0:7819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793800, rc 0) 00000100:00100000:0.0:1763334964.424719:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:52274:x1848989694418816:12345-192.168.201.60@tcp:101:bash.0 Request processed in 269us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.424726:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4681 00000100:00100000:0.0:1763334964.429329:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.429383:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.429437:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694418944 00000100:00100000:3.0:1763334964.429451:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694418944 00002000:00010000:3.0:1763334964.429508:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/552 (0->18446744073709551615) 00002000:00100000:3.0:1763334964.429514:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a22a00 with x1848989694418944 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334964.429531:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6a22a00. 00000100:00100000:3.0:1763334964.429600:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694419072 00000100:00100000:3.0:1763334964.429609:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694419072 00002000:00010000:3.0:1763334964.429636:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/556 (0->18446744073709551615) 00002000:00100000:3.0:1763334964.429640:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a23800 with x1848989694419072 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334964.429647:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a23800. 00000100:00100000:3.0:1763334964.429674:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1718 00000100:00100000:3.0:1763334964.429683:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694418944:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:0.0:1763334964.429736:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1719 00000100:00100000:0.0:1763334964.429750:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694419072:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:0.0:1763334964.430046:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334964.430051:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb mtime from disk: 0 -> 1763334965 00002000:00010000:0.0:1763334964.430054:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334964.430056:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb ctime from disk: 0 -> 1763334965 00002000:00010000:0.0:1763334964.430058:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334964.430142:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694419072:12345-192.168.201.60@tcp:10:bash.0 Request processed in 396us (758us total) trans 17179871034 rc 0/0 00000100:00100000:0.0:1763334964.430152:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1719 00002000:00010000:0.0:1763334964.430157:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/556 (0->18446744073709551615) 00002000:00100000:0.0:1763334964.430160:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a23800 with x1848989694419072 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334964.430165:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a23800. 00002000:00010000:3.0:1763334964.432245:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x228:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334964.432258:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x228:0x0] updating lvb mtime from disk: 0 -> 1763334965 00002000:00010000:3.0:1763334964.432271:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x228:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334964.432274:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x228:0x0] updating lvb ctime from disk: 0 -> 1763334965 00002000:00010000:3.0:1763334964.432276:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x228:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334964.432393:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694418944:12345-192.168.201.60@tcp:10:bash.0 Request processed in 2702us (3070us total) trans 21474838317 rc 0/0 00000100:00100000:3.0:1763334964.432405:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1718 00002000:00010000:3.0:1763334964.432413:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/552 (0->18446744073709551615) 00002000:00100000:3.0:1763334964.432417:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a22a00 with x1848989694418944 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334964.432426:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6a22a00. 00000100:00100000:3.0:1763334964.438566:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.438639:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694419328 00000100:00100000:1.0:1763334964.438653:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694419328 00000100:00100000:1.0:1763334964.438725:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1680 00000100:00100000:1.0:1763334964.438737:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:52274:x1848989694419328:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:1.0:1763334964.439287:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52274:x1848989694419328:12345-192.168.201.60@tcp:35:bash.0 Request processed in 550us (736us total) trans 8589938797 rc 0/0 00000100:00100000:1.0:1763334964.439298:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1680 00000100:00100000:3.0:1763334964.460349:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.460696:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694419456 00000100:00100000:1.0:1763334964.460714:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694419456 00000100:00100000:1.0:1763334964.460806:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4561 00000100:00100000:1.0:1763334964.460820:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53009:x1848989694419456:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:1.0:1763334964.460850:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.460878:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a507 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af879 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.460976:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a50e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.460995:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a50e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461008:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a50e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461023:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a515 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461030:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a515 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461036:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a515 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461188:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a51c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x192:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461198:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a51c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461205:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a51c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334964.461258:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x192:0x0]: returning size 5 00000004:00200000:1.0:1763334964.461283:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334964.461311:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a51c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461326:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a51c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461337:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a50e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461344:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a50e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461352:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a50e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461358:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.461363:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a50e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461372:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a50e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461386:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.461389:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.461395:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a50e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461401:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a50e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461415:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a515 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461420:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a515 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461425:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a515 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461429:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.461432:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a515 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461438:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a515 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461445:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fad00) 00010000:00010000:1.0:1763334964.461448:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.461451:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a515 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461457:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a515 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.461493:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a507 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af879 expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.461507:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a51c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af879 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.461514:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5acbb5ee00) 00010000:00010000:1.0:1763334964.461517:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334964.461519:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334964.461670:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53009:x1848989694419456:12345-192.168.201.60@tcp:101:rm.0 Request processed in 852us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.461680:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4561 00000100:00100000:2.0:1763334964.466444:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.466566:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694419712 00000100:00100000:3.0:1763334964.466598:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694419712 00000100:00100000:3.0:1763334964.466664:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4562 00000100:00100000:3.0:1763334964.466675:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53009:x1848989694419712:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:3.0:1763334964.466744:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1763334964.466778:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a51c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x192:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af879 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.466808:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a4cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x192:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af864 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.466820:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5acbb5ee00) 00010000:00010000:3.0:1763334964.466833:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334964.466866:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a523 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.466882:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a523 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.466896:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a523 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.466912:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a52a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.466919:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a52a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.466926:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a52a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.467310:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a531 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x192:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.467321:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a531 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.467328:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a531 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:3.0:1763334964.467960:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1058, 64 off90920 00000004:00080000:3.0:1763334964.467971:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1029101398304ns, next at 1030101395439ns, rc = 0 00000040:00080000:3.0:1763334964.468005:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1069, 64 off92008 00000004:00080000:3.0:1763334964.468009:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1029101437439ns, next at 1030101436569ns, rc = 0 00000040:00080000:3.0:1763334964.468170:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1070, 64 off92072 00000040:00080000:3.0:1763334964.468189:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1059, 64 off90984 00010000:00010000:3.0:1763334964.468280:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a538 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x192:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468293:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a538 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468302:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a538 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468309:0:32232:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a538 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468316:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a538 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468322:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a538 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468350:0:32232:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763334964.468376:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a531 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468381:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a531 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468387:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a531 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468393:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.468399:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a531 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468407:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a531 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x192:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468418:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:3.0:1763334964.468421:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763334964.468426:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a531 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x192:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468432:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a531 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x192:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468507:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a523 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468514:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a523 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468519:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a523 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468524:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.468527:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a523 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468532:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a523 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468540:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334964.468543:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.468546:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a523 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.468557:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a523 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:3.0:1763334964.468566:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000414a7739 reply state 00000000a0d36ff1 transno 8589938798 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a52a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334964.468604:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334964.468718:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53009:x1848989694419712:12345-192.168.201.60@tcp:36:rm.0 Request processed in 2041us (2285us total) trans 8589938798 rc 0/0 00000100:00100000:3.0:1763334964.468729:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4562 00010000:00010000:1.0:1763334964.468845:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334964.468854:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a538 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.468860:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334964.468863:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a538 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.468870:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a538 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x192:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.468881:0:8206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x192:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334964.468884:0:8206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763334964.468887:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a538 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x192:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.468893:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849a538 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x192:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334964.468910:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.468912:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.468915:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:1.0:1763334964.471289:0:29631:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008c136ecc reply state 000000004f98f2f6 transno 8589938796 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:1.0:1763334964.471315:0:29631:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763334964.471335:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:1.0:1763334964.471339:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334964.471352:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0030e00/0xcedf0054f849a28a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af799 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334964.471524:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53004:x1848989694418176:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 108397us (108617us total) trans 8589938796 rc 0/0 00000100:00100000:1.0:1763334964.471535:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1679 00000001:00080000:1.0:1763334964.471631:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938796 is committed 00000004:00080000:1.0:1763334964.471638:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 693 committed 00000004:00080000:1.0:1763334964.471651:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 705 committed 00000004:00080000:1.0:1763334964.471659:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 704 committed 00000004:00080000:1.0:1763334964.471662:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 692 committed 00000100:00100000:1.0:1763334964.471826:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701821440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.471894:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334964.472114:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763334964.472126:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701821312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334964.472157:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334964.472194:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701821440 00000100:00100000:0.0:1763334964.472202:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701821440 00000100:00100000:0.0:1763334964.472242:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701821312 00000100:00100000:0.0:1763334964.472244:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701821312 00000100:00100000:0.0:1763334964.472273:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4682 00000100:00100000:0.0:1763334964.472282:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701821440:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334964.472507:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763334964.472511:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb mtime from disk: 1763334965 -> 1763334965 00002000:00010000:0.0:1763334964.472514:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334964.472516:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb ctime from disk: 1763334965 -> 1763334965 00002000:00010000:0.0:1763334964.472519:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x229:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1763334964.472551:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701821440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 270us (657us total) trans 17179871035 rc 0/0 00000100:00100000:0.0:1763334964.472557:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4682 00000100:00100000:0.0:1763334964.472609:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4683 00000100:00100000:0.0:1763334964.472616:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701821312:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334964.472724:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334964.472727:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb mtime from disk: 1763334964 -> 1763334964 00002000:00010000:0.0:1763334964.472730:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334964.472732:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb ctime from disk: 1763334964 -> 1763334964 00002000:00010000:0.0:1763334964.472734:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x228:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:0.0:1763334964.472763:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701821312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (604us total) trans 17179871036 rc 0/0 00000100:00100000:0.0:1763334964.472769:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4683 00000004:00080000:0.0:1763334964.472826:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b7480/2, rc 0, transno 17179871036 00000100:00100000:0.0:1763334964.472839:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701821312:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334964.472860:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b5500/2, rc 0, transno 17179871035 00000100:00100000:0.0:1763334964.472865:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701821440:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334964.472971:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701821568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334964.473007:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334964.473038:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701821568 00000100:00100000:0.0:1763334964.473042:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701821568 00000100:00100000:0.0:1763334964.473069:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4684 00000100:00100000:0.0:1763334964.473077:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3292:x1848989701821568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334964.473202:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763334964.473205:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb mtime from disk: 1763334964 -> 1763334964 00002000:00010000:0.0:1763334964.473207:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb atime from disk: 1763334964 -> 1763334964 00002000:00010000:0.0:1763334964.473209:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb ctime from disk: 1763334965 -> 1763334965 00002000:00010000:0.0:1763334964.473211:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x224:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334964.473239:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+26:3292:x1848989701821568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (231us total) trans 21474838318 rc 0/0 00000100:00100000:0.0:1763334964.473245:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4684 00000004:00080000:0.0:1763334964.473290:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afc8e8000/2, rc 0, transno 21474838318 00000100:00100000:0.0:1763334964.473299:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701821568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334964.473311:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee93ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701821696:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334964.473335:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334964.473356:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701821696 00000100:00100000:0.0:1763334964.473360:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701821696 00000100:00100000:0.0:1763334964.473379:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4685 00000100:00100000:0.0:1763334964.473386:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+26:3289:x1848989701821696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334964.473471:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x225:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334964.473475:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x225:0x0] updating lvb mtime from disk: 1763334965 -> 1763334965 00002000:00010000:0.0:1763334964.473477:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x225:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334964.473479:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x225:0x0] updating lvb ctime from disk: 1763334965 -> 1763334965 00002000:00010000:0.0:1763334964.473482:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x225:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334964.473512:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb344c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3289:x1848989701821696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (174us total) trans 21474838319 rc 0/0 00000100:00100000:0.0:1763334964.473522:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4685 00000004:00080000:0.0:1763334964.473713:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee93ca80/2, rc 0, transno 21474838319 00000100:00100000:0.0:1763334964.473719:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee93ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701821696:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1763334964.474510:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334964.474524:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334964.474533:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334964.474540:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.474546:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334964.474555:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334964.474606:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:2.0:1763334964.474610:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334964.474615:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334964.474622:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a4d6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00000100:00100000:3.0:1763334964.477279:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.477357:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694419840 00000100:00100000:2.0:1763334964.477370:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694419840 00000100:00100000:2.0:1763334964.477445:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4563 00000100:00100000:2.0:1763334964.477456:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+177:53004:x1848989694419840:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.477488:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.477516:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f849a53f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af880 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.477641:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f849a53f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af880 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.477659:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067400/0xcedf0054f849a53f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x18f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af880 expref: 178 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.477682:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:2.0:1763334964.477686:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334964.477690:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067400, rc 0) 00000100:00100000:2.0:1763334964.477761:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53004:x1848989694419840:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 307us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.477768:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4563 00010000:00010000:0.0:1763334964.478748:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a52a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.478766:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a52a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.478775:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a52a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.478782:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c6e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.478786:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a52a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.478795:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a52a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.478824:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334964.478827:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.478831:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a52a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.478837:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a52a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334964.481130:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.481220:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694420096 00000100:00100000:1.0:1763334964.481235:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694420096 00000100:00100000:1.0:1763334964.481315:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1681 00000100:00100000:1.0:1763334964.481329:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+177:53004:x1848989694420096:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:1.0:1763334964.482664:0:29631:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x18f:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763334964.482764:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1060, 64 off91048 00000040:00080000:1.0:1763334964.482792:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1071, 64 off92136 00000040:00080000:1.0:1763334964.482808:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1072, 64 off92200 00000040:00080000:1.0:1763334964.482823:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1061, 64 off91112 00010000:00010000:1.0:1763334964.482924:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a546 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334964.482947:0:29631:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a546 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334964.482963:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a546 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334964.482973:0:29631:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a546 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334964.482980:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a546 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334964.482986:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a546 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334964.483012:0:29631:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334964.483234:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53004:x1848989694420096:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1904us (2115us total) trans 8589938799 rc 0/0 00000100:00100000:1.0:1763334964.483247:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1681 00010000:00010000:0.0:1763334964.483638:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334964.483647:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a546 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334964.483655:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334964.483660:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a546 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334964.483668:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a546 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334964.483683:0:5736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x18f:0x0].0x0 (ffff9a5acbb5ec00) 00010000:00010000:0.0:1763334964.483686:0:5736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763334964.483690:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a546 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334964.483696:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a546 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x18f:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334964.483707:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334964.483708:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334964.483710:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334964.486787:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.486882:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694420224 00000100:00100000:1.0:1763334964.486898:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694420224 00000100:00100000:1.0:1763334964.487596:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4564 00000100:00100000:1.0:1763334964.487614:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53010:x1848989694420224:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.487647:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.487679:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a54d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af887 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.487797:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a554 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.487817:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a554 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.487832:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a554 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.487851:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a55b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.487858:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a55b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.487864:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a55b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.487956:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a554 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.487964:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a554 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.487972:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a554 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.487979:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.487984:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a554 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.487992:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a554 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.488011:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.488014:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.488021:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a554 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.488026:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a554 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.488039:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a55b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.488044:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a55b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.488049:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a55b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.488054:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.488057:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a55b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.488062:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a55b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.488068:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fad00) 00010000:00010000:1.0:1763334964.488070:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.488072:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a55b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.488076:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a55b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.488112:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a54d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af887 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.488124:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.488126:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.488130:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a54d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af887 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.488139:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334964.490801:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53010:x1848989694420224:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3174us (4014us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334964.490822:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4564 00000100:00100000:3.0:1763334964.493974:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.494106:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694420480 00000100:00100000:1.0:1763334964.494122:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694420480 00000100:00100000:1.0:1763334964.494195:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4565 00000100:00100000:1.0:1763334964.494207:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53004:x1848989694420480:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.494241:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.494283:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a562 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af88e expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.494436:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a569 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494455:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a569 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494470:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a569 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494487:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a570 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494499:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a570 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494505:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a570 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494628:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a569 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494637:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a569 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494644:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a569 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494650:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.494655:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a569 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494663:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a569 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494676:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.494680:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.494686:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a569 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494692:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a569 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494708:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a570 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494714:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a570 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494720:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a570 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494724:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.494727:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a570 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494732:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a570 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494737:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28faa00) 00010000:00010000:1.0:1763334964.494740:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.494742:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a570 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494748:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a570 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.494796:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a562 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af88e expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.494808:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.494811:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334964.494814:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a562 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af88e expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.494825:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334964.494914:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53004:x1848989694420480:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 708us (957us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334964.494924:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4565 00000100:00100000:2.0:1763334964.502721:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.502863:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694420608 00000100:00100000:3.0:1763334964.502877:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694420608 00000100:00100000:3.0:1763334964.502951:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4566 00000100:00100000:3.0:1763334964.502962:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53010:x1848989694420608:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334964.502989:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.503304:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a577 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af895 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.503396:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a57e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503414:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a57e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503428:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a57e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503445:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a585 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503451:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a585 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503457:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a585 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503535:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a57e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503543:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a57e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503549:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a57e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503555:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.503559:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a57e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503566:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a57e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503612:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.503615:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.503622:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a57e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503629:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a57e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503641:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a585 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503646:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a585 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503651:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a585 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503661:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.503663:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a585 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503669:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a585 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503675:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334964.503677:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.503679:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a585 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503684:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a585 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.503724:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a577 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af895 expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.503736:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.503738:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.503741:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a577 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af895 expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.503750:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:2.0:1763334964.503835:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53010:x1848989694420608:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 873us (1129us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334964.503844:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4566 00000100:00100000:3.0:1763334964.518530:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.518781:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694420864 00000100:00100000:2.0:1763334964.518795:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694420864 00000100:00100000:2.0:1763334964.518878:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4567 00000100:00100000:2.0:1763334964.518890:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53011:x1848989694420864:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.518917:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.518947:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a58c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af89c expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.519046:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a593 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519064:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a593 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519078:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a593 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519094:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a59a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519101:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a59a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519108:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a59a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519196:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a593 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519203:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a593 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519210:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a593 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519217:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.519223:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a593 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519231:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a593 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519245:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.519249:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.519255:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a593 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519275:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a593 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519290:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a59a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519296:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a59a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519301:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a59a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519307:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.519310:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a59a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519315:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a59a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519322:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334964.519325:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.519327:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a59a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519337:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a59a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.519377:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a58c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af89c expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.519389:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.519391:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334964.519395:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a58c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af89c expref: 179 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.519405:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:2.0:1763334964.519484:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53011:x1848989694420864:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 595us (971us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334964.519493:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4567 00000100:00100000:0.0:1763334964.520889:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.521238:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694420992 00000100:00100000:1.0:1763334964.521251:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694420992 00000100:00100000:1.0:1763334964.521318:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4568 00000100:00100000:1.0:1763334964.521328:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53010:x1848989694420992:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.521352:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.521377:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a5a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8a3 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.521455:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a5a8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.521470:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.521481:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334964.521568:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:1.0:1763334964.521594:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334964.521624:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a5a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.521656:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a5a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8a3 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.521676:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a5a8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8a3 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.521685:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.521688:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763334964.521691:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334964.521777:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53010:x1848989694420992:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 449us (898us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.521785:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4568 00000100:00100000:3.0:1763334964.529336:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.529454:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694421120 00000100:00100000:2.0:1763334964.529469:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694421120 00000100:00100000:2.0:1763334964.529541:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4569 00000100:00100000:2.0:1763334964.529552:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53011:x1848989694421120:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.529611:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.529638:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a5af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8aa expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.529721:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a5b6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.529738:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.529756:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.529770:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a5bd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.529777:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a5bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.529783:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a5bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.529867:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a5b6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.529874:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a5b6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.529881:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.529888:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.529892:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.529900:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a5b6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.530154:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.530160:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.530166:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a5b6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.530173:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a5b6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.530187:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a5bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.530193:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a5bd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.530199:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a5bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.530203:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.530206:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a5bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.530211:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a5bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.530219:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334964.530221:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.530224:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a5bd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.530230:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a5bd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.530284:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a5af lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8aa expref: 180 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.530295:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.530298:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.530301:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a5af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8aa expref: 180 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.530316:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:2.0:1763334964.531675:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53011:x1848989694421120:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2109us (2340us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334964.531691:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4569 00000100:00100000:0.0:1763334964.537129:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.537190:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694421376 00000100:00100000:2.0:1763334964.537205:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694421376 00000100:00100000:2.0:1763334964.537291:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4570 00000100:00100000:2.0:1763334964.537305:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53010:x1848989694421376:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.537337:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.537341:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334964.537379:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a5a8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8a3 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.537404:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.537411:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334964.537430:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a5c4 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8b1 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.537637:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a5cb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.537655:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a5cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.537668:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a5cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.537686:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5d2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.537694:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5d2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.537701:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5d2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.538301:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a5d9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.538313:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.538321:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a5d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334964.538333:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 0 00010000:00010000:2.0:1763334964.538363:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a5cb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.538371:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a5cb lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.538380:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a5cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.538386:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.538391:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a5cb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.538399:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a5cb lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.538408:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.538412:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.538417:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a5cb lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.538423:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a5cb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:2.0:1763334964.538437:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008ea9b6f5 reply state 00000000849d31d2 transno 8589938800 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5d2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334964.538447:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334964.538477:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a5c4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8b1 expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.538491:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a5d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8b1 expref: 180 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.538498:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334964.538500:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334964.538502:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:2.0:1763334964.538643:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53010:x1848989694421376:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1340us (1528us total) trans 8589938800 rc 0/0 00000100:00100000:2.0:1763334964.538652:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4570 00010000:00010000:2.0:1763334964.541485:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5d2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.541507:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5d2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.541515:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5d2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.541525:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.541530:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5d2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.541538:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5d2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.541557:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334964.541560:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.541564:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5d2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.541593:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5d2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334964.548166:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.548271:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694421632 00000100:00100000:1.0:1763334964.548286:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694421632 00000100:00100000:1.0:1763334964.548367:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4571 00000100:00100000:1.0:1763334964.548380:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53010:x1848989694421632:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.548486:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.548518:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a5e7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8b8 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.548691:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.548708:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a5d9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8b1 expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.548718:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 4/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.548761:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a5d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8b1 expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.548777:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a5d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8b1 expref: 181 pid: 32232 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.548794:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701821824:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334964.549373:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee600 going to sleep for 11 seconds 00000100:00100000:3.0:1763334964.554268:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.554318:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.554360:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701821824:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334964.554397:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334964.554417:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694421760 00000100:00100000:0.0:1763334964.554428:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694421760 00010000:00010000:0.0:1763334964.554478:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a5d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8b1 expref: 182 pid: 32232 timeout: 1129 lvb_type: 0 00000100:00100000:0.0:1763334964.554525:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2476 00000100:00100000:0.0:1763334964.554536:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:2359:x1848989694421760:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334964.554554:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334964.554561:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a5d9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8b1 expref: 182 pid: 32232 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.554632:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a5d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8b1 expref: 182 pid: 32232 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.554661:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a5d9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8b1 expref: 182 pid: 32232 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.554681:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334964.554688:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 3/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.554699:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.554706:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.554727:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334964.554789:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:2359:x1848989694421760:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 254us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.554796:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2476 00000100:00100000:2.0:1763334964.555012:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694422016 00000100:00100000:2.0:1763334964.555017:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694422016 00000100:00100000:2.0:1763334964.555064:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4572 00000100:00100000:2.0:1763334964.555072:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53012:x1848989694422016:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.555094:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.555115:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5f5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8bf expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.555239:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a5fc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555249:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a5fc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555257:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a5fc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555289:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a603 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555297:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a603 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555304:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a603 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555487:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a60a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555496:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a60a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555504:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a60a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334964.555516:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 0 00010000:00010000:2.0:1763334964.555668:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a60a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555675:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a60a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555682:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a60a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555688:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.555692:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a60a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555699:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a60a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555708:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334964.555711:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334964.555715:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a60a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555721:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a60a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555734:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a5fc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555740:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a5fc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555745:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a5fc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555750:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.555752:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a5fc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555757:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a5fc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555763:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.555765:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.555768:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a5fc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555773:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a5fc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555781:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a603 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555787:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a603 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555793:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a603 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555797:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.555799:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a603 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555804:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a603 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555809:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334964.555812:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.555814:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a603 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555820:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a603 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334964.555863:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5f5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8bf expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.555872:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.555874:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334964.555878:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849a5f5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8bf expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.555886:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:2.0:1763334964.555959:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53012:x1848989694422016:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 887us (1724us total) trans 8589938801 rc 301/301 00000100:00100000:2.0:1763334964.555968:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4572 00010000:00010000:1.0:1763334964.556281:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.556290:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334964.556304:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 0 00000004:00080000:1.0:1763334964.556692:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22e:0x0], index 1: 0 00000004:00080000:1.0:1763334964.556704:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22a:0x0], index 0: 0 00000004:00080000:1.0:1763334964.556713:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22b:0x0], index 0: 0 00000004:00080000:1.0:1763334964.556718:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22f:0x0], index 1: 0 00010000:00010000:1.0:1763334964.556878:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.556887:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.556893:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.556899:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.556903:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.556909:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.556920:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:1.0:1763334964.556922:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334964.556926:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 2/0,0 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.556931:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a5ee lrc: 0/0,0 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.556982:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a5e7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8b8 expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.556992:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.556995:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334964.556999:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a5e7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8b8 expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.557008:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334964.557065:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53010:x1848989694421632:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 8688us (8916us total) trans 8589938802 rc 301/301 00000100:00100000:1.0:1763334964.557073:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4571 00000100:00100000:0.0:1763334964.562512:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.562728:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694422272 00000100:00100000:1.0:1763334964.562743:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694422272 00000100:00100000:1.0:1763334964.562822:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1682 00000100:00100000:1.0:1763334964.562836:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53012:x1848989694422272:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334964.563047:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.563341:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53012:x1848989694422272:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 507us (845us total) trans 8589938803 rc 0/0 00000100:00100000:1.0:1763334964.563350:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1682 00000100:00100000:1.0:1763334964.563369:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694422528 00000100:00100000:1.0:1763334964.563373:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694422528 00000100:00100000:1.0:1763334964.563389:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1683 00000100:00100000:1.0:1763334964.563395:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01d12050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53010:x1848989694422528:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334964.563481:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01d12050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53010:x1848989694422528:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 84us (434us total) trans 8589938804 rc 0/0 00000100:00100000:1.0:1763334964.563488:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1683 00000100:00100000:0.0:1763334964.568529:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.568819:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694423040 00000100:00100000:1.0:1763334964.568835:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694423040 00000100:00100000:1.0:1763334964.568914:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1684 00000100:00100000:1.0:1763334964.568927:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53010:x1848989694423040:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334964.569062:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.569288:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53010:x1848989694423040:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 361us (772us total) trans 8589938805 rc 0/0 00000100:00100000:1.0:1763334964.569297:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1684 00000100:00100000:0.0:1763334964.569385:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694422784 00000100:00100000:0.0:1763334964.569390:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694422784 00000100:00100000:0.0:1763334964.569434:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4573 00000100:00100000:0.0:1763334964.569443:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53012:x1848989694422784:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334964.569454:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.569479:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a61f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8c6 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.569561:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849a626 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569605:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849a626 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569619:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849a626 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569637:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a62d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569644:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a62d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569650:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a62d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569797:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a634 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569805:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a634 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569812:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a634 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334964.569823:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 0 00010000:00010000:0.0:1763334964.569893:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849a626 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569901:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849a626 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569912:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849a626 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569919:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.569923:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849a626 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569931:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849a626 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569944:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334964.569947:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.569953:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849a626 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569959:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849a626 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569970:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a62d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569976:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a62d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569981:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a62d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569985:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.569987:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a62d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.569992:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a62d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.570000:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac51bd200) 00010000:00010000:0.0:1763334964.570002:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.570006:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a62d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.570012:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a62d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.570050:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a61f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8c6 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.570066:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a634 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8c6 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.570073:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334964.570076:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334964.570079:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334964.570124:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53012:x1848989694422784:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 682us (1064us total) trans 8589938806 rc 0/0 00000100:00100000:0.0:1763334964.570132:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4573 00000100:00100000:2.0:1763334964.577029:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.577078:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.577106:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.577428:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694423552 00000100:00100000:1.0:1763334964.577446:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694423552 00000100:00100000:1.0:1763334964.577536:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4574 00000100:00100000:1.0:1763334964.577550:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694423552:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334964.577618:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.577649:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a642 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8db expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.577787:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.577805:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a634 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8c6 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.577815:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.577858:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a634 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8c6 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.577874:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a634 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8c6 expref: 187 pid: 30972 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.577890:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701821952:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334964.577987:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8eee40 going to sleep for 11 seconds 00000100:00100000:0.0:1763334964.578594:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694423168 00000100:00100000:0.0:1763334964.578606:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694423168 00000100:00100000:0.0:1763334964.578652:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694423296 00000100:00100000:0.0:1763334964.578656:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694423296 00000100:00100000:0.0:1763334964.578687:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4686 00000100:00100000:0.0:1763334964.578696:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694423168:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334964.578711:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.578732:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a650 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8cd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334964.578742:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4687 00000100:00100000:2.0:1763334964.578758:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694423296:12345-192.168.201.60@tcp:101:lfs.0 00002000:00010000:0.0:1763334964.578766:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x22b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334964.578768:0:7819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.578786:0:7819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a657 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8d4 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.578790:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.578794:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.578807:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a650 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8cd expref: 22 pid: 6517 timeout: 0 lvb_type: 1 00002000:00010000:2.0:1763334964.578812:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334964.578827:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.578829:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a650 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8cd expref: 22 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334964.578830:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334964.578839:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8d4 expref: 23 pid: 7819 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334964.578851:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00010000:00010000:2.0:1763334964.578856:0:7819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8d4 expref: 23 pid: 7819 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334964.578868:0:7819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:0.0:1763334964.578907:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694423168:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 212us (1827us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.578917:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4686 00000100:00100000:2.0:1763334964.579060:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694423296:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 307us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.579067:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4687 00000100:00100000:3.0:1763334964.584203:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.584738:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694423808 00000100:00100000:1.0:1763334964.584753:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694423808 00000100:00100000:1.0:1763334964.584832:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1685 00000100:00100000:1.0:1763334964.584844:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53012:x1848989694423808:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334964.585367:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53012:x1848989694423808:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 523us (1177us total) trans 8589938807 rc 0/0 00000100:00100000:1.0:1763334964.585378:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1685 00000100:00100000:0.0:1763334964.587380:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.587554:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701821952:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334964.587612:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334964.587690:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694423936 00000100:00100000:3.0:1763334964.587701:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694423936 00010000:00010000:3.0:1763334964.587744:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a634 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8c6 expref: 189 pid: 30972 timeout: 1129 lvb_type: 0 00000100:00100000:3.0:1763334964.587781:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2477 00000100:00100000:3.0:1763334964.587792:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2359:x1848989694423936:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334964.587808:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334964.587816:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a634 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8c6 expref: 189 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.587830:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a634 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8c6 expref: 189 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.587860:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a634 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8c6 expref: 189 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.587878:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:3.0:1763334964.587883:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.587894:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.587902:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.587932:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334964.588008:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+188:2359:x1848989694423936:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 217us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.588015:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2477 00010000:00010000:1.0:1763334964.588112:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.588120:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334964.588143:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 0 00010000:00010000:1.0:1763334964.588360:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a642 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8db expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.588381:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8db expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.588390:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:1.0:1763334964.588393:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334964.588396:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334964.588445:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694423552:12345-192.168.201.60@tcp:101:bash.0 Request processed in 10899us (11430us total) trans 8589938808 rc 0/0 00000100:00100000:1.0:1763334964.588453:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4574 00000100:00100000:0.0:1763334964.589361:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.589458:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694424192 00000100:00100000:1.0:1763334964.589468:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694424192 00000100:00100000:1.0:1763334964.589658:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4575 00000100:00100000:1.0:1763334964.589669:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53012:x1848989694424192:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.589694:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.589717:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a665 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8e2 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.589827:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a66c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.589843:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a66c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.589855:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a66c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.589870:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a673 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.589878:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a673 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.589889:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a673 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590043:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a67a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590052:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a67a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590060:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a67a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334964.590072:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 0 00010000:00010000:1.0:1763334964.590177:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a66c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590185:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a66c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590192:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a66c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590200:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.590205:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a66c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590214:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a66c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590227:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.590230:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.590235:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a66c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590245:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a66c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590269:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a673 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590276:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a673 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590281:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a673 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590287:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.590289:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a673 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590296:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a673 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590303:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28faa00) 00010000:00010000:1.0:1763334964.590305:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.590308:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a673 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590314:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a673 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.590358:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a665 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8e2 expref: 191 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.590373:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a67a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8e2 expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.590386:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:1.0:1763334964.590389:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763334964.590392:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334964.591308:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53012:x1848989694424192:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1632us (1947us total) trans 8589938809 rc 0/0 00000100:00100000:1.0:1763334964.591320:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4575 00000100:00100000:0.0:1763334964.593771:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.593861:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694424448 00000100:00100000:1.0:1763334964.593878:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694424448 00000100:00100000:1.0:1763334964.593954:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4576 00000100:00100000:1.0:1763334964.593965:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52274:x1848989694424448:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1763334964.594402:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.594426:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a67a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8e2 expref: 191 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.594437:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.594484:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a67a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8e2 expref: 191 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.594499:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a67a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8e2 expref: 191 pid: 29627 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.594517:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701822080:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334964.594686:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee240 going to sleep for 11 seconds 00000100:00100000:2.0:1763334964.598832:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.598960:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694424704 00000100:00100000:1.0:1763334964.598972:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701822080:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334964.598973:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694424704 00010000:00010000:1.0:1763334964.599015:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334964.599060:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1686 00000100:00100000:3.0:1763334964.599073:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53012:x1848989694424704:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334964.599496:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53012:x1848989694424704:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 424us (678us total) trans 8589938811 rc 0/0 00000100:00100000:3.0:1763334964.599504:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1686 00000100:00100000:2.0:1763334964.606776:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.606838:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694424832 00000100:00100000:1.0:1763334964.606853:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694424832 00000100:00100000:2.0:1763334964.606855:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.606932:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1687 00000100:00100000:0.0:1763334964.606938:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694424960 00000100:00100000:0.0:1763334964.606944:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694424960 00000100:00100000:1.0:1763334964.606946:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53012:x1848989694424832:12345-192.168.201.60@tcp:33:lfs.0 00010000:00010000:0.0:1763334964.606981:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a67a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8e2 expref: 194 pid: 29627 timeout: 1129 lvb_type: 0 00000100:00100000:0.0:1763334964.607021:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2478 00000100:00100000:0.0:1763334964.607030:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2361:x1848989694424960:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334964.607046:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334964.607053:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a67a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8e2 expref: 194 pid: 29627 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.607073:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a67a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8e2 expref: 194 pid: 29627 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.607104:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a67a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8e2 expref: 194 pid: 29627 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.607121:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334964.607127:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.607138:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.607147:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334964.607155:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53012:x1848989694424832:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 210us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.607165:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1687 00010000:00010000:0.0:1763334964.607185:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334964.607208:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2361:x1848989694424960:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 180us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.607214:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2478 00010000:00010000:0.0:1763334964.607241:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.607248:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:0.0:1763334964.607410:0:29627:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938810 00000004:00010000:0.0:1763334964.607472:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d97048d6 reply state 00000000e63e126d transno 8589938812 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334964.607486:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334964.607534:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52274:x1848989694424448:12345-192.168.201.60@tcp:36:bash.0 Request processed in 13572us (13778us total) trans 8589938812 rc 0/0 00000100:00100000:0.0:1763334964.607541:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4576 00000020:00080000:0.0:1763334964.607545:0:29627:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1763334964.610443:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.610467:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.610476:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.610483:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.610488:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.610497:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.610522:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:2.0:1763334964.610527:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.610534:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.610541:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a688 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334964.612543:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.613852:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694425088 00000100:00100000:0.0:1763334964.613872:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694425088 00000100:00100000:0.0:1763334964.613952:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4577 00000100:00100000:0.0:1763334964.613962:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52274:x1848989694425088:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334964.613992:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.614018:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a68f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8e9 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.614096:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a68f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8e9 expref: 193 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.614113:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a68f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8e9 expref: 193 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.614136:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334964.614140:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334964.614144:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334964.614235:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52274:x1848989694425088:12345-192.168.201.60@tcp:101:bash.0 Request processed in 273us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.614243:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4577 00000100:00100000:0.0:1763334964.620969:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.621077:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694425344 00000100:00100000:2.0:1763334964.621093:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694425344 00000100:00100000:2.0:1763334964.621173:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4578 00000100:00100000:2.0:1763334964.621188:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52274:x1848989694425344:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334964.621218:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.621222:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334964.621278:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a68f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8e9 expref: 193 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.621304:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:2.0:1763334964.621312:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334964.621334:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a696 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8f0 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.621413:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a69d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.621431:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a69d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.621445:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a69d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:2.0:1763334964.621928:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1073, 88 off92288 00000004:00080000:2.0:1763334964.621937:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1029255364003ns, next at 1030101436569ns, rc = 0 00000040:00080000:2.0:1763334964.621977:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1062, 88 off91200 00000004:00080000:2.0:1763334964.621982:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1029255410015ns, next at 1030101395439ns, rc = 0 00000040:00080000:2.0:1763334964.622015:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1063, 88 off91288 00000004:00080000:2.0:1763334964.622019:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1029255447368ns, next at 1030101395439ns, rc = 0 00000040:00080000:2.0:1763334964.622031:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1074, 88 off92376 00000004:00080000:2.0:1763334964.622034:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1029255462279ns, next at 1030101436569ns, rc = 0 00000100:00100000:2.0:1763334964.632936:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.634128:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694425600 00000100:00100000:1.0:1763334964.634150:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694425600 00000100:00100000:1.0:1763334964.634225:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4579 00000100:00100000:1.0:1763334964.634239:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53013:x1848989694425600:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.634768:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.634803:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6a4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8f7 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.635639:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ab lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.635663:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ab lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.635676:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ab lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.635692:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6b2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.635699:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.635705:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636103:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a6b9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636114:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636120:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334964.636133:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 2 00010000:00010000:1.0:1763334964.636328:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a6b9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636337:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a6b9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636346:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a6b9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636354:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.636359:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a6b9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636369:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a6b9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636385:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:1.0:1763334964.636389:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:1.0:1763334964.636396:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a6b9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636403:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a6b9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636431:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ab lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636437:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ab lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636442:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ab lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636448:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.636451:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ab lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636456:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ab lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636464:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.636466:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.636470:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636475:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636484:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6b2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636489:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6b2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636495:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636500:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.636503:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6b2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636509:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6b2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636517:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28faa00) 00010000:00010000:1.0:1763334964.636519:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.636522:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6b2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636527:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6b2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.636614:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6a4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8f7 expref: 197 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.636628:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.636635:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334964.636640:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6a4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8f7 expref: 197 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.636652:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334964.636758:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53013:x1848989694425600:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2522us (3838us total) trans 8589938814 rc 301/301 00000100:00100000:1.0:1763334964.636768:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4579 00000100:00100000:3.0:1763334964.645981:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.646047:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694425728 00000100:00100000:3.0:1763334964.646062:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694425728 00000100:00100000:3.0:1763334964.646138:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4580 00000100:00100000:3.0:1763334964.646150:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53013:x1848989694425728:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334964.646178:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.646209:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a6c7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af8fe expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.646350:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.646371:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8db expref: 197 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.646381:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a69d lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.646389:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 5/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.646413:0:29627:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a69d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.646445:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8db expref: 197 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.646464:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8db expref: 197 pid: 29627 timeout: 1129 lvb_type: 0 00000100:00100000:3.0:1763334964.646484:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af59f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701822208:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334964.646641:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1763334964.650302:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af59f8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701822208:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334964.650349:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334964.652765:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.653050:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694425856 00000100:00100000:0.0:1763334964.653064:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694425856 00010000:00010000:0.0:1763334964.653114:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8db expref: 198 pid: 29627 timeout: 1129 lvb_type: 0 00000100:00100000:0.0:1763334964.653162:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2479 00000100:00100000:0.0:1763334964.653172:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+198:2359:x1848989694425856:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334964.653190:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334964.653199:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8db expref: 198 pid: 29627 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.653213:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8db expref: 198 pid: 29627 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.653243:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a649 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8db expref: 198 pid: 29627 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.653276:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334964.653282:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.653293:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.653299:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.653312:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334964.653394:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88ec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694425856:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 222us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.653402:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2479 00000001:00080000:1.0:1763334964.671306:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938812 is committed 00000001:00080000:1.0:1763334964.671368:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938813 is committed 00000004:00080000:1.0:1763334964.671375:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 708 committed 00000004:00080000:1.0:1763334964.671386:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 696 committed 00000004:00080000:1.0:1763334964.671393:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 695 committed 00000004:00080000:1.0:1763334964.671396:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 707 committed 00000004:00080000:1.0:1763334964.671412:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 706 committed 00000004:00080000:1.0:1763334964.671415:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 694 committed 00000100:00100000:1.0:1763334964.671758:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701822720:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.671855:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.671906:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1763334964.671912:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701822336:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.671935:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.671953:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701822848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.671971:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.671994:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701822464:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.672015:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.672034:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701822976:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.672053:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.672070:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763334964.672076:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701822592:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.672097:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.672148:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701822720 00000100:00100000:3.0:1763334964.672621:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701823488:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334964.672663:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334964.672686:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1763334964.672690:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af59faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701823104:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334964.672707:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334964.672718:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701823616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334964.672732:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334964.672754:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701822336 00000100:00100000:3.0:1763334964.672761:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701822336 00000100:00100000:3.0:1763334964.672808:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701822848 00000100:00100000:3.0:1763334964.672810:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701822848 00000100:00100000:3.0:1763334964.672819:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701822464 00000100:00100000:3.0:1763334964.672821:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701822464 00000100:00100000:3.0:1763334964.672828:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701822976 00000100:00100000:3.0:1763334964.672829:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701822976 00000100:00100000:3.0:1763334964.672837:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701822592 00000100:00100000:3.0:1763334964.672839:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701822592 00000100:00100000:3.0:1763334964.672846:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701823488 00000100:00100000:3.0:1763334964.672848:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701823488 00000100:00100000:3.0:1763334964.672856:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701823104 00000100:00100000:3.0:1763334964.672858:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701823104 00000100:00100000:3.0:1763334964.672864:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701823616 00000100:00100000:3.0:1763334964.672867:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701823616 00000100:00100000:3.0:1763334964.672880:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4688 00000100:00100000:3.0:1763334964.672889:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3289:x1848989701822336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334964.672919:0:32239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:556 count 1 00010000:00010000:3.0:1763334964.672953:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.672979:0:32239:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f849a500 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af872 expref: 22 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.672988:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334964.672990:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334964.672995:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.673024:0:32239:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f849a500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af872 expref: 22 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.673039:0:32239:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f849a500 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af872 expref: 22 pid: 7819 timeout: 1129 lvb_type: 0 00000100:00100000:3.0:1763334964.673051:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:32239:1848989701823872:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334964.673125:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b480 going to sleep for 11 seconds 00000100:00100000:3.0:1763334964.673146:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4689 00000100:00100000:3.0:1763334964.673154:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3289:x1848989701822848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334964.673459:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3289:x1848989701822848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 304us (1485us total) trans 17179871037 rc 0/0 00000100:00100000:3.0:1763334964.673468:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4689 00000100:00100000:3.0:1763334964.673493:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4690 00000100:00100000:3.0:1763334964.673501:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3291:x1848989701822464:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334964.673511:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:557 count 1 00002000:00010000:3.0:1763334964.673536:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334964.673542:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a6dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.673551:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.673553:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.673558:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a6dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.673601:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a6dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.673613:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a6dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.673621:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a6dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.673990:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a69d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8f0 expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.674004:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334964.674007:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763334964.674011:0:30972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.674021:0:30972:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.674027:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.674071:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849a696 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8f0 expref: 180 pid: 30972 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1763334964.674092:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a69d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8f0 expref: 179 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.674129:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067c00, rc 0) 00000100:00100000:0.0:1763334964.674176:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:52274:x1848989694425344:12345-192.168.201.60@tcp:101:bash.0 Request processed in 52993us (53222us total) trans 8589938813 rc 0/0 00000100:00100000:0.0:1763334964.674185:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4578 00010000:00010000:0.0:1763334964.674227:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.674236:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:0.0:1763334964.674287:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 2 00000004:00200000:0.0:1763334964.674293:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334964.674315:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.674345:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849a6c7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8fe expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.674358:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8fe expref: 178 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.674364:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334964.674366:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763334964.674368:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fe00, rc 0) 00000100:00100000:0.0:1763334964.674402:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53013:x1848989694425728:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 28254us (28436us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.674408:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4580 00000100:00100000:1.0:1763334964.675605:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701822720 00000100:00100000:2.0:1763334964.675655:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af59f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701823232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334964.675669:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4691 00000100:00100000:1.0:1763334964.675681:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701822976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334964.675728:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334964.675760:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac721a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701823744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334964.675787:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763334964.675835:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b4380/2, rc 0, transno 17179871037 00000100:00100000:2.0:1763334964.675843:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701822848:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334964.675860:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763334964.675866:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701823360:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334964.675893:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334964.675926:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701823232 00000100:00100000:2.0:1763334964.675930:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701823232 00000100:00100000:2.0:1763334964.675951:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701823744 00000100:00100000:2.0:1763334964.675953:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701823744 00000100:00100000:2.0:1763334964.675961:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701823360 00000100:00100000:2.0:1763334964.675964:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701823360 00000100:00100000:2.0:1763334964.675976:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4692 00000100:00100000:2.0:1763334964.675983:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701822592:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334964.676057:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4693 00000100:00100000:0.0:1763334964.676068:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3291:x1848989701823488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334964.676089:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:549 count 1 00010000:00010000:0.0:1763334964.676118:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.676139:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a482 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af848 expref: 21 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.676152:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334964.676154:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334964.676157:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.676196:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a482 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af848 expref: 21 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.676208:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a482 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af848 expref: 21 pid: 21625 timeout: 1129 lvb_type: 0 00000100:00100000:0.0:1763334964.676219:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21625:1848989701824000:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334964.676312:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1763334964.676333:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4694 00000100:00100000:0.0:1763334964.676342:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+32:3291:x1848989701823104:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334964.676358:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:552 count 1 00010000:00010000:0.0:1763334964.676371:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.676384:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a4f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af86b expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.676390:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334964.676391:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334964.676394:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 4/0,1 mode: --/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.676419:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a4f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af86b expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.676429:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a4f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af86b expref: 21 pid: 26564 timeout: 1129 lvb_type: 0 00000100:00100000:0.0:1763334964.676438:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701824128:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334964.676463:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1480 going to sleep for 11 seconds 00002000:00010000:1.0:1763334964.677497:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334964.677508:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763334964.677510:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334964.677513:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763334964.677517:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334964.677626:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701822976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1946us (5568us total) trans 17179871038 rc 0/0 00000100:00100000:0.0:1763334964.677632:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4695 00000100:00100000:1.0:1763334964.677639:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4691 00000100:00100000:0.0:1763334964.677646:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3291:x1848989701823616:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334964.677668:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4696 00000100:00100000:1.0:1763334964.677676:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+16:3289:x1848989701822720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763334964.677689:0:25383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:553 count 1 00010000:00010000:1.0:1763334964.677708:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.677725:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849a47b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af841 expref: 22 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.677733:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334964.677735:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334964.677738:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.677765:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849a47b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af841 expref: 22 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.677776:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849a47b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af841 expref: 22 pid: 25383 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.677789:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6451c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701824256:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334964.677850:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee240 going to sleep for 11 seconds 00000100:00100000:1.0:1763334964.677871:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4697 00000100:00100000:1.0:1763334964.677879:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3289:x1848989701823232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763334964.677905:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:553 count 1 00000100:00100000:0.0:1763334964.677906:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3291:x1848989701823616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 265us (5172us total) trans 21474838320 rc 0/0 00000100:00100000:0.0:1763334964.677912:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4695 00000100:00100000:0.0:1763334964.677929:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4698 00002000:00010000:1.0:1763334964.677930:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x229:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334964.677936:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.677945:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.677958:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.677964:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.677978:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.677990:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.677999:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.678021:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334964.678302:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3289:x1848989701823232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 423us (2573us total) trans 21474838321 rc 0/0 00000100:00100000:1.0:1763334964.678309:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4697 00000100:00100000:1.0:1763334964.678326:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4699 00000100:00100000:1.0:1763334964.678334:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3289:x1848989701823360:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763334964.678351:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:548 count 1 00010000:00010000:1.0:1763334964.678364:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.678378:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a4b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af856 expref: 21 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.678384:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334964.678386:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334964.678388:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 4/0,1 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.678408:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a4b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af856 expref: 21 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.678417:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a4b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af856 expref: 21 pid: 21625 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.678429:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6451880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701824384:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334964.678457:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee300 going to sleep for 11 seconds 00010000:00010000:1.0:1763334964.678475:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334964.678481:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.678489:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334964.678494:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.678508:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.678529:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.678535:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a6f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.678552:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.678554:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.678556:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763334964.678629:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af59f8e00/2, rc 0, transno 21474838321 00000100:00100000:1.0:1763334964.678637:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af59f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701823232:0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334964.678757:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:552 count 1 00010000:00010000:2.0:1763334964.678775:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.678789:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f849a213 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af776 expref: 22 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.678796:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334964.678797:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334964.678800:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334964.678813:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+32:3289:x1848989701823744:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1763334964.678823:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f849a213 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af776 expref: 22 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.678832:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f849a213 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af776 expref: 22 pid: 26564 timeout: 1129 lvb_type: 0 00000100:00100000:2.0:1763334964.678843:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701824512:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334964.678880:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb66c0 going to sleep for 11 seconds 00002000:00010000:0.0:1763334964.679033:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334964.679037:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb mtime from disk: 0 -> 0 00010000:00010000:3.0:1763334964.679039:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1763334964.679040:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334964.679046:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763334964.679049:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334964.679107:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+33:3289:x1848989701823744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1171us (3318us total) trans 21474838322 rc 0/0 00000100:00100000:0.0:1763334964.679116:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4698 00000004:00080000:0.0:1763334964.679166:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4e300/2, rc 0, transno 21474838320 00000100:00100000:0.0:1763334964.679173:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701823616:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334964.679199:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b4e00/2, rc 0, transno 17179871038 00000100:00100000:0.0:1763334964.679205:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701822976:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334964.679327:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701822464:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5825us (7308us total) trans 17179871039 rc 0/0 00000100:00100000:3.0:1763334964.679336:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4690 00010000:00010000:3.0:1763334964.679363:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334964.679376:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a6dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.679392:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334964.679396:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a6dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.679404:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a6dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000004:00080000:1.0:1763334964.679414:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac721a300/2, rc 0, transno 21474838322 00010000:00010000:3.0:1763334964.679421:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a6dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334964.679421:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac721a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701823744:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1763334964.679435:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a6dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.679465:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334964.679468:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334964.679471:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334964.680785:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b4700/2, rc 0, transno 17179871039 00000100:00100000:0.0:1763334964.680801:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701822464:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334964.684950:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.684993:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.685036:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.685067:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694426112 00000100:00100000:1.0:1763334964.685083:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694426112 00000100:00100000:2.0:1763334964.685104:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.685131:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.685168:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4581 00000100:00100000:1.0:1763334964.685182:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53013:x1848989694426112:12345-192.168.201.60@tcp:101:lfs.0 00000100:00100000:2.0:1763334964.685199:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701824128:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334964.685213:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.685235:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.685242:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a70d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af905 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334964.685290:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3ac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:21625:1848989701824000:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334964.685306:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.685353:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a70d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af905 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.685376:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a70d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af905 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.685405:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:1.0:1763334964.685409:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334964.685413:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334964.685496:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53013:x1848989694426112:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 317us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.685505:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4581 00000100:00100000:1.0:1763334964.685540:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694425984 00000100:00100000:1.0:1763334964.685544:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694425984 00010000:00010000:1.0:1763334964.685567:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f849a500 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af872 expref: 23 pid: 7819 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.685625:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694426368 00000100:00100000:1.0:1763334964.685630:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694426368 00000100:00100000:3.0:1763334964.685636:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:32239:1848989701823872:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334964.685647:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a482 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af848 expref: 22 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.685656:0:32239:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334964.685667:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694426496 00000100:00100000:1.0:1763334964.685671:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694426496 00010000:00010000:1.0:1763334964.685685:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a4f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af86b expref: 23 pid: 26564 timeout: 1129 lvb_type: 0 00000100:00100000:3.0:1763334964.685691:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2480 00000100:00100000:3.0:1763334964.685705:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694425984:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763334964.685710:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2481 00000100:00100000:1.0:1763334964.685721:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694426368:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334964.685724:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334964.685735:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f849a500 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af872 expref: 23 pid: 7819 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.685739:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334964.685748:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a482 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af848 expref: 23 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.685767:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f849a500 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af872 expref: 23 pid: 7819 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.685768:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a482 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af848 expref: 23 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.685807:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a482 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af848 expref: 23 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.685808:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793800/0xcedf0054f849a500 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af872 expref: 23 pid: 7819 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.685837:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.685838:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.685841:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.685843:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.685850:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.685851:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.685875:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.685875:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.685914:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334964.685918:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334964.685944:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694425984:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 242us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.685950:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694426368:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 229us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.685957:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2480 00000100:00100000:1.0:1763334964.685966:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2481 00000100:00100000:3.0:1763334964.685981:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2482 00000100:00100000:3.0:1763334964.685991:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2362:x1848989694426496:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334964.686000:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334964.686006:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a4f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af86b expref: 21 pid: 26564 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.686013:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.686019:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a4f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af86b expref: 21 pid: 26564 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.686028:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.686060:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.686062:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a4f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af86b expref: 21 pid: 26564 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.686076:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.686081:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.686084:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.686088:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.686095:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.686096:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763334964.686119:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334964.686142:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694426496:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 153us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.686150:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2482 00010000:00010000:3.0:1763334964.686171:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.686180:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.686188:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.686195:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.686217:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763334964.686526:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+33:3291:x1848989701823488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10459us (13860us total) trans 21474838323 rc 0/0 00000100:00100000:1.0:1763334964.686535:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4693 00000100:00100000:1.0:1763334964.686554:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694426240 00000100:00100000:1.0:1763334964.686559:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694426240 00000100:00100000:1.0:1763334964.686624:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4700 00000100:00100000:1.0:1763334964.686632:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:52274:x1848989694426240:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334964.686646:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.686666:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af90c expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334964.686692:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334964.686704:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.686707:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.686715:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af90c expref: 23 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.686728:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af90c expref: 23 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.686740:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763334964.686744:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00010000:00010000:0.0:1763334964.686750:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.686760:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334964.686765:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334964.686773:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:52274:x1848989694426240:12345-192.168.201.60@tcp:101:bash.0 Request processed in 140us (1734us total) trans 0 rc 0/0 00010000:00010000:0.0:1763334964.686779:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334964.686784:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4700 00010000:00010000:0.0:1763334964.686800:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.686808:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a6e3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.686826:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334964.686829:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.686834:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334964.686838:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.686845:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.686854:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.686861:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a6ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.686875:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334964.686876:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334964.686879:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334964.686920:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4d180/2, rc 0, transno 21474838323 00000100:00100000:0.0:1763334964.686928:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701823488:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763334964.689645:0:32239:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.689671:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.689685:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.689698:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.689736:0:32239:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334964.689761:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334964.689771:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.689781:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c6e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334964.689786:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.689796:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.689819:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.689825:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a6d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.689856:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.689858:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334964.689860:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334964.690183:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701822336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17289us (18241us total) trans 17179871040 rc 0/0 00000100:00100000:2.0:1763334964.690195:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4688 00000004:00080000:1.0:1763334964.690327:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b6680/2, rc 0, transno 17179871040 00000100:00100000:1.0:1763334964.690337:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701822336:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334964.690559:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3291:x1848989701823104:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14217us (17848us total) trans 21474838324 rc 0/0 00000100:00100000:3.0:1763334964.690568:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4694 00010000:00010000:3.0:1763334964.690617:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334964.690710:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af59faa00/2, rc 0, transno 21474838324 00000100:00100000:0.0:1763334964.690717:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af59faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701823104:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334964.694340:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6451880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701824384:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334964.694380:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334964.694550:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.694626:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.694669:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.694699:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694426624 00000100:00100000:1.0:1763334964.694709:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694426624 00010000:00010000:1.0:1763334964.694755:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a4b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af856 expref: 20 pid: 21625 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.694792:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694426752 00000100:00100000:1.0:1763334964.694795:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694426752 00010000:00010000:1.0:1763334964.694813:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849a47b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af841 expref: 23 pid: 25383 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.694840:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694426880 00000100:00100000:1.0:1763334964.694843:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694426880 00010000:00010000:1.0:1763334964.694859:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f849a213 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af776 expref: 24 pid: 26564 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.694874:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2483 00000100:00100000:1.0:1763334964.694885:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694426624:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334964.694914:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334964.694920:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a4b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af856 expref: 20 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.694931:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a4b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af856 expref: 20 pid: 21625 timeout: 1129 lvb_type: 0 00000100:00100000:2.0:1763334964.695169:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2484 00000100:00100000:2.0:1763334964.695181:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6450000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694426752:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334964.695193:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334964.695198:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849a47b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af841 expref: 24 pid: 25383 timeout: 1129 lvb_type: 0 00010000:00010000:2.0:1763334964.695210:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849a47b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af841 expref: 24 pid: 25383 timeout: 1129 lvb_type: 0 00010000:00010000:2.0:1763334964.695236:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334964.695239:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334964.695244:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.695703:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849a4b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af856 expref: 20 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.695726:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.695728:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.695732:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.695745:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.695786:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334964.695854:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2485 00010000:00010000:3.0:1763334964.695864:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849a47b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af841 expref: 24 pid: 25383 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.695865:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694426624:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 978us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.695873:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694426880:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763334964.695886:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2483 00010000:00010000:0.0:1763334964.695891:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1763334964.695896:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6451c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701824256:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334964.695902:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f849a213 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af776 expref: 23 pid: 26564 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.695929:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f849a213 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af776 expref: 23 pid: 26564 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.695949:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.695952:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.695956:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.695976:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.695979:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.696000:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334964.696027:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694426880:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 163us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.696033:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2485 00010000:00010000:0.0:1763334964.696098:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066c00/0xcedf0054f849a213 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af776 expref: 22 pid: 26564 timeout: 1129 lvb_type: 0 00000100:00100000:0.0:1763334964.696110:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701824512:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334964.696140:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.696152:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.696159:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.696170:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.696181:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.696202:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334964.696493:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.696609:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.696686:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701822592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20700us (24585us total) trans 17179871041 rc 0/0 00000100:00100000:0.0:1763334964.696696:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4692 00000004:00080000:0.0:1763334964.696747:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b7100/2, rc 0, transno 17179871041 00000100:00100000:0.0:1763334964.696754:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701822592:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334964.696776:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694427008 00000100:00100000:0.0:1763334964.696782:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694427008 00000100:00100000:0.0:1763334964.696819:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4701 00000100:00100000:0.0:1763334964.696828:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+19:52274:x1848989694427008:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334964.696845:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.696896:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a71b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af913 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334964.696927:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x22a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334964.696945:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.696947:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.696955:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a71b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af913 expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.696971:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a71b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af913 expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.696989:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334964.697019:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+20:52274:x1848989694427008:12345-192.168.201.60@tcp:101:bash.0 Request processed in 193us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.697027:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4701 00010000:00010000:0.0:1763334964.697077:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697087:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697096:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697104:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697120:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763334964.697381:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+33:3289:x1848989701823360:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19046us (21485us total) trans 21474838325 rc 0/0 00000100:00100000:0.0:1763334964.697389:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4699 00010000:00010000:0.0:1763334964.697416:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763334964.697424:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697432:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334964.697437:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697450:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697466:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697473:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849a706 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697492:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334964.697496:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697502:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334964.697506:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697514:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697524:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697531:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a6ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.697556:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334964.697558:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334964.697561:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763334964.697607:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4d500/2, rc 0, transno 21474838325 00000100:00100000:1.0:1763334964.697615:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701823360:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334964.697641:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.697665:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694427392 00000100:00100000:1.0:1763334964.697669:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694427392 00000100:00100000:1.0:1763334964.697711:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 387 00000100:00100000:1.0:1763334964.697717:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+179:2362:x1848989694427392:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334964.697729:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334964.697749:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a70d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af905 expref: 179 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.697764:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:1.0:1763334964.697769:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334964.697799:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+178:2362:x1848989694427392:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 82us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.697805:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 387 00010000:00010000:1.0:1763334964.698884:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334964.698916:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694427264 00000100:00100000:1.0:1763334964.698928:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694427264 00000100:00100000:1.0:1763334964.698996:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1688 00000100:00100000:1.0:1763334964.699006:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+178:53013:x1848989694427264:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334964.699253:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53013:x1848989694427264:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 248us (2644us total) trans 8589938815 rc 0/0 00000100:00100000:1.0:1763334964.699269:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1688 00010000:00010000:2.0:1763334964.704251:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334964.704436:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334964.705004:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6450000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694426752:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 9815us (10365us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.705019:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2484 00010000:00010000:3.0:1763334964.705303:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.705315:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.705329:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.705338:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.705364:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334964.705869:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701822720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 28192us (34011us total) trans 17179871042 rc 0/0 00000100:00100000:3.0:1763334964.705879:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4696 00000100:00100000:0.0:1763334964.705996:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.706147:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.706195:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000004:00080000:0.0:1763334964.706295:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b7800/2, rc 0, transno 17179871042 00000100:00100000:0.0:1763334964.706304:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701822720:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763334964.706328:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334964.706337:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.706348:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334964.706353:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.706363:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.706386:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.706394:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849a6f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.706422:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334964.706423:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334964.706425:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334964.706448:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694427776 00000100:00100000:0.0:1763334964.706456:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694427776 00000100:00100000:0.0:1763334964.706504:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4582 00000100:00100000:0.0:1763334964.706512:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53013:x1848989694427776:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334964.706538:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.706561:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a722 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af91a expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.706671:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a729 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.706694:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a729 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.706704:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a729 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.706719:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a730 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.706727:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a730 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.706733:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a730 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.706980:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a737 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.706991:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a737 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.706998:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a737 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334964.707039:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 2 00000004:00200000:0.0:1763334964.707045:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334964.707067:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a737 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707080:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a737 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707088:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a729 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707094:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a729 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707101:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a729 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707106:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.707110:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a729 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707116:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a729 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707125:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334964.707129:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.707133:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a729 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707140:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a729 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707149:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a730 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707155:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a730 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707160:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a730 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707165:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.707168:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a730 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707173:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a730 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707181:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334964.707184:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.707186:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a730 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707191:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a730 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.707224:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a722 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af91a expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.707237:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a737 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af91a expref: 180 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.707250:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334964.707252:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334964.707254:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334964.707333:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53013:x1848989694427776:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 820us (1137us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.707340:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4582 00000100:00100000:3.0:1763334964.708396:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694427520 00000100:00100000:3.0:1763334964.708407:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694427520 00002000:00010000:3.0:1763334964.708459:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/558 (0->18446744073709551615) 00002000:00100000:3.0:1763334964.708465:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a81500 with x1848989694427520 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334964.708476:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a81500. 00000100:00100000:3.0:1763334964.708516:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694427648 00000100:00100000:3.0:1763334964.708521:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694427648 00002000:00010000:3.0:1763334964.708535:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/554 (0->18446744073709551615) 00002000:00100000:3.0:1763334964.708539:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afc8c2680 with x1848989694427648 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334964.708552:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afc8c2680. 00000100:00100000:3.0:1763334964.708590:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1720 00000100:00100000:3.0:1763334964.708600:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694427520:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334964.708963:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334964.708968:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb mtime from disk: 0 -> 1763334965 00002000:00010000:3.0:1763334964.708971:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334964.708973:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb ctime from disk: 0 -> 1763334965 00002000:00010000:3.0:1763334964.708976:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334964.709031:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694427520:12345-192.168.201.60@tcp:10:bash.0 Request processed in 432us (3035us total) trans 17179871043 rc 0/0 00000100:00100000:3.0:1763334964.709039:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1720 00002000:00010000:3.0:1763334964.709044:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/558 (0->18446744073709551615) 00002000:00100000:3.0:1763334964.709047:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a81500 with x1848989694427520 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334964.709052:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a81500. 00000100:00100000:3.0:1763334964.709070:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1721 00000100:00100000:3.0:1763334964.709079:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694427648:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334964.709255:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334964.709272:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb mtime from disk: 0 -> 1763334965 00002000:00010000:3.0:1763334964.709274:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334964.709277:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb ctime from disk: 0 -> 1763334965 00002000:00010000:3.0:1763334964.709279:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334964.709304:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694427648:12345-192.168.201.60@tcp:10:bash.0 Request processed in 226us (3156us total) trans 21474838326 rc 0/0 00000100:00100000:3.0:1763334964.709312:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1721 00002000:00010000:3.0:1763334964.709316:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/554 (0->18446744073709551615) 00002000:00100000:3.0:1763334964.709319:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afc8c2680 with x1848989694427648 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334964.709324:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afc8c2680. 00000100:00100000:0.0:1763334964.734158:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.734537:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694428032 00000100:00100000:1.0:1763334964.734552:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694428032 00000100:00100000:1.0:1763334964.734743:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4583 00000100:00100000:1.0:1763334964.734757:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53014:x1848989694428032:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.734787:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.734817:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a73e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af921 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.734958:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a745 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.734979:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a745 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.734999:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a745 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334964.735015:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 2 00000100:00100000:0.0:1763334964.735064:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.735137:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694428288 00000100:00100000:2.0:1763334964.735143:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694428288 00000100:00100000:2.0:1763334964.735188:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1689 00000100:00100000:2.0:1763334964.735198:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01d11c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52274:x1848989694428288:12345-192.168.201.60@tcp:35:bash.0 00010000:00010000:1.0:1763334964.735503:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a73e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af921 expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.735530:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a745 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af921 expref: 183 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.735540:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:1.0:1763334964.735544:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763334964.735549:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:1.0:1763334964.735677:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53014:x1848989694428032:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 922us (1536us total) trans 8589938816 rc 0/0 00000100:00100000:1.0:1763334964.735685:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4583 00000100:00100000:2.0:1763334964.736486:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01d11c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52274:x1848989694428288:12345-192.168.201.60@tcp:35:bash.0 Request processed in 1286us (1418us total) trans 8589938817 rc 0/0 00000100:00100000:2.0:1763334964.736496:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1689 00000100:00100000:0.0:1763334964.740091:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.740162:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694428544 00000100:00100000:1.0:1763334964.740177:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694428544 00000100:00100000:1.0:1763334964.740268:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4584 00000100:00100000:1.0:1763334964.740282:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53014:x1848989694428544:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.740316:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.740347:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a753 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af928 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.740461:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.740477:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8fe expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.740485:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a737 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af91a expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.740496:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 5/0,1 mode: --/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.740538:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a737 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af91a expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.740550:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a737 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af91a expref: 184 pid: 30972 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.740563:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6452680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701824640:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334964.740683:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8fe expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.740689:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8fe expref: 184 pid: 29627 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.740696:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6450e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701824768:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334964.740712:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334964.743478:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.743617:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.743721:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6452680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701824640:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334964.743736:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6450e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701824768:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334964.743937:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334964.744632:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694428672 00000100:00100000:2.0:1763334964.744645:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694428672 00010000:00010000:2.0:1763334964.744701:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a737 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af91a expref: 185 pid: 30972 timeout: 1129 lvb_type: 0 00000100:00100000:2.0:1763334964.744742:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694428800 00000100:00100000:2.0:1763334964.744745:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694428800 00010000:00010000:2.0:1763334964.744758:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8fe expref: 186 pid: 29627 timeout: 1129 lvb_type: 0 00000100:00100000:2.0:1763334964.744781:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2486 00000100:00100000:2.0:1763334964.744792:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2360:x1848989694428672:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334964.744813:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334964.744821:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a737 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af91a expref: 186 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:2.0:1763334964.744834:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a737 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af91a expref: 186 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:2.0:1763334964.744866:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a737 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af91a expref: 186 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:2.0:1763334964.744885:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:2.0:1763334964.744890:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.744898:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.744905:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334964.745226:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2487 00000100:00100000:3.0:1763334964.745237:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:2360:x1848989694428800:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334964.745247:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334964.745254:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8fe expref: 185 pid: 29627 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.745274:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8fe expref: 185 pid: 29627 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.745289:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849a6ce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8fe expref: 185 pid: 29627 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.745300:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:3.0:1763334964.745304:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.745313:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.745321:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.745343:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334964.745781:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.745791:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334964.745822:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 5 00000100:00100000:2.0:1763334964.746068:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2360:x1848989694428672:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1274us (2603us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.746079:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2486 00000100:00100000:3.0:1763334964.746167:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:2360:x1848989694428800:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 930us (2549us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.746175:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2487 00000100:00100000:0.0:1763334964.746214:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334964.746399:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a753 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af928 expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.746420:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af928 expref: 183 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.746428:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:1.0:1763334964.746431:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334964.746434:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334964.746481:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53014:x1848989694428544:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6204us (6408us total) trans 8589938818 rc 0/0 00000100:00100000:1.0:1763334964.746489:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4584 00000100:00100000:3.0:1763334964.746719:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694428928 00000100:00100000:3.0:1763334964.746728:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694428928 00000100:00100000:1.0:1763334964.746896:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4585 00000100:00100000:1.0:1763334964.746908:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53015:x1848989694428928:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:1.0:1763334964.747128:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.747151:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a768 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af92f expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.747274:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a76f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.747289:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a76f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.747300:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a76f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.747322:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a776 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.747329:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a776 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.747336:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a776 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.748255:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a77d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.748308:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af928 expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.748318:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a77d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.748370:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af928 expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.748387:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af928 expref: 184 pid: 29627 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.748406:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6450e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701824896:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334964.748524:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334964.752653:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.753824:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694429056 00000100:00100000:0.0:1763334964.753842:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694429056 00000100:00100000:0.0:1763334964.753940:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4586 00000100:00100000:0.0:1763334964.753953:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53014:x1848989694429056:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334964.753989:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.754705:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a784 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af936 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.754888:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.754908:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.754920:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334964.756852:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6450e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701824896:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334964.756871:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334964.756908:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a77d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334964.757399:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694429184 00000100:00100000:3.0:1763334964.757412:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694429184 00010000:00010000:3.0:1763334964.757459:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af928 expref: 187 pid: 29627 timeout: 1129 lvb_type: 0 00000100:00100000:3.0:1763334964.757505:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2488 00000100:00100000:3.0:1763334964.757516:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+187:2359:x1848989694429184:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334964.757539:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334964.757547:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af928 expref: 187 pid: 29627 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.757561:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af928 expref: 187 pid: 29627 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.757617:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a75a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x194:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af928 expref: 187 pid: 29627 timeout: 1129 lvb_type: 0 00010000:00010000:3.0:1763334964.757643:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:3.0:1763334964.757649:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a77d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.757661:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a77d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.757670:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a77d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.757679:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.757685:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.757691:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.757729:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334964.757808:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2359:x1848989694429184:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 292us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.757817:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2488 00010000:00010000:1.0:1763334964.758195:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a77d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758204:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a77d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334964.758279:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 5 00000004:00200000:1.0:1763334964.758285:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334964.758316:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a77d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758332:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a77d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758343:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a76f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758350:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a76f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758357:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a76f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758363:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.758368:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a76f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758377:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a76f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758388:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.758391:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.758396:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a76f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758403:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849a76f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758416:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a776 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758422:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a776 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758427:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a776 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758432:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.758434:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a776 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758440:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a776 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758446:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa200) 00010000:00010000:1.0:1763334964.758449:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334964.758452:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a776 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758457:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a776 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334964.758509:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849a768 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af92f expref: 186 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.758528:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a77d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af92f expref: 185 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.758540:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:1.0:1763334964.758543:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334964.758545:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334964.758635:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53015:x1848989694428928:12345-192.168.201.60@tcp:101:rm.0 Request processed in 11729us (12422us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.758644:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4585 00010000:00010000:0.0:1763334964.759003:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.759012:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334964.759037:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 5 00000004:00200000:0.0:1763334964.759041:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334964.759054:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.759082:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a784 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af936 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.759096:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af936 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.759104:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334964.759106:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334964.759108:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334964.759158:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53014:x1848989694429056:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5208us (6522us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.759166:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4586 00000100:00100000:1.0:1763334964.768361:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.768731:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694429440 00000100:00100000:2.0:1763334964.768753:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694429440 00000100:00100000:2.0:1763334964.768840:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1690 00000100:00100000:2.0:1763334964.768853:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53015:x1848989694429440:12345-192.168.201.60@tcp:35:rm.0 00000100:00100000:2.0:1763334964.769227:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53015:x1848989694429440:12345-192.168.201.60@tcp:35:rm.0 Request processed in 375us (886us total) trans 8589938819 rc 0/0 00000100:00100000:2.0:1763334964.769239:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1690 00000100:00100000:1.0:1763334964.772309:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.775079:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694429696 00000100:00100000:0.0:1763334964.775100:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694429696 00000100:00100000:0.0:1763334964.775723:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4587 00000100:00100000:0.0:1763334964.775737:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53014:x1848989694429696:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334964.775775:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.775806:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a792 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af93d expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.775945:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a799 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.775965:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a799 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334964.775978:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a799 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334964.775995:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 5 00000100:00100000:3.0:1763334964.776159:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334964.776169:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a792 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af93d expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.776193:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a799 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af93d expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.776203:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334964.776207:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334964.776212:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:2.0:1763334964.776228:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694429952 00000100:00100000:2.0:1763334964.776237:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694429952 00000100:00100000:2.0:1763334964.776293:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4588 00000100:00100000:0.0:1763334964.776309:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53014:x1848989694429696:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 574us (4018us total) trans 8589938820 rc 0/0 00000100:00100000:0.0:1763334964.776318:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4587 00000100:00100000:2.0:1763334964.776689:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53015:x1848989694429952:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:2.0:1763334964.776730:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1763334964.776749:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a77d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af92f expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.776767:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a745 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af921 expref: 186 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.776782:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a69d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8f0 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.776791:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:2.0:1763334964.776795:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334964.776914:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a7a7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.776926:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a7a7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.776934:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a7a7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.776949:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a7ae lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.776955:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a7ae lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.776963:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a7ae lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.777110:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.777122:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af936 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.777131:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.777403:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af936 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.777419:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af936 expref: 184 pid: 30972 timeout: 1129 lvb_type: 0 00000100:00100000:2.0:1763334964.777437:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701825024:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334964.778742:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb6840 going to sleep for 11 seconds 00000100:00100000:1.0:1763334964.779293:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.779651:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694430080 00000100:00100000:3.0:1763334964.779664:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694430080 00000100:00100000:3.0:1763334964.779736:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4702 00000100:00100000:3.0:1763334964.779748:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694430080:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:3.0:1763334964.779803:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.779826:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af90c expref: 22 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.779834:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334964.779837:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334964.779841:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.779881:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af90c expref: 22 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.779895:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af90c expref: 22 pid: 21625 timeout: 1129 lvb_type: 0 00000100:00100000:3.0:1763334964.779910:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701825152:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334964.781326:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334964.781536:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.781704:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701825024:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334964.781738:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334964.782945:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694430208 00000100:00100000:0.0:1763334964.782962:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694430208 00010000:00010000:0.0:1763334964.783021:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af936 expref: 185 pid: 30972 timeout: 1129 lvb_type: 0 00000100:00100000:0.0:1763334964.783072:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2489 00000100:00100000:0.0:1763334964.783091:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:2360:x1848989694430208:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334964.783112:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334964.783120:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af936 expref: 185 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.783134:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af936 expref: 185 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.783161:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a78b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af936 expref: 185 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334964.783179:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334964.783185:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.783197:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.783205:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334964.783241:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334964.783324:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2360:x1848989694430208:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 234us (1791us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.783333:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2489 00010000:00010000:2.0:1763334964.783458:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.783467:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00080000:2.0:1763334964.784109:0:29627:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x194:0x0] is inserted into orphan list, open count = 2 00010000:00010000:2.0:1763334964.784288:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.784299:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.784306:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.784312:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.784317:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.784325:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.784337:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:2.0:1763334964.784340:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763334964.784345:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.784350:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7b5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.784366:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a7a7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.784373:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a7a7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.784378:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a7a7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.784388:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.784391:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a7a7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.784397:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a7a7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.784405:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.784408:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.784411:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a7a7 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334964.784416:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849a7a7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:2.0:1763334964.784427:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fcb20cfd reply state 0000000077eb922c transno 8589938821 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a7ae lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334964.784437:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334964.784507:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53015:x1848989694429952:12345-192.168.201.60@tcp:36:rm.0 Request processed in 8203us (8348us total) trans 8589938821 rc 0/0 00000100:00100000:2.0:1763334964.784515:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4588 00000100:00100000:2.0:1763334964.790940:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701825152:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334964.790990:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334964.791384:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334964.791739:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a7ae lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.791752:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a7ae lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.791760:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a7ae lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.791767:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.791773:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a7ae lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.791786:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a7ae lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.791809:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334964.791813:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.791818:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a7ae lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334964.791824:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849a7ae lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334964.792367:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694430336 00000100:00100000:1.0:1763334964.792382:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694430336 00002000:00100000:1.0:1763334964.792462:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22e:0x0] (0->4) req@ffff9a5afb1fd500 x1848989694430336/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:10/0 lens 496/0 e 0 to 0 dl 1763334975 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334964.792474:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fd500 with x1848989694430336 ext(0->4) 00010000:00010000:1.0:1763334964.792486:0:14385:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af90c expref: 23 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.792506:0:14385:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af90c expref: 23 pid: 21625 timeout: 1129 lvb_type: 0 00002000:00010000:1.0:1763334964.792515:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a5afb1fd500 00000100:00100000:1.0:1763334964.792566:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 68 00000100:00100000:1.0:1763334964.792599:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694430336:12345-192.168.201.60@tcp:4:bash.0 00000100:00100000:1.0:1763334964.793231:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694430336:12345-192.168.201.60@tcp:4:bash.0 Request processed in 633us (1845us total) trans 17179871044 rc 0/0 00000100:00100000:1.0:1763334964.793246:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 68 00002000:00100000:1.0:1763334964.795722:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x22e:0x0] (0->4) req@ffff9a5afb1fd500 x1848989694430336/t17179871044(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:10/0 lens 496/448 e 0 to 0 dl 1763334975 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334964.795741:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fd500 with x1848989694430336 ext(0->4) 00010000:00010000:1.0:1763334964.795754:0:14385:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af90c expref: 25 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.795774:0:14385:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af90c expref: 25 pid: 21625 timeout: 1129 lvb_type: 0 00002000:00010000:1.0:1763334964.795783:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a5afb1fd500 00000100:00100000:3.0:1763334964.795946:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.796272:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694430464 00000100:00100000:1.0:1763334964.796283:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694430464 00010000:00010000:1.0:1763334964.796320:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af90c expref: 25 pid: 21625 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.796860:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2490 00000100:00100000:1.0:1763334964.796874:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694430464:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334964.796902:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763334964.796928:0:5735:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb size from disk: 0 -> 5 00010000:00010000:1.0:1763334964.796936:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af90c expref: 25 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.796950:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af90c expref: 25 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.796987:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a714 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af90c expref: 25 pid: 21625 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.797009:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.797012:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.797018:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.797028:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.797070:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334964.797152:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694430464:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 280us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.797160:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2490 00010000:00010000:2.0:1763334964.797220:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.797231:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.797278:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.797288:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.797296:0:25383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.797303:0:25383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334964.797308:0:25383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.797317:0:25383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.797330:0:25383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.797338:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a7bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334964.797394:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694430080:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 17648us (18105us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.797402:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4702 00000100:00100000:3.0:1763334964.798957:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.799052:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.799164:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694430592 00000100:00100000:0.0:1763334964.799178:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694430592 00000100:00100000:0.0:1763334964.799239:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694430848 00000100:00100000:0.0:1763334964.799243:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694430848 00000100:00100000:0.0:1763334964.799296:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4589 00000100:00100000:0.0:1763334964.799307:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53016:x1848989694430592:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334964.799347:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.799378:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a7c3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af944 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334964.799442:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4590 00000100:00100000:3.0:1763334964.799452:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53014:x1848989694430848:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334964.799471:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a7ca lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799490:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a7ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799503:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a7ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.799510:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a7d1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.799518:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a7d1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334964.799518:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a7d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799525:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.799526:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a7d1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334964.799532:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799654:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a7ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799662:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a7ca lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799669:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a7ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799675:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.799680:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a7ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799694:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a7ca lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799707:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334964.799712:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.799719:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a7ca lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799726:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a7ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799738:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a7d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799744:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a7d8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799750:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799755:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.799758:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a7d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799762:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a7d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799769:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334964.799772:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.799775:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a7d8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799785:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a7d8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.799823:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a7c3 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af944 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.799833:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334964.799835:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.799839:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a7c3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af944 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.799849:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334964.799928:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53016:x1848989694430592:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 622us (981us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334964.799935:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4589 00000040:00080000:3.0:1763334964.800048:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1075, 88 off92464 00000004:00080000:3.0:1763334964.800058:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1029433486045ns, next at 1030101436569ns, rc = 0 00000040:00080000:3.0:1763334964.800129:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1064, 88 off91376 00000004:00080000:3.0:1763334964.800135:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1029433562972ns, next at 1030101395439ns, rc = 0 00000040:00080000:3.0:1763334964.800169:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1065, 88 off91464 00000004:00080000:3.0:1763334964.800174:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1029433602755ns, next at 1030101395439ns, rc = 0 00000040:00080000:3.0:1763334964.800191:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1076, 88 off92552 00000004:00080000:3.0:1763334964.800195:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1029433623354ns, next at 1030101436569ns, rc = 0 00000100:00100000:0.0:1763334964.806063:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.806488:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694430976 00000100:00100000:2.0:1763334964.806503:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694430976 00000100:00100000:2.0:1763334964.806751:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4591 00000100:00100000:2.0:1763334964.806765:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53016:x1848989694430976:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.806797:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334964.806828:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af94b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.806929:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a7e6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.806948:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a7e6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.806963:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a7e6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.806980:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a7ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.806986:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a7ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.806992:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a7ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807122:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a7e6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807131:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a7e6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807138:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a7e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807148:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.807153:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a7e6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807162:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a7e6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807177:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.807181:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.807186:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a7e6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807193:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a7e6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807205:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a7ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807211:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a7ed lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807217:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a7ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807222:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.807225:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a7ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807231:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a7ed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807238:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cabc00) 00010000:00010000:2.0:1763334964.807242:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.807245:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a7ed lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807267:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849a7ed lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334964.807307:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7df lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af94b expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.807319:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334964.807322:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334964.807325:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849a7df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af94b expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.807334:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:2.0:1763334964.807418:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53016:x1848989694430976:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 656us (1369us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334964.807426:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4591 00000100:00100000:3.0:1763334964.811742:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.812096:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694431104 00000100:00100000:1.0:1763334964.812113:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694431104 00000100:00100000:1.0:1763334964.812188:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4592 00000100:00100000:1.0:1763334964.812200:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53016:x1848989694431104:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.812228:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.812269:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a7f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af952 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.812366:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a7fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.812384:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a7fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.812400:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a7fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334964.812473:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:1.0:1763334964.812478:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334964.812503:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a7fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.812540:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a7f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af952 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.812559:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a7fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af952 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.812607:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.812612:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763334964.812618:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334964.812710:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53016:x1848989694431104:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 511us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.812719:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4592 00000100:00100000:1.0:1763334964.819532:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.820388:0:29623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694431232 00000100:00100000:0.0:1763334964.820407:0:29623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694431232 00000100:00100000:0.0:1763334964.820493:0:29623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 136 00000100:00100000:0.0:1763334964.820505:0:29623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01e7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1264d40-158f-4e44-9f7a-49909c525321+9:2359:x1848989694431232:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1763334964.820637:0:29623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01e7ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1264d40-158f-4e44-9f7a-49909c525321+9:2359:x1848989694431232:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 133us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.820646:0:29623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 136 00000100:00100000:0.0:1763334964.821031:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.821225:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694431360 00000100:00100000:3.0:1763334964.821231:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694431360 00000100:00100000:3.0:1763334964.821288:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4593 00000100:00100000:3.0:1763334964.821297:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53016:x1848989694431360:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334964.821321:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.821357:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a802 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af959 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.821457:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a809 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821478:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a809 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821494:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a809 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821512:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a810 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821519:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a810 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821526:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a810 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821769:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a809 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821783:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a809 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821791:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a809 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821796:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.821802:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a809 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821811:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a809 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821829:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334964.821832:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.821838:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a809 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821844:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a809 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821857:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a810 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821862:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a810 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821868:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a810 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821872:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.821876:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a810 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821885:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a810 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821892:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4800) 00010000:00010000:3.0:1763334964.821895:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.821897:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a810 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821922:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a810 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.821966:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a802 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af959 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.821978:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334964.821980:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.821984:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a802 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af959 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.821993:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7200, rc 0) 00000100:00100000:3.0:1763334964.822054:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53016:x1848989694431360:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 758us (1024us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334964.822115:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4593 00000100:00100000:0.0:1763334964.825749:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.825844:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694431616 00000100:00100000:3.0:1763334964.825859:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694431616 00000100:00100000:3.0:1763334964.825935:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4594 00000100:00100000:3.0:1763334964.825947:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53016:x1848989694431616:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334964.825977:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.825983:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334964.826023:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a7fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af952 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.826043:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334964.826050:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334964.826073:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a817 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af960 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.826269:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849a81e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.826287:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849a81e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.826299:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849a81e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.826316:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849a825 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.826323:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849a825 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.826330:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849a825 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.827152:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849a82c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.827167:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849a82c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.827177:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849a82c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334964.827190:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x195:0x0]: returning size 0 00010000:00010000:3.0:1763334964.827223:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849a81e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.827232:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849a81e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.827239:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849a81e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.827245:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c314b600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.827250:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849a81e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.827272:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849a81e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.827285:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334964.827288:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.827293:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849a81e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.827299:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849a81e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:3.0:1763334964.827312:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006f6d9bd4 reply state 0000000060e01ee2 transno 8589938823 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849a825 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334964.827323:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763334964.827360:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a817 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af960 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.827374:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849a82c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af960 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.827382:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:3.0:1763334964.827385:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334964.827387:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c314b400, rc 0) 00000100:00100000:3.0:1763334964.827494:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53016:x1848989694431616:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1548us (1760us total) trans 8589938823 rc 0/0 00000100:00100000:3.0:1763334964.827504:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4594 00010000:00010000:0.0:1763334964.829849:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849a825 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.829874:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849a825 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.829882:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849a825 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.829889:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c314b800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.829895:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849a825 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.829902:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849a825 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.829919:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4100) 00010000:00010000:0.0:1763334964.829922:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.829927:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849a825 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.829934:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849a825 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334964.830858:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.830912:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694431872 00000100:00100000:1.0:1763334964.830927:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694431872 00000100:00100000:1.0:1763334964.831001:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4595 00000100:00100000:1.0:1763334964.831798:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53016:x1848989694431872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334964.831828:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334964.831855:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a83a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af967 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.832000:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x195:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.832019:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849a82c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af960 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.832030:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.832074:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849a82c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af960 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.832091:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849a82c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af960 expref: 189 pid: 32232 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.832108:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6453100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701825280:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334964.832229:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee780 going to sleep for 11 seconds 00000100:00100000:0.0:1763334964.837439:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.837609:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694432000 00000100:00100000:1.0:1763334964.837625:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694432000 00010000:00010000:1.0:1763334964.837681:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849a82c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af960 expref: 190 pid: 32232 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.837731:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2491 00000100:00100000:1.0:1763334964.837744:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+190:2359:x1848989694432000:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334964.837768:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334964.837775:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849a82c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af960 expref: 190 pid: 32232 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.837795:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849a82c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af960 expref: 190 pid: 32232 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334964.837831:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334964.837838:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.837850:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.837859:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.837883:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334964.837951:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+190:2359:x1848989694432000:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 208us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.837959:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2491 00010000:00010000:1.0:1763334964.838277:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849a82c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af960 expref: 189 pid: 32232 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334964.838295:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6453100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701825280:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334964.838403:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.838415:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.838420:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334964.839030:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x195:0x0]: returning size 0 00000004:00080000:1.0:1763334964.839740:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22c:0x0], index 0: 0 00000004:00080000:1.0:1763334964.839755:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x230:0x0], index 1: 0 00000004:00080000:1.0:1763334964.839761:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x231:0x0], index 1: 0 00000004:00080000:1.0:1763334964.839766:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22d:0x0], index 0: 0 00010000:00010000:1.0:1763334964.839965:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.839978:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.839987:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.839993:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334964.839998:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.840007:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.840023:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334964.840027:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334964.840032:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.840039:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849a841 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334964.840114:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a83a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af967 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.840130:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334964.840134:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334964.840138:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849a83a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af967 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.840146:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334964.840229:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53016:x1848989694431872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 8436us (9379us total) trans 8589938824 rc 301/301 00000100:00100000:1.0:1763334964.840239:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4595 00000100:00100000:0.0:1763334964.844440:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.845925:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694432256 00000100:00100000:3.0:1763334964.845946:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694432256 00000100:00100000:3.0:1763334964.846193:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1691 00000100:00100000:3.0:1763334964.846206:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53016:x1848989694432256:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334964.846724:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53016:x1848989694432256:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 519us (2300us total) trans 8589938825 rc 0/0 00000100:00100000:3.0:1763334964.846734:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1691 00000001:00080000:1.0:1763334964.851596:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938820 is committed 00000001:00080000:1.0:1763334964.851642:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938821 is committed 00000001:00080000:1.0:1763334964.851662:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938822 is committed 00000004:00080000:1.0:1763334964.851668:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 710 committed 00000004:00080000:1.0:1763334964.851680:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 698 committed 00000004:00080000:1.0:1763334964.851690:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 697 committed 00000004:00080000:1.0:1763334964.851693:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 709 committed 00000100:00100000:1.0:1763334964.851863:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701825536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.851951:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.852008:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763334964.852014:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701825664:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334964.852040:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.852077:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701825536 00000100:00100000:1.0:1763334964.852088:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701825536 00000100:00100000:1.0:1763334964.852144:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701825664 00000100:00100000:1.0:1763334964.852147:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701825664 00000100:00100000:1.0:1763334964.852176:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4703 00000100:00100000:1.0:1763334964.852187:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701825536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334964.852499:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334964.852503:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763334964.852506:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334964.852508:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763334964.852511:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334964.852560:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701825536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 373us (608us total) trans 17179871045 rc 0/0 00000100:00100000:1.0:1763334964.852568:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4703 00000100:00100000:1.0:1763334964.852619:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4704 00000100:00100000:1.0:1763334964.852625:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3291:x1848989701825664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334964.852758:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334964.852761:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb mtime from disk: 1763334965 -> 1763334965 00002000:00010000:1.0:1763334964.852764:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334964.852767:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb ctime from disk: 1763334965 -> 1763334965 00002000:00010000:1.0:1763334964.852769:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334964.852798:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3291:x1848989701825664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 173us (757us total) trans 21474838327 rc 0/0 00000100:00100000:1.0:1763334964.852804:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4704 00000100:00100000:1.0:1763334964.852839:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701825792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334964.852902:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.852926:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763334964.852933:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701825408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.852957:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334964.852984:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701825792 00000100:00100000:1.0:1763334964.852990:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701825792 00000100:00100000:1.0:1763334964.853016:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701825408 00000100:00100000:1.0:1763334964.853020:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701825408 00000100:00100000:1.0:1763334964.853039:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4705 00000100:00100000:1.0:1763334964.853045:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3289:x1848989701825792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334964.853136:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334964.853139:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1763334964.853141:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334964.853142:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1763334964.853145:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334964.853178:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+35:3289:x1848989701825792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (274us total) trans 21474838328 rc 0/0 00000100:00100000:1.0:1763334964.853184:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4705 00000100:00100000:1.0:1763334964.853196:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4706 00000100:00100000:1.0:1763334964.853202:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701825408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.853324:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3289:x1848989701825408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (365us total) trans 17179871046 rc 0/0 00000100:00100000:1.0:1763334964.853330:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4706 00000004:00080000:1.0:1763334964.853381:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6451180/2, rc 0, transno 21474838327 00000100:00100000:1.0:1763334964.853389:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6451180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701825664:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334964.853403:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6451f80/2, rc 0, transno 17179871045 00000100:00100000:1.0:1763334964.853408:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6451f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701825536:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334964.853427:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6453100/2, rc 0, transno 17179871046 00000100:00100000:1.0:1763334964.853431:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6453100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701825408:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334964.853440:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6450000/2, rc 0, transno 21474838328 00000100:00100000:1.0:1763334964.853444:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6450000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701825792:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1763334964.853929:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d442e18f reply state 00000000f4418bac transno 8589938822 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a7d1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334964.853944:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1763334964.854065:0:29629:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763334964.854085:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53014:x1848989694430848:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 54632us (55029us total) trans 8589938822 rc 0/0 00000100:00100000:3.0:1763334964.854093:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4590 00000100:00100000:0.0:1763334964.854219:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334964.854439:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a7d1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.854451:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a7d1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.854460:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a7d1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.854467:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334964.854473:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a7d1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.854488:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a7d1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.854510:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:2.0:1763334964.854514:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334964.854519:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a7d1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334964.854526:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a7d1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334964.854604:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694432512 00000100:00100000:3.0:1763334964.854612:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694432512 00000100:00100000:3.0:1763334964.854660:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1692 00000100:00100000:3.0:1763334964.854671:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53016:x1848989694432512:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334964.854933:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53016:x1848989694432512:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 264us (714us total) trans 8589938826 rc 0/0 00000100:00100000:3.0:1763334964.854942:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1692 00000100:00100000:0.0:1763334964.859556:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.859718:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.860512:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694432640 00000100:00100000:3.0:1763334964.860514:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694432896 00000100:00100000:3.0:1763334964.860527:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694432896 00000100:00100000:2.0:1763334964.860527:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694432640 00000100:00100000:3.0:1763334964.860632:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4596 00000100:00100000:3.0:1763334964.860646:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52274:x1848989694432896:12345-192.168.201.60@tcp:101:bash.0 00000100:00100000:2.0:1763334964.860682:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4597 00010000:00010000:3.0:1763334964.860688:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763334964.860691:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53014:x1848989694432640:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334964.860699:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.860723:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849a84f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af975 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.860723:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a856 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af96e expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.860810:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a856 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af96e expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.860830:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a856 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af96e expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.860853:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:2.0:1763334964.860856:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334964.860860:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067c00, rc 0) 00000100:00100000:2.0:1763334964.860945:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53014:x1848989694432640:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 256us (1521us total) trans 0 rc 0/0 00010000:00010000:3.0:1763334964.860953:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a85d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00000100:00100000:2.0:1763334964.860955:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4597 00010000:00010000:3.0:1763334964.860964:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a85d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.860974:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a85d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.860990:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a864 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.860998:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a864 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861004:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a864 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861082:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63800/0xcedf0054f849a86b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861095:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63800/0xcedf0054f849a86b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861102:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63800/0xcedf0054f849a86b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334964.861114:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x195:0x0]: returning size 0 00010000:00010000:3.0:1763334964.861245:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a85d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861282:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a85d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861289:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a85d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861296:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d62400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.861350:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a85d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861361:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a85d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861373:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334964.861376:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.861381:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a85d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861388:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a85d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861404:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a864 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861415:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a864 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861422:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a864 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861427:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d62800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.861430:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a864 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861441:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a864 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861451:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4a00) 00010000:00010000:3.0:1763334964.861453:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.861456:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a864 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861461:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a864 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.861510:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849a84f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af975 expref: 184 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.861522:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63800/0xcedf0054f849a86b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af975 expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.861528:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ac71b4800) 00010000:00010000:3.0:1763334964.861531:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334964.861533:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac7d63800, rc 0) 00000100:00100000:3.0:1763334964.861600:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52274:x1848989694432896:12345-192.168.201.60@tcp:101:bash.0 Request processed in 958us (1882us total) trans 8589938827 rc 0/0 00000100:00100000:3.0:1763334964.861609:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4596 00000100:00100000:1.0:1763334964.863885:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.864006:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694433024 00000100:00100000:3.0:1763334964.864022:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694433024 00000100:00100000:1.0:1763334964.864049:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.864105:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694433280 00000100:00100000:0.0:1763334964.864110:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694433280 00000100:00100000:3.0:1763334964.864170:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4598 00000100:00100000:3.0:1763334964.864183:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53014:x1848989694433024:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334964.864210:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.864244:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a879 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af97c expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.864365:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849a880 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.864383:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849a880 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.864397:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849a880 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334964.864444:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x194:0x0]: returning size 5 00000004:00200000:3.0:1763334964.864450:0:29629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334964.864473:0:29629:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849a880 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334964.864510:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a879 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af97c expref: 186 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.864531:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849a880 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af97c expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.864541:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00000100:00100000:0.0:1763334964.864544:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4599 00010000:00010000:3.0:1763334964.864546:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1763334964.864551:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac7d63c00, rc 0) 00000100:00100000:0.0:1763334964.864553:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694433280:12345-192.168.201.60@tcp:36:bash.0 00000100:00100000:3.0:1763334964.864654:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53014:x1848989694433024:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 473us (782us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.864663:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4598 00010000:00010000:0.0:1763334964.864695:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334964.864715:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63800/0xcedf0054f849a86b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af975 expref: 184 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.864726:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ac71b4800) 00010000:00010000:0.0:1763334964.864735:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334964.865030:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a887 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.865040:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a887 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.865048:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a887 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:0.0:1763334964.865110:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938828 00000004:00010000:0.0:1763334964.865134:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002a8b0337 reply state 000000008eb77ad4 transno 8589938829 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a887 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334964.865144:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334964.865207:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694433280:12345-192.168.201.60@tcp:36:bash.0 Request processed in 655us (1157us total) trans 8589938829 rc 0/0 00000100:00100000:0.0:1763334964.865213:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4599 00000020:00080000:0.0:1763334964.865217:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1763334964.867395:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a887 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334964.867418:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334964.867419:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a887 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.867427:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a887 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.867440:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334964.867446:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a887 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.867456:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a887 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.867476:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334964.867481:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334964.867486:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a887 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x195:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334964.867492:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a887 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x195:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334964.867717:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694433408 00000100:00100000:3.0:1763334964.867732:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694433408 00000100:00100000:3.0:1763334964.867794:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4600 00000100:00100000:3.0:1763334964.867804:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694433408:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334964.867833:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.867855:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849a88e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af983 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.867924:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849a88e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af983 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.867940:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849a88e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af983 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.867960:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:3.0:1763334964.867963:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334964.867966:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac7d63000, rc 0) 00000100:00100000:3.0:1763334964.868039:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694433408:12345-192.168.201.60@tcp:101:bash.0 Request processed in 236us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.868048:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4600 00000100:00100000:1.0:1763334964.868087:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.868227:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694433536 00000100:00100000:3.0:1763334964.868232:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694433536 00000100:00100000:3.0:1763334964.868864:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4707 00000100:00100000:3.0:1763334964.868876:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694433536:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334964.868891:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.868910:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a895 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af98a expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334964.868935:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x22e:0x0] initial LVB size: 5, mtime: 0x691a5b35, atime: 0x0, ctime: 0x691a5b35, blocks: 0x1 00010000:00010000:3.0:1763334964.868953:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.868955:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.868965:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af98a expref: 24 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334964.868979:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af98a expref: 24 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334964.868991:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac7d62800, rc 0) 00000100:00100000:3.0:1763334964.869023:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694433536:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 149us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.869029:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4707 00000100:00100000:1.0:1763334964.871438:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.871671:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694433792 00000100:00100000:3.0:1763334964.871687:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694433792 00000100:00100000:3.0:1763334964.871763:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4601 00000100:00100000:3.0:1763334964.871774:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694433792:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334964.871804:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.871808:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334964.871847:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849a88e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af983 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.871876:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:3.0:1763334964.871888:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334964.871911:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a89c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af991 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.871982:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a8a3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x195:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.871996:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a8a3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.872006:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a8a3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:3.0:1763334964.872666:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1066, 88 off91552 00000004:00080000:3.0:1763334964.872684:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1029506110750ns, next at 1030101395439ns, rc = 0 00000040:00080000:3.0:1763334964.872748:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1077, 88 off92640 00000004:00080000:3.0:1763334964.872753:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1029506181193ns, next at 1030101436569ns, rc = 0 00000040:00080000:3.0:1763334964.872787:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1078, 88 off92728 00000004:00080000:3.0:1763334964.872791:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1029506219275ns, next at 1030101436569ns, rc = 0 00000040:00080000:3.0:1763334964.872810:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1067, 88 off91640 00000004:00080000:3.0:1763334964.872815:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1029506242988ns, next at 1030101395439ns, rc = 0 00000001:00080000:1.0:1763334964.917950:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938829 is committed 00010000:00010000:3.0:1763334964.918168:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a8a3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x195:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af991 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.918189:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ac71b4800) 00010000:00010000:3.0:1763334964.918193:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334964.918221:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a89c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x195:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af991 expref: 186 pid: 32232 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763334964.918245:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a8a3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x195:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af991 expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.918304:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ac71b4800) 00010000:00010000:3.0:1763334964.918308:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334964.918311:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac7d62400, rc 0) 00000100:00100000:3.0:1763334964.918414:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694433792:12345-192.168.201.60@tcp:101:bash.0 Request processed in 46640us (46987us total) trans 8589938830 rc 0/0 00000100:00100000:3.0:1763334964.918426:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4601 00000100:00100000:3.0:1763334964.918638:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000001:00080000:2.0:1763334964.918766:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938830 is committed 00000004:00080000:2.0:1763334964.918774:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 700 committed 00000004:00080000:2.0:1763334964.918791:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 712 committed 00000004:00080000:2.0:1763334964.918802:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 711 committed 00000004:00080000:2.0:1763334964.918805:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 699 committed 00000100:00100000:2.0:1763334964.918926:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763334964.918945:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701826048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334964.919031:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701825920:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334964.919075:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334964.919115:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701826048 00000100:00100000:0.0:1763334964.919128:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701826048 00000100:00100000:2.0:1763334964.919133:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334964.919171:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701825920 00000100:00100000:2.0:1763334964.919176:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701825920 00000100:00100000:0.0:1763334964.919191:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4708 00000100:00100000:0.0:1763334964.919211:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3292:x1848989701826048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334964.919220:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4709 00000100:00100000:2.0:1763334964.919229:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3290:x1848989701825920:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.919834:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694433920 00000100:00100000:1.0:1763334964.919841:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694433920 00000100:00100000:1.0:1763334964.919893:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1722 00000100:00100000:1.0:1763334964.919902:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694433920:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:1.0:1763334964.919944:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849a8aa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.919971:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.919975:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.919982:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849a8aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.919999:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849a8aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334964.920374:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3292:x1848989701826048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1172us (1298us total) trans 17179871047 rc 0/0 00000100:00100000:0.0:1763334964.920384:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4708 00010000:00010000:1.0:1763334964.920547:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849a8aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.920560:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849a8aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334964.920597:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3290:x1848989701825920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1343us (1439us total) trans 17179871048 rc 0/0 00010000:00010000:1.0:1763334964.920601:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849a8aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334964.920608:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4709 00010000:00010000:1.0:1763334964.920621:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334964.920627:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849a8aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.920637:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849a8aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.920659:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849a8aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763334964.920668:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44ea00/2, rc 0, transno 17179871047 00010000:00010000:1.0:1763334964.920669:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849a8aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334964.920678:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701826048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334964.920754:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694433920:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 850us (2114us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763334964.920761:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1722 00000100:00100000:3.0:1763334964.921031:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763334964.921046:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701826176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334964.921096:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334964.921132:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701826176 00000100:00100000:3.0:1763334964.921138:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701826176 00000100:00100000:3.0:1763334964.921199:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4710 00000100:00100000:3.0:1763334964.921208:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+35:3291:x1848989701826176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334964.921431:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+36:3291:x1848989701826176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 225us (335us total) trans 21474838329 rc 0/0 00000100:00100000:3.0:1763334964.921439:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4710 00000100:00100000:3.0:1763334964.921464:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701826304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334964.921491:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334964.921520:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701826304 00000100:00100000:3.0:1763334964.921524:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701826304 00000100:00100000:3.0:1763334964.921546:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4711 00000100:00100000:3.0:1763334964.921553:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+36:3289:x1848989701826304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334964.921702:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+37:3289:x1848989701826304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 148us (210us total) trans 21474838330 rc 0/0 00000100:00100000:3.0:1763334964.921708:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4711 00000004:00080000:3.0:1763334964.921740:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab37480/2, rc 0, transno 21474838330 00000100:00100000:3.0:1763334964.921746:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701826304:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334964.921764:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab34a80/2, rc 0, transno 21474838329 00000100:00100000:3.0:1763334964.921768:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701826176:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334964.922717:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44f800/2, rc 0, transno 17179871048 00000100:00100000:0.0:1763334964.922731:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701825920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334964.928839:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.930204:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694434048 00000100:00100000:0.0:1763334964.930223:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694434048 00000100:00100000:0.0:1763334964.930320:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4712 00000100:00100000:0.0:1763334964.930332:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+21:52274:x1848989694434048:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334964.930357:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334964.930389:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a8b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af998 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334964.930422:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x22c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334964.930455:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.930457:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.930470:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a8b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af998 expref: 22 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.930489:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a8b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af998 expref: 22 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.930504:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334964.930636:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+22:52274:x1848989694434048:12345-192.168.201.60@tcp:101:bash.0 Request processed in 306us (1817us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.930645:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4712 00000100:00100000:1.0:1763334964.931163:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.931225:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694434176 00000100:00100000:3.0:1763334964.931233:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694434176 00000100:00100000:3.0:1763334964.931282:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4602 00000100:00100000:3.0:1763334964.931292:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+179:53014:x1848989694434176:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334964.931312:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.931331:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849a8b8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af99f expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.931374:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63800/0xcedf0054f849a8bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.931391:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63800/0xcedf0054f849a8bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.931404:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63800/0xcedf0054f849a8bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334964.931533:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849a8b8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af99f expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.931559:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63800/0xcedf0054f849a8bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x194:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af99f expref: 180 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.931568:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:3.0:1763334964.931651:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763334964.931656:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac7d63800, rc 0) 00000100:00100000:3.0:1763334964.931705:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53014:x1848989694434176:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 414us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.931712:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4602 00000100:00100000:1.0:1763334964.940308:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.941178:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694434304 00000100:00100000:3.0:1763334964.941194:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694434304 00000100:00100000:3.0:1763334964.941307:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4713 00000100:00100000:3.0:1763334964.941321:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+24:52274:x1848989694434304:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334964.941348:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.941379:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a8c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af9a6 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334964.941415:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x230:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334964.941444:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.941447:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334964.941461:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a8c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9a6 expref: 25 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.941483:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a8c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9a6 expref: 25 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.941504:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac7d63600, rc 0) 00000100:00100000:3.0:1763334964.941616:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+25:52274:x1848989694434304:12345-192.168.201.60@tcp:101:bash.0 Request processed in 297us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.941624:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4713 00000100:00100000:1.0:1763334964.945612:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.945684:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694434432 00000100:00100000:0.0:1763334964.945699:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694434432 00000100:00100000:0.0:1763334964.945792:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1723 00000100:00100000:0.0:1763334964.945804:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694434432:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:0.0:1763334964.945854:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.945877:0:14384:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a650 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8cd expref: 22 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334964.945892:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.945895:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334964.945900:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334964.945949:0:14384:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a650 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8cd expref: 22 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334964.945967:0:14384:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a650 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8cd expref: 22 pid: 6517 timeout: 1129 lvb_type: 1 00000100:00100000:0.0:1763334964.945988:0:14384:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14384:1848989701826432:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334964.946105:0:14384:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa65e180 going to sleep for 11 seconds 00000100:00100000:2.0:1763334964.948526:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.948567:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334964.948735:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334964.948838:0:14384:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14384:1848989701826432:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334964.948877:0:14384:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334964.948903:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694434688 00000100:00100000:3.0:1763334964.948915:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694434688 00002000:00010000:3.0:1763334964.948965:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/560 (0->18446744073709551615) 00002000:00100000:3.0:1763334964.948971:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44ed80 with x1848989694434688 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334964.948986:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44ed80. 00000100:00100000:3.0:1763334964.949021:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694434560 00000100:00100000:3.0:1763334964.949025:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694434560 00002000:00010000:3.0:1763334964.949096:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/556 (0->18446744073709551615) 00000100:00100000:2.0:1763334964.949101:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1724 00002000:00100000:3.0:1763334964.949102:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44e680 with x1848989694434560 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334964.949112:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa44e680. 00000100:00100000:2.0:1763334964.949122:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694434688:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:3.0:1763334964.949144:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1725 00000100:00100000:3.0:1763334964.949153:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694434560:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334964.949646:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x22c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334964.949646:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334964.949654:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x22c:0x0] updating lvb mtime from disk: 0 -> 1763334965 00002000:00010000:2.0:1763334964.949654:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb mtime from disk: 0 -> 1763334965 00002000:00010000:3.0:1763334964.949661:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x22c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334964.949662:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334964.949666:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x22c:0x0] updating lvb ctime from disk: 0 -> 1763334965 00002000:00010000:2.0:1763334964.949668:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb ctime from disk: 0 -> 1763334965 00002000:00010000:3.0:1763334964.949671:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x22c:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1763334964.949673:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x230:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334964.949752:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694434688:12345-192.168.201.60@tcp:10:bash.0 Request processed in 636us (1240us total) trans 17179871049 rc 0/0 00000100:00100000:2.0:1763334964.949762:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1724 00002000:00010000:2.0:1763334964.949768:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/560 (0->18446744073709551615) 00002000:00100000:2.0:1763334964.949772:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44ed80 with x1848989694434688 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334964.949778:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44ed80. 00000100:00100000:3.0:1763334964.950121:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694434560:12345-192.168.201.60@tcp:10:bash.0 Request processed in 967us (1551us total) trans 21474838331 rc 0/0 00000100:00100000:3.0:1763334964.950130:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1725 00002000:00010000:3.0:1763334964.950134:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/556 (0->18446744073709551615) 00002000:00100000:3.0:1763334964.950137:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44e680 with x1848989694434560 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334964.950142:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa44e680. 00000100:00100000:1.0:1763334964.950613:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694434816 00000100:00100000:1.0:1763334964.950622:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694434816 00010000:00010000:1.0:1763334964.950663:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a650 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8cd expref: 24 pid: 6517 timeout: 1129 lvb_type: 1 00000100:00100000:1.0:1763334964.950710:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2492 00000100:00100000:1.0:1763334964.950719:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694434816:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334964.950739:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334964.950756:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a650 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8cd expref: 24 pid: 6517 timeout: 1129 lvb_type: 1 00010000:00010000:1.0:1763334964.950773:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a650 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8cd expref: 24 pid: 6517 timeout: 1129 lvb_type: 1 00010000:00010000:1.0:1763334964.950801:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a650 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8cd expref: 24 pid: 6517 timeout: 1129 lvb_type: 1 00010000:00010000:1.0:1763334964.950820:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.950823:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334964.950829:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.950841:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334964.950883:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334964.950916:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694434816:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 198us (2180us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334964.950923:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2492 00010000:00010000:2.0:1763334964.952487:0:14384:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334964.952509:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334964.966871:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701826560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1763334964.966977:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334964.967114:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701826560 00000100:00100000:0.0:1763334964.967126:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701826560 00000100:00100000:0.0:1763334964.967197:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1763334964.967208:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3290:x1848989701826560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1763334964.967237:0:6520:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 49217536 pending 3407872 free 3856662528 avail 3852468224 00000100:00100000:0.0:1763334964.967300:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3290:x1848989701826560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.967308:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1763334964.967415:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701826560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1763334964.967696:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763334964.967708:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac37cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701826688:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1763334964.967742:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334964.967801:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701826688 00000100:00100000:2.0:1763334964.967806:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701826688 00000100:00100000:2.0:1763334964.967846:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1763334964.967853:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3292:x1848989701826688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1763334964.967866:0:6521:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 61014016 pending 1703936 free 3856662528 avail 3854565376 00000100:00100000:2.0:1763334964.967907:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3292:x1848989701826688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334964.967914:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1763334964.967947:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac37cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701826688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1763334964.971370:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334964.971478:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694435072 00000100:00100000:1.0:1763334964.971493:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694435072 00000100:00100000:1.0:1763334964.971566:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1693 00000100:00100000:1.0:1763334964.971605:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52274:x1848989694435072:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:1.0:1763334964.972210:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52274:x1848989694435072:12345-192.168.201.60@tcp:35:bash.0 Request processed in 604us (853us total) trans 8589938831 rc 0/0 00000100:00100000:1.0:1763334964.972221:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1693 00000100:00100000:0.0:1763334964.975106:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1848989701827200:0@lo:400:kworker.0 00000100:00100000:0.0:1763334964.975195:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334964.975243:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763334964.975249:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac37cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:53c3ae04-da5d-4a5f-b9b8-469954a64a68:3291:1848989701826816:0@lo:400:kworker.0 00000100:00100000:0.0:1763334964.975292:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334964.975336:0:29624:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701826816 00000100:00100000:0.0:1763334964.975344:0:29624:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701826816 00000100:00100000:0.0:1763334964.975394:0:29624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1763334964.975402:0:29624:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01e7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:53c3ae04-da5d-4a5f-b9b8-469954a64a68+18:3291:x1848989701826816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763334964.975452:0:29624:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01e7cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:53c3ae04-da5d-4a5f-b9b8-469954a64a68+18:3291:x1848989701826816:12345-0@lo:400:kworker.0 Request processed in 50us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.975460:0:29624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1763334964.975498:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701827200 00000100:00100000:0.0:1763334964.975500:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701827200 00000100:00100000:0.0:1763334964.975529:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1763334964.975534:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1848989701827200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763334964.975561:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1848989701827200:12345-0@lo:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.975567:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1763334964.975623:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac37cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:53c3ae04-da5d-4a5f-b9b8-469954a64a68:3291:1848989701826816:0@lo:400:kworker.0 00000100:00100000:0.0:1763334964.975636:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3291:1848989701827200:0@lo:400:kworker.0 00000100:00100000:3.0:1763334964.977815:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1848989701826944:0@lo:400:kworker.0 00000100:00100000:3.0:1763334964.977902:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334964.977950:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763334964.977959:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1848989701827072:0@lo:400:kworker.0 00000100:00100000:3.0:1763334964.977981:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334964.978915:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701826944 00000100:00100000:0.0:1763334964.978928:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701826944 00000100:00100000:0.0:1763334964.978988:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701827072 00000100:00100000:0.0:1763334964.978992:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701827072 00000100:00100000:0.0:1763334964.979018:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1763334964.979028:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1848989701826944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763334964.979108:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3289:x1848989701826944:12345-0@lo:400:kworker.0 Request processed in 82us (1207us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.979115:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1763334964.979133:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1763334964.979140:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1848989701827072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763334964.979165:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3289:x1848989701827072:12345-0@lo:400:kworker.0 Request processed in 27us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334964.979171:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:0.0:1763334964.979190:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1763334964.979235:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3289:1848989701827072:0@lo:400:kworker.0 00000100:00100000:0.0:1763334964.979246:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3289:1848989701826944:0@lo:400:kworker.0 00000100:00100000:1.0:1763334964.998089:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334964.998189:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694435200 00000100:00100000:3.0:1763334964.998204:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694435200 00000100:00100000:3.0:1763334964.998286:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4603 00000100:00100000:3.0:1763334964.998298:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53017:x1848989694435200:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:3.0:1763334964.998332:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334964.998360:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849a8d4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af9ad expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.998449:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a8db lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998468:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a8db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998482:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a8db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998499:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a8e2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998506:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998519:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998710:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a8e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x195:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998720:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998728:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334964.998771:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x195:0x0]: returning size 5 00000004:00200000:3.0:1763334964.998777:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334964.998799:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998813:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a8e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998822:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a8db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998830:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a8db lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998837:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a8db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998845:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.998850:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a8db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998858:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a8db lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998872:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334964.998876:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.998882:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a8db lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998889:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a8db lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998903:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998909:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a8e2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998916:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998921:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c6e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334964.998924:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998931:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a8e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998938:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5e600) 00010000:00010000:3.0:1763334964.998940:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334964.998943:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a8e2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998949:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a8e2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334964.998996:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849a8d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9ad expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.999013:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a8e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9ad expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334964.999020:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ac71b4800) 00010000:00010000:3.0:1763334964.999023:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334964.999026:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7200, rc 0) 00000100:00100000:3.0:1763334964.999111:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53017:x1848989694435200:12345-192.168.201.60@tcp:101:rm.0 Request processed in 815us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334964.999121:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4603 00000100:00100000:2.0:1763334965.009882:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.010909:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694435456 00000100:00100000:1.0:1763334965.010929:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694435456 00000100:00100000:1.0:1763334965.011006:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4604 00000100:00100000:1.0:1763334965.011019:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53017:x1848989694435456:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:1.0:1763334965.011090:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1763334965.011127:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a8e9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x195:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9ad expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.011155:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849a8a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x195:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af991 expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.011166:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ac71b4800) 00010000:00010000:1.0:1763334965.011179:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334965.011211:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a8f0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.011227:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a8f0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.011237:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a8f0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.011265:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a8f7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.011277:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.011284:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.011438:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a8fe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x195:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.011446:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a8fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.011454:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a8fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:1.0:1763334965.012070:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1068, 64 off91704 00000040:00080000:1.0:1763334965.012129:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1079, 64 off92792 00000040:00080000:1.0:1763334965.012150:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1080, 64 off92856 00000040:00080000:1.0:1763334965.012166:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1069, 64 off91768 00010000:00010000:1.0:1763334965.012250:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a905 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x195:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012273:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a905 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012283:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a905 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012292:0:32232:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a905 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012299:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a905 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012310:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a905 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012334:0:32232:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334965.012361:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a8fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012367:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a8fe lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012373:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a8fe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012381:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334965.012387:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a8fe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012395:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a8fe lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012406:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:1.0:1763334965.012410:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763334965.012414:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a8fe lrc: 2/0,0 mode: --/EX res: [0x200000404:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012420:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a8fe lrc: 0/0,0 mode: --/EX res: [0x200000404:0x195:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012506:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a8f0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012513:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a8f0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012523:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a8f0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012528:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334965.012531:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a8f0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012538:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a8f0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012546:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334965.012548:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334965.012552:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a8f0 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.012557:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a8f0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:1.0:1763334965.012566:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001b9d3b0e reply state 0000000046b371e7 transno 8589938832 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334965.012601:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334965.012718:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53017:x1848989694435456:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1698us (2850us total) trans 8589938832 rc 0/0 00000100:00100000:1.0:1763334965.012728:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4604 00010000:00010000:0.0:1763334965.013528:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334965.013538:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a905 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.013547:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334965.013550:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a905 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.013556:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a905 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.013590:0:5736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x195:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:0.0:1763334965.013594:0:5736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763334965.013597:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a905 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.013606:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849a905 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x195:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.013623:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334965.013625:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334965.013627:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334965.014904:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a8f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.014916:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a8f7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.014922:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a8f7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.014927:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.014931:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a8f7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.014936:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a8f7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.014948:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa200) 00010000:00010000:3.0:1763334965.014951:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.014954:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a8f7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.014964:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849a8f7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000001:00080000:1.0:1763334965.025488:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838325 is committed 00000001:00080000:1.0:1763334965.025528:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838304 is committed 00000001:00080000:1.0:1763334965.025549:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838328 is committed 00000001:00080000:1.0:1763334965.025620:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838332 is committed 00000001:00080000:1.0:1763334965.025690:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838330 is committed 00002000:00010000:0.0:1763334965.025905:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763334965.025911:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb mtime from disk: 0 -> 1763334965 00002000:00010000:0.0:1763334965.025915:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb ctime from disk: 0 -> 1763334965 00002000:00010000:0.0:1763334965.025916:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1763334965.025936:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.025950:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.025961:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.025969:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334965.025974:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.025985:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.026010:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.026024:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a8cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334965.026319:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+11:2360:x1848989694434432:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 80508us (80712us total) trans 21474838332 rc 0/0 00000100:00100000:0.0:1763334965.026332:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1723 00000100:00100000:1.0:1763334965.046292:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.047182:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694435584 00000100:00100000:3.0:1763334965.047202:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694435584 00000100:00100000:2.0:1763334965.047408:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4605 00000100:00100000:2.0:1763334965.047422:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53018:x1848989694435584:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.047458:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.047493:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a90c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af9b4 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.047608:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a913 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047628:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a913 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047642:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a913 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047659:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a91a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047665:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a91a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047672:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a91a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047755:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a913 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047763:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a913 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047770:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a913 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047777:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.047782:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a913 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047789:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a913 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047802:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.047805:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.047810:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a913 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047816:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849a913 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047828:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a91a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047833:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a91a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047838:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a91a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047842:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.047844:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a91a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047849:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a91a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047854:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cabe00) 00010000:00010000:2.0:1763334965.047856:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.047859:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a91a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047864:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a91a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.047898:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a90c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9b4 expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.047907:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.047909:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.047912:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a90c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9b4 expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.047921:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:2.0:1763334965.048003:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53018:x1848989694435584:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 584us (1728us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334965.048010:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4605 00000100:00100000:3.0:1763334965.048492:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.049419:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694435840 00000100:00100000:1.0:1763334965.049434:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694435840 00000100:00100000:1.0:1763334965.049495:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4606 00000100:00100000:1.0:1763334965.049507:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53014:x1848989694435840:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334965.049585:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.049615:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849a880 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x194:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af97c expref: 181 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.049636:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:1.0:1763334965.049640:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334965.049716:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a921 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.049731:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a921 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.049740:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a921 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00010000:1.0:1763334965.049959:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000194e7475 reply state 00000000bedab9af transno 8589938833 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a921 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334965.049969:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334965.052229:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53014:x1848989694435840:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 2705us (3720us total) trans 8589938833 rc 0/0 00000100:00100000:1.0:1763334965.052248:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4606 00000100:00100000:2.0:1763334965.052661:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.052947:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694435968 00000100:00100000:3.0:1763334965.052962:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694435968 00000100:00100000:3.0:1763334965.053101:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4607 00000100:00100000:3.0:1763334965.053112:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53018:x1848989694435968:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334965.053143:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334965.053172:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a928 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af9bb expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.053281:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a92f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053300:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a92f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053314:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a92f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053332:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a936 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053338:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a936 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053344:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a936 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053439:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a92f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053447:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a92f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053454:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a92f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053460:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.053465:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a92f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053473:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a92f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053488:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334965.053493:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.053500:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a92f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053507:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a92f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053522:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a936 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053528:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a936 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053533:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a936 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053542:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.053545:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a936 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053550:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a936 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053555:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5ee00) 00010000:00010000:3.0:1763334965.053557:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.053559:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a936 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.053564:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a936 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.054790:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a928 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9bb expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.054811:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334965.054815:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.054819:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849a928 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9bb expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.054832:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c6e00, rc 0) 00000100:00100000:2.0:1763334965.055031:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53018:x1848989694435968:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1918us (2369us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334965.055043:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4607 00000100:00100000:3.0:1763334965.056048:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.056183:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694436096 00000100:00100000:1.0:1763334965.056202:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694436096 00000100:00100000:1.0:1763334965.056278:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4714 00000100:00100000:1.0:1763334965.056290:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+11:53014:x1848989694436096:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334965.056315:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.056343:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a93d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af9c2 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334965.056376:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x22b:0x0] initial LVB size: 4096, mtime: 0x691a5b35, atime: 0x0, ctime: 0x691a5b35, blocks: 0xb 00010000:00010000:1.0:1763334965.056403:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.056405:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.056416:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a93d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9c2 expref: 12 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.056436:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a93d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9c2 expref: 12 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.056450:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334965.056513:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+12:53014:x1848989694436096:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 225us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.056520:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4714 00010000:00010000:0.0:1763334965.061822:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a921 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.061846:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a921 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.061855:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a921 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.061863:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.061869:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a921 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.061879:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a921 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.061904:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334965.061908:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.061914:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a921 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.061920:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849a921 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334965.062077:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.062161:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694436224 00000100:00100000:2.0:1763334965.062176:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694436224 00000100:00100000:2.0:1763334965.062249:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4608 00000100:00100000:2.0:1763334965.062273:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53018:x1848989694436224:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.062308:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.062335:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a944 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af9c9 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.062448:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a94b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.062466:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a94b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.062483:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a94b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334965.062623:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:2.0:1763334965.062628:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334965.062662:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a94b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.062697:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a944 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9c9 expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.062715:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a94b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9c9 expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.062722:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.062725:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334965.062728:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:2.0:1763334965.062816:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53018:x1848989694436224:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 545us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334965.062824:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4608 00000100:00100000:3.0:1763334965.063135:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.063399:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694436352 00000100:00100000:2.0:1763334965.063406:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694436352 00000100:00100000:2.0:1763334965.063458:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4715 00000100:00100000:2.0:1763334965.063467:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+26:53014:x1848989694436352:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.063482:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.063498:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849a952 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af9d0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.063526:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a657 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8d4 expref: 27 pid: 7819 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334965.063536:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.063539:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.063544:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849a952 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d0 expref: 27 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.063664:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8d4 expref: 27 pid: 7819 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334965.063682:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a657 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8d4 expref: 27 pid: 7819 timeout: 1129 lvb_type: 1 00000100:00100000:2.0:1763334965.063700:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701827328:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334965.063788:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1000 going to sleep for 11 seconds 00000100:00100000:3.0:1763334965.067052:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.067146:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694436480 00000100:00100000:0.0:1763334965.067160:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694436480 00000100:00100000:0.0:1763334965.067235:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4609 00000100:00100000:0.0:1763334965.067247:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53018:x1848989694436480:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334965.067286:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.067318:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a959 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af9d7 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.067414:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a960 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067434:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a960 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067447:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a960 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067464:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a967 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067471:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a967 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067478:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a967 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067614:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a960 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067622:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a960 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067629:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a960 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067640:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.067645:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a960 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067653:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a960 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067668:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.067672:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.067680:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a960 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067686:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a960 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067703:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a967 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067709:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a967 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067714:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a967 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067720:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.067724:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a967 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067730:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a967 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067737:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60b00) 00010000:00010000:0.0:1763334965.067740:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.067743:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a967 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067749:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849a967 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.067789:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a959 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d7 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.067800:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.067803:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.067806:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849a959 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d7 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.067816:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334965.067901:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53018:x1848989694436480:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 655us (864us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334965.067910:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4609 00000100:00100000:3.0:1763334965.070429:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.070726:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa764e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701827328:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334965.070777:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849a952 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d0 expref: 27 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.070803:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:2.0:1763334965.070874:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+27:53014:x1848989694436352:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7407us (7739us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334965.070886:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4715 00000100:00100000:0.0:1763334965.071003:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694436608 00000100:00100000:0.0:1763334965.071014:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694436608 00010000:00010000:0.0:1763334965.071064:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a657 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8d4 expref: 27 pid: 7819 timeout: 1129 lvb_type: 1 00000100:00100000:0.0:1763334965.071411:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2493 00000100:00100000:0.0:1763334965.071422:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694436608:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334965.071439:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334965.071466:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a657 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8d4 expref: 27 pid: 7819 timeout: 1129 lvb_type: 1 00010000:00010000:0.0:1763334965.071485:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a657 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8d4 expref: 27 pid: 7819 timeout: 1129 lvb_type: 1 00010000:00010000:0.0:1763334965.071513:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849a657 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af8d4 expref: 27 pid: 7819 timeout: 1129 lvb_type: 1 00010000:00010000:0.0:1763334965.071528:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.071530:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.071536:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849a952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d0 expref: 26 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.071547:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849a952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d0 expref: 26 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.071624:0:11727:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849a952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d0 expref: 26 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334965.071638:0:11727:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11727:1848989701827456:192.168.201.60@tcp:105: 00000100:00100000:0.0:1763334965.071704:0:11727:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b540 going to sleep for 11 seconds 00000100:00100000:1.0:1763334965.082306:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.082423:0:11727:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11727:1848989701827456:192.168.201.60@tcp:105: 00010000:00010000:0.0:1763334965.082464:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334965.082541:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694436608:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 11119us (12132us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334965.082555:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2493 00000100:00100000:2.0:1763334965.082739:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694436864 00000100:00100000:2.0:1763334965.082753:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694436864 00002000:00010000:2.0:1763334965.082812:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/559 (0->18446744073709551615) 00002000:00100000:2.0:1763334965.082818:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5503480 with x1848989694436864 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334965.082832:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5503480. 00000100:00100000:2.0:1763334965.082863:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1726 00000100:00100000:2.0:1763334965.082873:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2361:x1848989694436864:12345-192.168.201.60@tcp:10:lfs.0 00000100:00100000:1.0:1763334965.083557:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00002000:00010000:2.0:1763334965.083859:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334965.083863:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb mtime from disk: 0 -> 1763334965 00002000:00010000:2.0:1763334965.083866:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334965.083868:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb ctime from disk: 0 -> 1763334965 00002000:00010000:2.0:1763334965.083870:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334965.083926:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2361:x1848989694436864:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 1053us (1637us total) trans 17179871050 rc 0/0 00000100:00100000:2.0:1763334965.083935:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1726 00002000:00010000:2.0:1763334965.083940:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/559 (0->18446744073709551615) 00002000:00100000:2.0:1763334965.083944:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5503480 with x1848989694436864 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334965.083951:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5503480. 00000100:00100000:1.0:1763334965.084114:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.084356:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694437120 00000100:00100000:3.0:1763334965.084366:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694437120 00000100:00100000:3.0:1763334965.084474:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4610 00000100:00100000:3.0:1763334965.084486:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53018:x1848989694437120:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334965.084512:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334965.084516:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334965.084557:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849a94b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9c9 expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.084614:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334965.084623:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334965.084645:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a96e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af9de expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.084835:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a975 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.084853:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a975 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.084865:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a975 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.084884:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a97c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.084891:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a97c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.084898:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a97c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.087923:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a983 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.087955:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a983 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.087971:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a983 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334965.087986:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x197:0x0]: returning size 0 00010000:00010000:3.0:1763334965.088028:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a975 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.088036:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a975 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.088044:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a975 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.088051:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.088056:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a975 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.088064:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a975 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.088079:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334965.088083:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.088089:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a975 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.088096:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849a975 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:3.0:1763334965.088118:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bf64c331 reply state 000000006498d85e transno 8589938834 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a97c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334965.088128:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763334965.088174:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849a96e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9de expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.088190:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a983 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9de expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.088198:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5acbb5e600) 00010000:00010000:3.0:1763334965.088200:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334965.088203:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7c00, rc 0) 00000100:00100000:3.0:1763334965.088329:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53018:x1848989694437120:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3843us (4775us total) trans 8589938834 rc 0/0 00000100:00100000:3.0:1763334965.088340:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4610 00000100:00100000:0.0:1763334965.103504:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694436736 00000100:00100000:0.0:1763334965.103528:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694436736 00002000:00010000:0.0:1763334965.103634:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/555 (5->18446744073709551615) 00002000:00100000:0.0:1763334965.103641:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5501180 with x1848989694436736 ext(5->18446744073709551615) 00002000:00010000:0.0:1763334965.103657:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac5501180. 00000100:00100000:0.0:1763334965.103702:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1727 00000100:00100000:0.0:1763334965.103711:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2362:x1848989694436736:12345-192.168.201.60@tcp:10:lfs.0 00010000:00010000:3.0:1763334965.103900:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1763334965.104179:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763334965.104184:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb mtime from disk: 1763334965 -> 1763334965 00002000:00010000:0.0:1763334965.104187:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334965.104190:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb ctime from disk: 1763334965 -> 1763334965 00002000:00010000:0.0:1763334965.104192:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1763334965.104295:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2362:x1848989694436736:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 583us (20179us total) trans 21474838333 rc 0/0 00000100:00100000:0.0:1763334965.104306:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1727 00002000:00010000:0.0:1763334965.104311:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/555 (5->18446744073709551615) 00002000:00100000:0.0:1763334965.104314:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5501180 with x1848989694436736 ext(5->18446744073709551615) 00002000:00010000:0.0:1763334965.104319:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac5501180. 00000100:00100000:0.0:1763334965.112733:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.112837:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694437376 00000100:00100000:1.0:1763334965.112854:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694437376 00000100:00100000:1.0:1763334965.112931:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4611 00000100:00100000:1.0:1763334965.112943:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53018:x1848989694437376:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334965.112978:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.113012:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a991 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af9e5 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.113168:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.113187:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a983 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9de expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.113199:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.113259:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a983 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9de expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.113276:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a983 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9de expref: 185 pid: 30972 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334965.113293:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5500000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701827584:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334965.113422:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee300 going to sleep for 11 seconds 00010000:00010000:2.0:1763334965.116177:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a97c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.116198:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a97c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.116206:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a97c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.116216:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.116222:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a97c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.116231:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a97c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.116266:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5ee00) 00010000:00010000:2.0:1763334965.116270:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.116276:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a97c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.116283:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849a97c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334965.116535:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5500000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701827584:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334965.116567:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334965.118150:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.118201:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.118299:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694437504 00000100:00100000:2.0:1763334965.118306:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694437760 00000100:00100000:2.0:1763334965.118312:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694437760 00000100:00100000:0.0:1763334965.118312:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694437504 00010000:00010000:0.0:1763334965.118368:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a983 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9de expref: 186 pid: 30972 timeout: 1129 lvb_type: 0 00000100:00100000:0.0:1763334965.118419:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2494 00000100:00100000:0.0:1763334965.118430:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2359:x1848989694437504:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334965.118450:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334965.118458:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a983 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9de expref: 186 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334965.118472:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a983 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9de expref: 186 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334965.118501:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849a983 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9de expref: 186 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:0.0:1763334965.118519:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5acbb5e600) 00010000:00010000:0.0:1763334965.118524:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.118535:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.118543:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.118568:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334965.118660:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:2359:x1848989694437504:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 231us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334965.118667:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2494 00010000:00010000:1.0:1763334965.118896:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.118906:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334965.118931:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x197:0x0]: returning size 0 00000004:00080000:1.0:1763334965.119403:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x232:0x0], index 1: 0 00000004:00080000:1.0:1763334965.119415:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22e:0x0], index 0: 0 00000004:00080000:1.0:1763334965.119422:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22f:0x0], index 0: 0 00000100:00100000:2.0:1763334965.119423:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4612 00000004:00080000:1.0:1763334965.119427:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x233:0x0], index 1: 0 00000100:00100000:2.0:1763334965.119438:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53014:x1848989694437760:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334965.119539:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a99f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.119554:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a99f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.119565:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a99f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.119641:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.119650:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.119657:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.119664:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00000004:00010000:2.0:1763334965.119665:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000075efa0c4 reply state 00000000b703cd51 transno 8589938836 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a99f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.119668:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.119678:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334965.119680:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763334965.119689:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5acbb5e600) 00010000:00010000:1.0:1763334965.119692:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334965.119695:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.119701:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849a998 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.119760:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a991 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9e5 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334965.119761:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53014:x1848989694437760:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 328us (1559us total) trans 8589938836 rc 0/0 00000100:00100000:2.0:1763334965.119768:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4612 00010000:00010000:1.0:1763334965.119772:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334965.119774:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334965.119778:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a991 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9e5 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.119786:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334965.119824:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53018:x1848989694437376:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6884us (7108us total) trans 8589938835 rc 301/301 00000100:00100000:1.0:1763334965.119830:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4611 00000100:00100000:0.0:1763334965.120061:0:29653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:29653:1848989701827712:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1763334965.120124:0:29653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334965.120169:0:29653:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b540 going to sleep for 11 seconds 00000100:00100000:3.0:1763334965.120537:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701827712 00000100:00100000:3.0:1763334965.120549:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701827712 00000100:00100000:3.0:1763334965.120638:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4716 00000100:00100000:3.0:1763334965.120649:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:29653:x1848989701827712:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1763334965.120704:0:32241:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 578 00000100:00100000:0.0:1763334965.136606:0:29653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:29653:1848989701827712:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1763334965.136640:0:29653:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x233:0x0]-[0x280000400:0x261:0x0] 00000100:00100000:3.0:1763334965.136724:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:29653:x1848989701827712:12345-0@lo:5:osp-pre-1-0.0 Request processed in 15902us (16424us total) trans 17179871051 rc 0/0 00000100:00100000:3.0:1763334965.136740:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4716 00010000:00010000:0.0:1763334965.137492:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a99f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.137507:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a99f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.137516:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a99f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.137523:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.137529:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a99f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.137538:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a99f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.137557:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334965.137560:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.137565:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a99f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.137646:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849a99f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334965.137727:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.138036:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694437888 00000100:00100000:2.0:1763334965.138048:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694437888 00000100:00100000:0.0:1763334965.138127:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.138373:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694438144 00000100:00100000:3.0:1763334965.138378:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694438144 00000100:00100000:3.0:1763334965.138532:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1694 00000100:00100000:3.0:1763334965.138545:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53018:x1848989694438144:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334965.138883:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4717 00000100:00100000:2.0:1763334965.138893:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2361:x1848989694437888:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334965.139067:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763334965.139071:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb mtime from disk: 1763334965 -> 1763334965 00002000:00010000:2.0:1763334965.139073:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb atime from disk: 0 -> 1763334965 00002000:00010000:2.0:1763334965.139075:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb ctime from disk: 1763334965 -> 1763334965 00002000:00010000:2.0:1763334965.139077:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334965.139127:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53018:x1848989694438144:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 583us (999us total) trans 8589938837 rc 0/0 00000100:00100000:3.0:1763334965.139136:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1694 00000100:00100000:2.0:1763334965.139157:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2361:x1848989694437888:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 266us (1434us total) trans 17179871052 rc 0/0 00000100:00100000:2.0:1763334965.139163:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4717 00000100:00100000:0.0:1763334965.141888:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.143051:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.143112:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694438400 00000100:00100000:1.0:1763334965.143127:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694438400 00000100:00100000:1.0:1763334965.143191:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694438656 00000100:00100000:1.0:1763334965.143195:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694438656 00000100:00100000:1.0:1763334965.143217:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1695 00000100:00100000:1.0:1763334965.143228:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01d13c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53018:x1848989694438400:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334965.143639:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01d13c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53018:x1848989694438400:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 409us (1765us total) trans 8589938838 rc 0/0 00000100:00100000:1.0:1763334965.143649:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1695 00000100:00100000:1.0:1763334965.143719:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1696 00000100:00100000:1.0:1763334965.143727:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53014:x1848989694438656:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:1.0:1763334965.143760:0:29631:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x194:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a799 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af93d expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.143839:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 3/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334965.143857:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a856 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af96e expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.143869:0:29631:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 4/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334965.143916:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a856 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af96e expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.143933:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a856 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af96e expref: 186 pid: 30972 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334965.143952:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5500000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701827840:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334965.144014:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee180 going to sleep for 11 seconds 00000100:00100000:1.0:1763334965.155351:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5500000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701827840:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334965.155395:0:29631:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 3/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:2.0:1763334965.156713:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.158426:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694438784 00000100:00100000:1.0:1763334965.158448:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694438784 00010000:00010000:1.0:1763334965.158519:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a856 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af96e expref: 187 pid: 30972 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334965.159198:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2495 00000100:00100000:1.0:1763334965.159217:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+187:2359:x1848989694438784:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.159241:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.159353:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a856 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af96e expref: 187 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334965.159374:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a856 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af96e expref: 187 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334965.159406:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849a856 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af96e expref: 187 pid: 30972 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334965.159432:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:1.0:1763334965.159439:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 3/0,1 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334965.159450:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334965.159458:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334965.159501:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.159629:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa764e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2359:x1848989694438784:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 419us (2924us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.159639:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2495 00000100:00100000:0.0:1763334965.159790:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.159846:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694439040 00000100:00100000:0.0:1763334965.159855:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694439040 00010000:00010000:3.0:1763334965.159897:0:29631:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:0.0:1763334965.159902:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4613 00010000:00010000:3.0:1763334965.159907:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:0.0:1763334965.159910:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694439040:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334965.159944:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.159965:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a9b4 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af9ec expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.160166:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9bb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160179:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9bb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160188:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9bb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160204:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a9c2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160210:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160215:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160309:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a9c9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160317:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a9c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160335:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a9c9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334965.160346:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x197:0x0]: returning size 0 00010000:00010000:0.0:1763334965.160449:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9bb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160460:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9bb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160474:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160481:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.160489:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160497:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9bb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160506:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.160509:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.160513:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9bb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160519:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9bb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160529:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a9c2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160535:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a9c2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160540:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160545:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.160547:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a9c2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160555:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a9c2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160562:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60b00) 00010000:00010000:0.0:1763334965.160565:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.160567:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a9c2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160601:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849a9c2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.160650:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a9b4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9ec expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.160665:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a9c9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9ec expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.160673:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60800) 00010000:00010000:0.0:1763334965.160675:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334965.160678:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:0.0:1763334965.160732:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694439040:12345-192.168.201.60@tcp:101:bash.0 Request processed in 822us (943us total) trans 8589938839 rc 0/0 00000100:00100000:0.0:1763334965.160740:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4613 00000040:00080000:0.0:1763334965.162343:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1081, 88 off92944 00000004:00080000:0.0:1763334965.162363:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1029795790456ns, next at 1030101436569ns, rc = 0 00000040:00080000:0.0:1763334965.162410:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1070, 88 off91856 00000004:00080000:0.0:1763334965.162415:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1029795843360ns, next at 1030101395439ns, rc = 0 00000040:00080000:0.0:1763334965.162443:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1071, 88 off91944 00000004:00080000:0.0:1763334965.162448:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1029795876413ns, next at 1030101395439ns, rc = 0 00000040:00080000:0.0:1763334965.162535:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1082, 88 off93032 00000004:00080000:0.0:1763334965.162541:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1029795968926ns, next at 1030101436569ns, rc = 0 00000100:00100000:1.0:1763334965.165280:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.165329:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694439296 00000100:00100000:1.0:1763334965.165344:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694439296 00000100:00100000:1.0:1763334965.165414:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4614 00000100:00100000:1.0:1763334965.165426:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:52274:x1848989694439296:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1763334965.165505:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.165543:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849a9c9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9ec expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.165565:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60800) 00010000:00010000:1.0:1763334965.165597:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334965.165985:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a9d7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.166003:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.166018:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:1.0:1763334965.166087:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938841 00000004:00010000:1.0:1763334965.166116:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ecaee25e reply state 00000000e82639a3 transno 8589938842 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334965.166126:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334965.166246:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52274:x1848989694439296:12345-192.168.201.60@tcp:36:bash.0 Request processed in 821us (996us total) trans 8589938842 rc 0/0 00000100:00100000:1.0:1763334965.166269:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4614 00000020:00080000:1.0:1763334965.166276:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763334965.170489:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334965.170565:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.170611:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a9d7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.170620:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a9d7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.170626:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.170632:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a9d7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.170640:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a9d7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.170661:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ad28fa800) 00010000:00010000:3.0:1763334965.170664:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.170670:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a9d7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x197:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.170677:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849a9d7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x197:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334965.170986:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694439424 00000100:00100000:1.0:1763334965.171002:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694439424 00000100:00100000:1.0:1763334965.171078:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4615 00000100:00100000:1.0:1763334965.171090:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52274:x1848989694439424:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334965.171137:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.171389:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9de lrc: 2/0,0 mode: --/CR res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af9f3 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.171479:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9f3 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.171497:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9f3 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.171519:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60e00) 00010000:00010000:0.0:1763334965.171522:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334965.171552:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:0.0:1763334965.172494:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52274:x1848989694439424:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1367us (1984us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334965.172509:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4615 00000100:00100000:1.0:1763334965.176022:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.176061:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694439680 00000100:00100000:0.0:1763334965.176076:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694439680 00000100:00100000:0.0:1763334965.176155:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4616 00000100:00100000:0.0:1763334965.176169:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52274:x1848989694439680:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334965.176199:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.176203:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334965.176240:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9f3 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.176278:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60e00) 00010000:00010000:0.0:1763334965.176289:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334965.176307:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a9e5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833af9fa expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.176367:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a9ec lrc: 3/0,1 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.176381:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a9ec lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.176390:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a9ec lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:0.0:1763334965.176922:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1083, 88 off93120 00000004:00080000:0.0:1763334965.176934:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1029810361462ns, next at 1030101436569ns, rc = 0 00000040:00080000:0.0:1763334965.177011:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1072, 88 off92032 00000004:00080000:0.0:1763334965.177016:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1029810444325ns, next at 1030101395439ns, rc = 0 00000040:00080000:0.0:1763334965.177049:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1073, 88 off92120 00000004:00080000:0.0:1763334965.177054:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1029810482622ns, next at 1030101395439ns, rc = 0 00000040:00080000:0.0:1763334965.177074:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1084, 88 off93208 00000004:00080000:0.0:1763334965.177079:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1029810507541ns, next at 1030101436569ns, rc = 0 00000001:00080000:1.0:1763334965.204310:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938839 is committed 00000001:00080000:1.0:1763334965.204356:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938840 is committed 00000004:00080000:1.0:1763334965.204361:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 714 committed 00000004:00080000:1.0:1763334965.204370:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 702 committed 00000004:00080000:1.0:1763334965.204380:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 701 committed 00000004:00080000:1.0:1763334965.204383:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 713 committed 00000100:00100000:0.0:1763334965.204721:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701828352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334965.204829:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334965.204893:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763334965.204900:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701827968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334965.204924:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334965.204957:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701828096:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334965.204982:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334965.205001:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763334965.205007:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701828224:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334965.205030:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334965.205065:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701828352 00000100:00100000:0.0:1763334965.205078:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701828352 00000100:00100000:0.0:1763334965.205139:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701827968 00000100:00100000:0.0:1763334965.205143:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701827968 00000100:00100000:0.0:1763334965.205161:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701828096 00000100:00100000:0.0:1763334965.205163:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701828096 00000100:00100000:0.0:1763334965.205178:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701828224 00000100:00100000:0.0:1763334965.205180:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701828224 00000100:00100000:0.0:1763334965.205205:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4718 00000100:00100000:0.0:1763334965.205216:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701828352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334965.205497:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763334965.205501:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb mtime from disk: 1763334965 -> 1763334965 00002000:00010000:0.0:1763334965.205503:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334965.205505:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb ctime from disk: 1763334965 -> 1763334965 00002000:00010000:0.0:1763334965.205507:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x22b:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1763334965.205553:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701828352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 339us (725us total) trans 21474838334 rc 0/0 00000100:00100000:0.0:1763334965.205562:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4718 00000100:00100000:0.0:1763334965.205614:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4719 00000100:00100000:0.0:1763334965.205621:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701827968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334965.205637:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:556 count 1 00010000:00010000:0.0:1763334965.205663:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.205688:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a8b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af998 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.205703:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334965.205706:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334965.205711:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.205744:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a8b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af998 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.205761:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a8b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af998 expref: 12 pid: 32241 timeout: 1129 lvb_type: 0 00000100:00100000:0.0:1763334965.205774:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701828480:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334965.205839:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1763334965.205858:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4720 00000100:00100000:0.0:1763334965.205865:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701828096:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334965.205876:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:557 count 1 00002000:00010000:0.0:1763334965.205897:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x22d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334965.205902:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a9fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.205911:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.205912:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.205917:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a9fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.205930:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a9fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.205940:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a9fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.205948:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a9fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.205967:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334965.206195:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb344050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701828096:12345-0@lo:6:osp-syn-0-0.0 Request processed in 330us (1211us total) trans 21474838335 rc 0/0 00000100:00100000:0.0:1763334965.206201:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4720 00000100:00100000:0.0:1763334965.206213:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4721 00000100:00100000:0.0:1763334965.206219:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701828224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334965.206328:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334965.206332:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb mtime from disk: 1763334965 -> 1763334965 00002000:00010000:0.0:1763334965.206334:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334965.206336:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb ctime from disk: 1763334965 -> 1763334965 00002000:00010000:0.0:1763334965.206339:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x22a:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:0.0:1763334965.206366:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701828224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (1335us total) trans 21474838336 rc 0/0 00000100:00100000:0.0:1763334965.206372:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4721 00010000:00010000:0.0:1763334965.206402:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334965.206410:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a9fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.206418:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334965.206423:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a9fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.206433:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a9fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.206452:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a9fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.206461:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793800/0xcedf0054f849a9fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.206478:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334965.206480:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334965.206482:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334965.206519:0:3289:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838330 gen 2 00000004:00080000:0.0:1763334965.206526:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca871180, transno 21474838291 00000004:00080000:0.0:1763334965.206538:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca871880, transno 21474838292 00000004:00080000:0.0:1763334965.206542:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca872a00, transno 21474838293 00000004:00080000:0.0:1763334965.206545:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca873800, transno 21474838294 00000004:00080000:0.0:1763334965.206549:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d4e00, transno 21474838296 00000004:00080000:0.0:1763334965.206553:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac721a680, transno 21474838297 00000004:00080000:0.0:1763334965.206556:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77f800, transno 21474838298 00000004:00080000:0.0:1763334965.206560:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77ed80, transno 21474838299 00000004:00080000:0.0:1763334965.206563:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77d180, transno 21474838300 00000004:00080000:0.0:1763334965.206566:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77d880, transno 21474838301 00000004:00080000:0.0:1763334965.206568:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77c000, transno 21474838302 00000004:00080000:0.0:1763334965.206611:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77dc00, transno 21474838303 00000004:00080000:0.0:1763334965.206614:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5576680, transno 21474838306 00000004:00080000:0.0:1763334965.206618:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5574380, transno 21474838307 00000004:00080000:0.0:1763334965.206621:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5b01f2c700, transno 21474838308 00000004:00080000:0.0:1763334965.206624:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5b01f2c380, transno 21474838309 00000004:00080000:0.0:1763334965.206626:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d4a80, transno 21474838313 00000004:00080000:0.0:1763334965.206629:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeec5b100, transno 21474838314 00000004:00080000:0.0:1763334965.206632:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8c3100, transno 21474838315 00000004:00080000:0.0:1763334965.206635:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8c1180, transno 21474838316 00000004:00080000:0.0:1763334965.206638:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8e8000, transno 21474838318 00000004:00080000:0.0:1763334965.206641:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee93ca80, transno 21474838319 00000004:00080000:0.0:1763334965.206643:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4e300, transno 21474838320 00000004:00080000:0.0:1763334965.206647:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af59f8e00, transno 21474838321 00000004:00080000:0.0:1763334965.206650:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac721a300, transno 21474838322 00000004:00080000:0.0:1763334965.206653:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4d180, transno 21474838323 00000004:00080000:0.0:1763334965.206655:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af59faa00, transno 21474838324 00000004:00080000:0.0:1763334965.206658:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4d500, transno 21474838325 00000004:00080000:0.0:1763334965.206661:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6451180, transno 21474838327 00000004:00080000:0.0:1763334965.206663:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6450000, transno 21474838328 00000004:00080000:0.0:1763334965.206666:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab34a80, transno 21474838329 00000004:00080000:0.0:1763334965.206669:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab37480, transno 21474838330 00000100:00100000:0.0:1763334965.206678:0:3289:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5afb1fd880 x1848989701828224/t21474838336(21474838336) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334981 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763334965.206691:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1fd880/2, rc 0, transno 21474838336 00000100:00100000:0.0:1763334965.206697:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701828224:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334965.206711:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1fed80/2, rc 0, transno 21474838335 00000100:00100000:0.0:1763334965.206715:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701828096:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1763334965.206982:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 4 in progress, 2 in flight, 32 done 00000004:00080000:0.0:1763334965.207012:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5b01f2d180/2, rc 0, transno 21474838334 00000100:00100000:0.0:1763334965.207022:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701828352:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1763334965.207154:0:29631:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d18cb9cb reply state 0000000056aa70dc transno 8589938840 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:3.0:1763334965.207168:0:29631:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763334965.207179:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:3.0:1763334965.207183:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763334965.207191:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849a799 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af93d expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1763334965.207306:0:29631:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763334965.207328:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53014:x1848989694438656:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 63601us (64282us total) trans 8589938840 rc 0/0 00000100:00100000:3.0:1763334965.207337:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1696 00000100:00100000:3.0:1763334965.207523:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701828608:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334965.207567:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334965.207627:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334965.207633:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701828992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334965.207651:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334965.207670:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701828864:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334965.207687:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334965.207701:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763334965.207705:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701828736:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334965.207717:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334965.207753:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701828608 00000100:00100000:3.0:1763334965.207760:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701828608 00000100:00100000:3.0:1763334965.207793:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701828992 00000100:00100000:3.0:1763334965.207795:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701828992 00000100:00100000:3.0:1763334965.207807:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701828864 00000100:00100000:3.0:1763334965.207809:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701828864 00000100:00100000:3.0:1763334965.207816:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701828736 00000100:00100000:3.0:1763334965.207818:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701828736 00000100:00100000:3.0:1763334965.207831:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4722 00000100:00100000:3.0:1763334965.207838:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3292:x1848989701828608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334965.207861:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:560 count 1 00010000:00010000:3.0:1763334965.207887:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.207904:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a8c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9a6 expref: 27 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.207911:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334965.207913:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334965.207917:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.207942:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a8c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9a6 expref: 27 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.207952:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a8c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9a6 expref: 27 pid: 26564 timeout: 1129 lvb_type: 0 00000100:00100000:3.0:1763334965.207963:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701829120:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334965.208005:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa806180 going to sleep for 11 seconds 00000100:00100000:3.0:1763334965.208025:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4723 00000100:00100000:3.0:1763334965.208033:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3292:x1848989701828992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334965.208200:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334965.208204:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb mtime from disk: 1763334965 -> 1763334965 00002000:00010000:3.0:1763334965.208207:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334965.208209:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb ctime from disk: 1763334965 -> 1763334965 00002000:00010000:3.0:1763334965.208212:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334965.208261:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3292:x1848989701828992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (597us total) trans 17179871053 rc 0/0 00000100:00100000:3.0:1763334965.208268:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4723 00000100:00100000:3.0:1763334965.208288:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4724 00000100:00100000:3.0:1763334965.208294:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3290:x1848989701828864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334965.208373:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763334965.208376:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb mtime from disk: 1763334965 -> 1763334965 00002000:00010000:3.0:1763334965.208378:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb atime from disk: 1763334965 -> 1763334965 00002000:00010000:3.0:1763334965.208380:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb ctime from disk: 1763334965 -> 1763334965 00002000:00010000:3.0:1763334965.208382:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x22e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334965.208411:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3290:x1848989701828864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (723us total) trans 17179871054 rc 0/0 00000100:00100000:3.0:1763334965.208417:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4724 00000100:00100000:3.0:1763334965.208429:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4725 00000100:00100000:3.0:1763334965.208434:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3290:x1848989701828736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334965.208445:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:561 count 1 00002000:00010000:3.0:1763334965.208466:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x231:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334965.208472:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.208481:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334965.208483:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334965.208488:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.208501:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.208510:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.208517:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.208536:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334965.208744:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3290:x1848989701828736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 309us (1024us total) trans 17179871055 rc 0/0 00000100:00100000:3.0:1763334965.208751:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4725 00010000:00010000:3.0:1763334965.208782:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334965.208789:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.208797:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d63c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334965.208801:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.208811:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.208829:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.208836:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.208854:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334965.208856:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334965.208858:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334965.208901:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d4e00/2, rc 0, transno 17179871055 00000100:00100000:3.0:1763334965.208914:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701828736:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763334965.208925:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d4a80/2, rc 0, transno 17179871054 00000100:00100000:3.0:1763334965.208928:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701828864:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334965.208957:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77f800/2, rc 0, transno 17179871053 00000100:00100000:3.0:1763334965.208965:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701828992:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763334965.214433:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334965.214456:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334965.214465:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334965.214471:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.214478:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334965.214486:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334965.214506:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:2.0:1763334965.214509:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334965.214515:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 2/0,0 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334965.214521:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849a9ad lrc: 0/0,0 mode: --/EX res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00000100:00100000:2.0:1763334965.220143:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701829120:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334965.220705:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701828480:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334965.220741:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.220970:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334965.225549:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.225633:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.225675:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.225711:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694439936 00000100:00100000:1.0:1763334965.225725:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694439936 00010000:00010000:1.0:1763334965.225786:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a8c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9a6 expref: 28 pid: 26564 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334965.225827:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694439808 00000100:00100000:1.0:1763334965.225830:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694439808 00010000:00010000:1.0:1763334965.225846:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a8b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af998 expref: 13 pid: 32241 timeout: 1129 lvb_type: 0 00000100:00100000:1.0:1763334965.225869:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2496 00000100:00100000:1.0:1763334965.225878:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694439936:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.225898:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.225905:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a8c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9a6 expref: 28 pid: 26564 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334965.225918:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a8c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9a6 expref: 28 pid: 26564 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334965.225951:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849a8c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9a6 expref: 28 pid: 26564 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334965.225972:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.225975:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.225981:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.225992:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.226028:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.226096:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694439936:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 218us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.226104:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2496 00000100:00100000:1.0:1763334965.226127:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2497 00000100:00100000:1.0:1763334965.226134:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694439808:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.226144:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.226148:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a8b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af998 expref: 13 pid: 32241 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334965.226160:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a8b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af998 expref: 13 pid: 32241 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334965.226176:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849a8b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af998 expref: 13 pid: 32241 timeout: 1129 lvb_type: 0 00010000:00010000:1.0:1763334965.226186:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.226188:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.226192:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.226226:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.226235:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.226246:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.226265:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.226286:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334965.226657:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3292:x1848989701828608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18816us (19087us total) trans 17179871056 rc 0/0 00000100:00100000:0.0:1763334965.226669:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4722 00000004:00080000:3.0:1763334965.226695:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d5180/2, rc 0, transno 17179871056 00010000:00010000:0.0:1763334965.226702:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334965.226710:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334965.226714:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701828608:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763334965.226730:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d62400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334965.226735:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.226746:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.226761:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.226770:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.226797:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334965.226799:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334965.226801:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.227614:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334965.227662:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694440064 00000100:00100000:3.0:1763334965.227672:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694440064 00010000:00010000:1.0:1763334965.227802:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334965.227842:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4617 00000100:00100000:0.0:1763334965.227854:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53014:x1848989694440064:12345-192.168.201.60@tcp:101:lfs.0 00000100:00100000:1.0:1763334965.227855:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694439808:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1722us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.227863:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2497 00010000:00010000:0.0:1763334965.227882:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.227900:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.227908:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849aa0f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa01 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.227910:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.227922:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.227929:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.227948:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763334965.227990:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849aa0f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa01 expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.228006:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793800/0xcedf0054f849aa0f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x194:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa01 expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.228029:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:0.0:1763334965.228033:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334965.228036:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793800, rc 0) 00000100:00100000:0.0:1763334965.228060:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53014:x1848989694440064:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 211us (2385us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334965.228066:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4617 00000100:00100000:1.0:1763334965.229621:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701827968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23989us (24683us total) trans 21474838337 rc 0/0 00000100:00100000:1.0:1763334965.229639:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4719 00000004:00080000:3.0:1763334965.229683:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1fea00/2, rc 0, transno 21474838337 00000100:00100000:3.0:1763334965.229707:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701827968:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763334965.229858:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334965.229868:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.229882:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334965.229887:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.229899:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.229921:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.229933:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849a9f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.229955:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.229957:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.229958:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334965.247012:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.249840:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694440320 00000100:00100000:3.0:1763334965.249866:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694440320 00000100:00100000:3.0:1763334965.252100:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1697 00000100:00100000:3.0:1763334965.252798:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53014:x1848989694440320:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:3.0:1763334965.254043:0:29631:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x194:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763334965.254552:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1085, 64 off93272 00000040:00080000:3.0:1763334965.254649:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1074, 64 off92184 00000040:00080000:3.0:1763334965.254670:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1075, 64 off92248 00000040:00080000:3.0:1763334965.254686:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1086, 64 off93336 00010000:00010000:3.0:1763334965.255016:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa16 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334965.255042:0:29631:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334965.255057:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334965.255073:0:29631:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa16 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334965.255080:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa16 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334965.255086:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa16 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334965.255282:0:29631:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334965.255467:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334965.255476:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa16 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334965.255485:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d63c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334965.255488:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa16 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334965.255496:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa16 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334965.255512:0:5737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x194:0x0].0x0 (ffff9a5ac51bd100) 00010000:00010000:1.0:1763334965.255515:0:5737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763334965.255521:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa16 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334965.255525:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa16 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x194:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334965.255538:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.255540:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.255542:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334965.256186:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53014:x1848989694440320:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 4058us (9180us total) trans 8589938844 rc 0/0 00000100:00100000:3.0:1763334965.256204:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1697 00000100:00100000:1.0:1763334965.265093:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.265290:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694440576 00000100:00100000:3.0:1763334965.265307:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694440576 00000100:00100000:0.0:1763334965.265946:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4618 00000100:00100000:0.0:1763334965.265963:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53014:x1848989694440576:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334965.265990:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.266016:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849aa1d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa08 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.266110:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aa24 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266127:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aa24 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266139:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aa24 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266153:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aa2b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266159:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aa2b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266165:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aa2b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266362:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849aa32 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266370:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849aa32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266376:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849aa32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:0.0:1763334965.266388:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x197:0x0]: returning size 2 00010000:00010000:0.0:1763334965.266520:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849aa32 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266530:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849aa32 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266537:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849aa32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266544:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.266550:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849aa32 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266560:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849aa32 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266595:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60500) 00010000:00010000:0.0:1763334965.266599:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1763334965.266605:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849aa32 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x197:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266613:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849aa32 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x197:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266632:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aa24 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266639:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aa24 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266644:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aa24 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266649:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.266652:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aa24 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266662:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aa24 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266670:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.266672:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.266676:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aa24 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266681:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aa24 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266690:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aa2b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266696:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aa2b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266701:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aa2b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266706:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.266709:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aa2b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266714:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aa2b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266721:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60e00) 00010000:00010000:0.0:1763334965.266723:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.266726:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aa2b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266731:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aa2b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334965.266779:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849aa1d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa08 expref: 185 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.266790:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.266793:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334965.266797:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849aa1d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa08 expref: 185 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.266806:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334965.266905:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53014:x1848989694440576:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 948us (1829us total) trans 8589938845 rc 301/301 00000100:00100000:0.0:1763334965.266915:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4618 00000001:00080000:0.0:1763334965.275150:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938843 is committed 00000004:00080000:0.0:1763334965.275169:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 716 committed 00000004:00080000:0.0:1763334965.275182:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 704 committed 00000004:00080000:0.0:1763334965.275192:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 703 committed 00000004:00080000:0.0:1763334965.275194:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 715 committed 00000100:00100000:0.0:1763334965.275407:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701829248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334965.275516:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334965.275611:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701829376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334965.275638:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334965.275680:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701829248 00000100:00100000:0.0:1763334965.275691:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701829248 00000100:00100000:0.0:1763334965.275757:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701829376 00000100:00100000:0.0:1763334965.275761:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701829376 00000100:00100000:0.0:1763334965.275786:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4726 00000100:00100000:0.0:1763334965.275796:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701829248:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334965.275975:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4727 00000100:00100000:1.0:1763334965.275985:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701829376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334965.276108:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701829376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (468us total) trans 21474838339 rc 0/0 00000100:00100000:1.0:1763334965.276116:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4727 00000100:00100000:0.0:1763334965.278918:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701829248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3100us (3380us total) trans 21474838338 rc 0/0 00000100:00100000:0.0:1763334965.278942:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4726 00000004:00080000:0.0:1763334965.279087:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f1f80/2, rc 0, transno 21474838339 00000100:00100000:0.0:1763334965.279114:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701829376:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334965.279167:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f0000/2, rc 0, transno 21474838338 00000100:00100000:0.0:1763334965.279173:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701829248:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1763334965.279471:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a9ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x197:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9fa expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.279495:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60500) 00010000:00010000:2.0:1763334965.279499:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334965.279536:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849a9e5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9fa expref: 181 pid: 32232 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763334965.279565:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a9ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x197:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9fa expref: 180 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.279661:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60500) 00010000:00010000:2.0:1763334965.279664:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334965.279667:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:2.0:1763334965.279771:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+180:52274:x1848989694439680:12345-192.168.201.60@tcp:101:bash.0 Request processed in 103605us (103765us total) trans 8589938843 rc 0/0 00000100:00100000:2.0:1763334965.279780:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4616 00000100:00100000:1.0:1763334965.280728:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701829504:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334965.280813:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334965.281002:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701829504 00000100:00100000:2.0:1763334965.281012:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701829504 00000100:00100000:2.0:1763334965.281074:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4728 00000100:00100000:2.0:1763334965.281084:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+26:3290:x1848989701829504:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334965.281374:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763334965.281386:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701829632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334965.281431:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334965.282759:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701829632 00000100:00100000:1.0:1763334965.282776:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701829632 00000100:00100000:1.0:1763334965.282831:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4729 00000100:00100000:1.0:1763334965.282842:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3292:x1848989701829632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334965.283009:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3292:x1848989701829632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 169us (1576us total) trans 17179871058 rc 0/0 00000100:00100000:1.0:1763334965.283016:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4729 00000100:00100000:2.0:1763334965.284346:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+28:3290:x1848989701829504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3248us (3518us total) trans 17179871057 rc 0/0 00000100:00100000:2.0:1763334965.284363:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4728 00000004:00080000:0.0:1763334965.284932:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca872a00/2, rc 0, transno 17179871057 00000100:00100000:0.0:1763334965.284959:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca872a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701829504:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334965.285003:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca873800/2, rc 0, transno 17179871058 00000100:00100000:0.0:1763334965.285007:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701829632:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334965.288943:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.289039:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694440704 00000100:00100000:3.0:1763334965.289055:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694440704 00000100:00100000:3.0:1763334965.289455:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4730 00000100:00100000:3.0:1763334965.289470:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+27:52274:x1848989694440704:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334965.289494:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334965.289524:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849aa40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa0f expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334965.289557:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x232:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334965.290411:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334965.290418:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334965.290435:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849aa40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa0f expref: 28 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.290461:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849aa40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa0f expref: 28 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.290477:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac7d63000, rc 0) 00000100:00100000:3.0:1763334965.291395:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+28:52274:x1848989694440704:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1920us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334965.291411:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4730 00000100:00100000:2.0:1763334965.292985:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.293277:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694440832 00000100:00100000:3.0:1763334965.293294:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694440832 00000100:00100000:3.0:1763334965.293372:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4619 00000100:00100000:3.0:1763334965.293386:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c3c4d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+180:53014:x1848989694440832:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334965.293423:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334965.293451:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa47 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa16 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.293613:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aa4e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.293633:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aa4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.293648:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aa4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334965.293690:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x197:0x0]: returning size 2 00000004:00200000:3.0:1763334965.293696:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334965.293724:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aa4e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.293765:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa47 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x197:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa16 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.293787:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aa4e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa16 expref: 181 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.293798:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60500) 00010000:00010000:3.0:1763334965.293802:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334965.293807:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac7d63600, rc 0) 00000100:00100000:3.0:1763334965.293905:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c3c4d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53014:x1848989694440832:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 521us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334965.293914:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4619 00000100:00100000:0.0:1763334965.298593:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.298702:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694440960 00000100:00100000:2.0:1763334965.298716:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694440960 00000100:00100000:2.0:1763334965.298958:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4731 00000100:00100000:2.0:1763334965.298971:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+12:52274:x1848989694440960:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334965.298994:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.299026:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849aa55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa1d expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334965.299060:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x22e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334965.299090:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.299093:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.299106:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849aa55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa1d expref: 13 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.299125:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849aa55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa1d expref: 13 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.299149:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:2.0:1763334965.299244:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+13:52274:x1848989694440960:12345-192.168.201.60@tcp:101:bash.0 Request processed in 276us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334965.299264:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4731 00000100:00100000:1.0:1763334965.302402:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.303093:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694441216 00000100:00100000:0.0:1763334965.303109:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694441216 00000100:00100000:0.0:1763334965.303182:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1698 00000100:00100000:0.0:1763334965.303193:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53014:x1848989694441216:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334965.303544:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53014:x1848989694441216:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 352us (1156us total) trans 8589938846 rc 0/0 00000100:00100000:0.0:1763334965.303552:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1698 00000100:00100000:2.0:1763334965.304539:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.304648:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.304875:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694441344 00000100:00100000:1.0:1763334965.304884:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694441344 00002000:00010000:1.0:1763334965.304929:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/562 (0->18446744073709551615) 00002000:00100000:1.0:1763334965.304935:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa765f80 with x1848989694441344 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334965.304952:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa765f80. 00000100:00100000:0.0:1763334965.305104:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694441472 00000100:00100000:0.0:1763334965.305110:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694441472 00002000:00010000:0.0:1763334965.305132:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/558 (0->18446744073709551615) 00002000:00100000:0.0:1763334965.305136:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa764380 with x1848989694441472 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334965.305145:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa764380. 00000100:00100000:1.0:1763334965.305287:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1728 00000100:00100000:1.0:1763334965.305300:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694441344:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:3.0:1763334965.305719:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1729 00000100:00100000:2.0:1763334965.307006:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694441472:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334965.307442:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x22e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334965.307449:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x22e:0x0] updating lvb mtime from disk: 0 -> 1763334965 00002000:00010000:2.0:1763334965.307452:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x22e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334965.307455:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x22e:0x0] updating lvb ctime from disk: 0 -> 1763334965 00002000:00010000:2.0:1763334965.307458:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x22e:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:1.0:1763334965.308171:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x232:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334965.308178:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x232:0x0] updating lvb mtime from disk: 0 -> 1763334965 00002000:00010000:1.0:1763334965.308180:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x232:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334965.308182:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x232:0x0] updating lvb ctime from disk: 0 -> 1763334965 00002000:00010000:1.0:1763334965.308186:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x232:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334965.309124:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa764380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694441472:12345-192.168.201.60@tcp:10:bash.0 Request processed in 3385us (4465us total) trans 21474838340 rc 0/0 00000100:00100000:2.0:1763334965.309140:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1729 00002000:00010000:2.0:1763334965.309149:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/558 (0->18446744073709551615) 00002000:00100000:2.0:1763334965.309153:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa764380 with x1848989694441472 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334965.309163:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa764380. 00000100:00100000:1.0:1763334965.309240:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa765f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694441344:12345-192.168.201.60@tcp:10:bash.0 Request processed in 3941us (4706us total) trans 17179871059 rc 0/0 00000100:00100000:1.0:1763334965.309257:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1728 00002000:00010000:1.0:1763334965.309261:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/562 (0->18446744073709551615) 00002000:00100000:1.0:1763334965.309264:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa765f80 with x1848989694441344 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334965.309270:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa765f80. 00000100:00100000:0.0:1763334965.310929:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.311027:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694441728 00000100:00100000:1.0:1763334965.311041:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694441728 00000100:00100000:1.0:1763334965.311445:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4620 00000100:00100000:1.0:1763334965.311458:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53014:x1848989694441728:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334965.311495:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.311525:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aa5c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa24 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.311734:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aa63 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.311755:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aa63 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.311768:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aa63 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.311787:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa6a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.311795:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.311801:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312010:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849aa71 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312020:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849aa71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312026:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849aa71 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334965.312038:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x197:0x0]: returning size 2 00010000:00010000:1.0:1763334965.312156:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aa63 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312164:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aa63 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312171:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aa63 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312177:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334965.312182:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aa63 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312189:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aa63 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312202:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334965.312205:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334965.312211:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aa63 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312217:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aa63 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312237:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa6a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312243:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa6a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312259:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312264:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334965.312267:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa6a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312272:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa6a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312278:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa200) 00010000:00010000:1.0:1763334965.312281:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334965.312283:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa6a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312288:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa6a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.312347:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aa5c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa24 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.312362:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849aa71 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa24 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.312370:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60500) 00010000:00010000:1.0:1763334965.312373:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334965.312376:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334965.312470:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53014:x1848989694441728:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1014us (1552us total) trans 8589938847 rc 0/0 00000100:00100000:1.0:1763334965.312478:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4620 00000100:00100000:2.0:1763334965.317090:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.317144:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.317805:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694441984 00000100:00100000:1.0:1763334965.317824:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694441984 00000100:00100000:1.0:1763334965.317892:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694442112 00000100:00100000:1.0:1763334965.317896:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694442112 00000100:00100000:1.0:1763334965.317916:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1699 00000100:00100000:1.0:1763334965.317933:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694441984:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:0.0:1763334965.318163:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1700 00000100:00100000:0.0:1763334965.318174:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01d12450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53014:x1848989694442112:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:0.0:1763334965.318358:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01d12450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53014:x1848989694442112:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 186us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334965.318366:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1700 00000100:00100000:2.0:1763334965.318623:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.319158:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa765500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694441984:12345-192.168.201.60@tcp:35:bash.0 Request processed in 1226us (2081us total) trans 8589938848 rc 0/0 00000100:00100000:1.0:1763334965.319167:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1699 00000100:00100000:0.0:1763334965.322363:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694442240 00000100:00100000:0.0:1763334965.322388:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694442240 00000100:00100000:0.0:1763334965.322499:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 388 00000100:00100000:0.0:1763334965.322511:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:2360:x1848989694442240:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334965.322532:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334965.322566:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849aa71 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa24 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.322639:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60500) 00010000:00010000:0.0:1763334965.322646:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334965.323496:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa767b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2360:x1848989694442240:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 979us (4866us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334965.323511:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 388 00000100:00100000:2.0:1763334965.327831:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.327912:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694442496 00000100:00100000:1.0:1763334965.327928:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694442496 00000100:00100000:1.0:1763334965.328001:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4621 00000100:00100000:1.0:1763334965.328012:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53014:x1848989694442496:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334965.328039:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.328067:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aa7f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa2b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.328201:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa86 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.328222:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa86 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.328235:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa86 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334965.328260:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x197:0x0]: returning size 5 00010000:00010000:1.0:1763334965.328454:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aa7f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x197:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa2b expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.328477:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa86 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa2b expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.328487:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60500) 00010000:00010000:1.0:1763334965.328490:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334965.328494:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:1.0:1763334965.328631:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa766a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53014:x1848989694442496:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 619us (814us total) trans 8589938849 rc 0/0 00000100:00100000:1.0:1763334965.328641:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4621 00000100:00100000:3.0:1763334965.334272:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.335560:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.335708:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694443008 00000100:00100000:3.0:1763334965.335722:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694443008 00000100:00100000:3.0:1763334965.335802:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4622 00000100:00100000:3.0:1763334965.335815:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53019:x1848989694443008:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:3.0:1763334965.335892:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1763334965.335927:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aa4e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x197:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa16 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.335952:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849a9ec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x197:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9fa expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.335964:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60500) 00010000:00010000:3.0:1763334965.335970:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334965.336002:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa94 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.336018:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa94 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.336028:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa94 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.336045:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa9b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.336051:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.336056:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.336201:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aaa2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.336208:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aaa2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.336215:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aaa2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00080000:3.0:1763334965.336938:0:32232:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x197:0x0] is inserted into orphan list, open count = 2 00010000:00010000:3.0:1763334965.337088:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aaa2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.337098:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aaa2 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.337105:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aaa2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.337111:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.337116:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aaa2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.337123:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aaa2 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.337133:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60500) 00010000:00010000:3.0:1763334965.337136:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763334965.337139:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aaa2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.337145:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aaa2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.337166:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa94 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.337172:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa94 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.337177:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa94 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.337181:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d62400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.337183:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa94 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.337187:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa94 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.337193:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334965.337195:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.337198:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa94 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.337202:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849aa94 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:3.0:1763334965.337209:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006937ea10 reply state 0000000077cc7d0d transno 8589938850 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334965.337217:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334965.337620:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa765880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53019:x1848989694443008:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1803us (2063us total) trans 8589938850 rc 0/0 00000100:00100000:3.0:1763334965.337632:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4622 00000100:00100000:1.0:1763334965.339044:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694442752 00000100:00100000:1.0:1763334965.339063:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694442752 00000100:00100000:1.0:1763334965.339136:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1701 00000100:00100000:1.0:1763334965.339147:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53014:x1848989694442752:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:1.0:1763334965.339243:0:30956:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x197:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa86 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa2b expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.339306:0:30956:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aaa9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.339323:0:30956:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aaa9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.339335:0:30956:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aaa9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30956 initiator: MDT0 00000004:00020000:1.0:1763334965.339701:0:30956:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000404:0x197:0x0]: rc = -1 00010000:00010000:1.0:1763334965.339755:0:30956:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aaa9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.339764:0:30956:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aaa9 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.339772:0:30956:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aaa9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.339778:0:30956:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334965.339783:0:30956:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aaa9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.339792:0:30956:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aaa9 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x197:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.339804:0:30956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60500) 00010000:00010000:1.0:1763334965.339808:0:30956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1763334965.339813:0:30956:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aaa9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.339820:0:30956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aaa9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x197:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.339832:0:30956:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5ac7d60500) 00010000:00010000:1.0:1763334965.339834:0:30956:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334965.339840:0:30956:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849aa86 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x197:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa2b expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334965.340034:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53014:x1848989694442752:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 888us (5789us total) trans 8589938851 rc -1/-1 00000100:00100000:1.0:1763334965.340046:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1701 00010000:00010000:3.0:1763334965.340087:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.340098:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa9b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.340105:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa9b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.340110:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d63c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.340113:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa9b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.340120:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa9b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.340130:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5ed00) 00010000:00010000:3.0:1763334965.340133:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.340137:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa9b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.340143:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849aa9b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334965.349849:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.350429:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694443136 00000100:00100000:3.0:1763334965.350448:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694443136 00000100:00100000:3.0:1763334965.350538:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4623 00000100:00100000:3.0:1763334965.350551:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53014:x1848989694443136:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334965.350625:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334965.350664:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849aab0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa32 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.350756:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849aab0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa32 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.350775:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7800/0xcedf0054f849aab0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x197:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa32 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.350798:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5acbb5e700) 00010000:00010000:3.0:1763334965.350802:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334965.350806:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7800, rc 0) 00000100:00100000:3.0:1763334965.350905:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa764700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53014:x1848989694443136:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 356us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334965.350913:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4623 00000100:00100000:2.0:1763334965.353397:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.355669:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694443392 00000100:00100000:0.0:1763334965.355691:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694443392 00000100:00100000:0.0:1763334965.355786:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1702 00000100:00100000:0.0:1763334965.355798:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53014:x1848989694443392:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:0.0:1763334965.356358:0:30956:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x197:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763334965.356506:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1087, 64 off93400 00000040:00080000:0.0:1763334965.356537:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1076, 64 off92312 00000040:00080000:0.0:1763334965.356553:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1077, 64 off92376 00000040:00080000:0.0:1763334965.356568:0:30956:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1088, 64 off93464 00010000:00010000:0.0:1763334965.356701:0:30956:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aab7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x197:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30956 initiator: MDT0 00010000:00010000:0.0:1763334965.356724:0:30956:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aab7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30956 initiator: MDT0 00010000:00010000:0.0:1763334965.356737:0:30956:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aab7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30956 initiator: MDT0 00010000:00010000:0.0:1763334965.356748:0:30956:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aab7 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30956 initiator: MDT0 00010000:00010000:0.0:1763334965.356755:0:30956:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aab7 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30956 initiator: MDT0 00010000:00010000:0.0:1763334965.356761:0:30956:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aab7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30956 initiator: MDT0 00010000:00010000:0.0:1763334965.356793:0:30956:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334965.356828:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334965.356841:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aab7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.356850:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334965.356855:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aab7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.356865:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aab7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.356884:0:8205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x197:0x0].0x0 (ffff9a5acbb5e700) 00010000:00010000:1.0:1763334965.356888:0:8205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763334965.356895:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aab7 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.356901:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aab7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x197:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 30956 initiator: MDT0 00010000:00010000:1.0:1763334965.356916:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.356918:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.356920:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334965.357019:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53014:x1848989694443392:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1219us (3636us total) trans 8589938852 rc 0/0 00000100:00100000:0.0:1763334965.357031:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1702 00000100:00100000:1.0:1763334965.368537:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.368709:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694443520 00000100:00100000:3.0:1763334965.368723:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694443520 00000100:00100000:3.0:1763334965.368809:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4624 00000100:00100000:3.0:1763334965.368824:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53020:x1848989694443520:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334965.368859:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334965.368887:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aabe lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa39 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.368982:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aac5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369001:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aac5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369017:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aac5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369037:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aacc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369048:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aacc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369055:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aacc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369145:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aac5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369153:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aac5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369159:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aac5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369165:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.369171:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aac5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369179:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aac5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369194:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334965.369198:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.369204:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aac5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369210:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aac5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369224:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aacc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369229:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aacc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369236:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aacc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369241:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.369244:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aacc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369260:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aacc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369268:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5ed00) 00010000:00010000:3.0:1763334965.369271:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.369275:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aacc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369281:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aacc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.369322:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aabe lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa39 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.369335:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334965.369337:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.369342:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aabe lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa39 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.369352:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7c00, rc 0) 00000100:00100000:3.0:1763334965.369442:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53020:x1848989694443520:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 621us (922us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334965.369451:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4624 00000100:00100000:0.0:1763334965.377467:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.377533:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694443776 00000100:00100000:3.0:1763334965.377549:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694443776 00000100:00100000:2.0:1763334965.377730:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4625 00000100:00100000:2.0:1763334965.377747:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53021:x1848989694443776:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.377775:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.377803:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849aad3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa40 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.377897:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849aada lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.377913:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849aada lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.377926:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849aada lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.377941:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aae1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.377948:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aae1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.377953:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aae1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378031:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849aada lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378038:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849aada lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378046:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849aada lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378052:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.378057:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849aada lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378065:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849aada lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378077:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.378080:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.378085:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849aada lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378091:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849aada lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378102:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aae1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378107:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aae1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378113:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aae1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378118:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.378120:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aae1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378125:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aae1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378133:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab500) 00010000:00010000:2.0:1763334965.378135:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.378138:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aae1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378143:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aae1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.378176:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849aad3 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa40 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.378185:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.378187:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334965.378190:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849aad3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa40 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.378199:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:2.0:1763334965.381536:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53021:x1848989694443776:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3774us (4066us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334965.381555:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4625 00000100:00100000:2.0:1763334965.395630:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.395790:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694443904 00000100:00100000:3.0:1763334965.395806:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694443904 00000100:00100000:3.0:1763334965.395895:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4626 00000100:00100000:3.0:1763334965.395908:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53021:x1848989694443904:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334965.395934:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334965.395964:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aae8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa47 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.396056:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aaef lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396075:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aaef lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396090:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aaef lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396109:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aaf6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396116:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396123:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396211:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aaef lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396219:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aaef lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396230:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aaef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396236:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.396241:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aaef lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396260:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aaef lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396274:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334965.396277:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.396285:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aaef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396291:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849aaef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396308:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aaf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396315:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aaf6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396321:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aaf6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396326:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5afb1c7200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.396329:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aaf6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396335:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aaf6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396344:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5ed00) 00010000:00010000:3.0:1763334965.396347:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.396350:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aaf6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396357:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849aaf6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.396401:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aae8 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa47 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.396413:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334965.396416:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.396419:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849aae8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa47 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.396430:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7c00, rc 0) 00000100:00100000:3.0:1763334965.399406:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa764a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53021:x1848989694443904:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3475us (3769us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334965.399427:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4626 00000100:00100000:1.0:1763334965.408112:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.410371:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694444032 00000100:00100000:2.0:1763334965.410396:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694444032 00000100:00100000:2.0:1763334965.410493:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4627 00000100:00100000:2.0:1763334965.410507:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53020:x1848989694444032:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.410535:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.410567:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849aafd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa4e expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.410807:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ab04 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.410824:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ab04 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.410836:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ab04 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.410852:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab0b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.410858:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.410864:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.410951:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ab04 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.410959:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ab04 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.410966:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ab04 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.410973:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.410977:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ab04 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.410985:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ab04 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.411002:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.411005:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.411011:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ab04 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.411016:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ab04 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.411030:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.411035:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab0b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.411041:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab0b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.411045:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.411048:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab0b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.411052:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab0b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.411059:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab500) 00010000:00010000:2.0:1763334965.411061:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.411063:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab0b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.411068:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab0b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.411103:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849aafd lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa4e expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.411115:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.411117:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.411120:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849aafd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa4e expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.411130:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:2.0:1763334965.413619:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53020:x1848989694444032:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3096us (5502us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334965.413636:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4627 00000100:00100000:3.0:1763334965.416813:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.416866:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.417092:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694444160 00000100:00100000:2.0:1763334965.417106:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694444160 00000100:00100000:2.0:1763334965.417184:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694444416 00000100:00100000:2.0:1763334965.417188:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694444416 00000100:00100000:3.0:1763334965.417210:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4628 00000100:00100000:2.0:1763334965.417229:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4629 00000100:00100000:3.0:1763334965.417231:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53020:x1848989694444160:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334965.417272:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334965.417306:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849ab12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa55 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.417409:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ab19 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334965.417428:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ab19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334965.417441:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ab19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334965.417523:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334965.417529:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334965.417554:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ab19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334965.417619:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849ab12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa55 expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.417643:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ab19 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa55 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.417654:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334965.417658:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334965.417662:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7200, rc 0) 00000100:00100000:3.0:1763334965.417736:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53020:x1848989694444160:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 514us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334965.417743:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4628 00000100:00100000:2.0:1763334965.418650:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53022:x1848989694444416:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334965.419017:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.419046:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ab20 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa5c expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.419144:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab27 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419158:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419171:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419191:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab2e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419198:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419205:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419301:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab27 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419310:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab27 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419317:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419323:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.419328:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419335:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab27 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419348:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.419351:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.419356:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab27 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419362:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab27 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419376:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419382:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab2e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419388:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419393:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.419396:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419402:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab2e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419409:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60e00) 00010000:00010000:0.0:1763334965.419412:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.419414:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab2e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419420:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab2e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.419462:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ab20 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa5c expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.419474:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.419476:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334965.419480:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ab20 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa5c expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.419494:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334965.419625:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53022:x1848989694444416:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2331us (2703us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334965.419635:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4629 00000100:00100000:1.0:1763334965.437888:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.438419:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694444672 00000100:00100000:0.0:1763334965.438434:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694444672 00000100:00100000:0.0:1763334965.438513:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4630 00000100:00100000:0.0:1763334965.438525:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53020:x1848989694444672:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334965.438553:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.438557:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334965.438612:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ab19 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa55 expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.438637:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.438644:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334965.438663:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ab35 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa63 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.438845:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab3c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.438862:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab3c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.438873:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab3c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.438889:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab43 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.438897:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab43 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.438902:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab43 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.440157:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ab4a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.440176:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ab4a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.440188:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ab4a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334965.440201:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x199:0x0]: returning size 0 00010000:00010000:0.0:1763334965.440239:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab3c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.440488:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab3c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.440498:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab3c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.440505:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.440510:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab3c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.440519:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab3c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.440532:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.440537:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.440542:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab3c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.440550:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab3c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:0.0:1763334965.440567:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000de94461c reply state 00000000247a42a1 transno 8589938853 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab43 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334965.440688:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334965.441480:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ab35 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa63 expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.441506:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ab4a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa63 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.441514:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac7d60b00) 00010000:00010000:2.0:1763334965.441517:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334965.441519:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:2.0:1763334965.441661:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53020:x1848989694444672:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3138us (3789us total) trans 8589938853 rc 0/0 00000100:00100000:2.0:1763334965.441676:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4630 00010000:00010000:2.0:1763334965.443805:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab43 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.443823:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab43 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.443832:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab43 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.443839:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.443844:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab43 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.443852:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab43 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.443871:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60e00) 00010000:00010000:2.0:1763334965.443875:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.443879:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab43 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.443886:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ab43 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334965.448436:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.448711:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694444928 00000100:00100000:2.0:1763334965.448725:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694444928 00000100:00100000:2.0:1763334965.448800:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4631 00000100:00100000:2.0:1763334965.448813:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53020:x1848989694444928:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.448866:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.448896:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849ab58 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa6a expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.449027:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.449044:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ab4a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa63 expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.449054:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.449097:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ab4a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa63 expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.449112:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ab4a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa63 expref: 190 pid: 32232 timeout: 1130 lvb_type: 0 00000100:00100000:2.0:1763334965.449128:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa765180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701829760:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334965.449517:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.449760:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694445184 00000100:00100000:0.0:1763334965.449767:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694445184 00000100:00100000:0.0:1763334965.449814:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4632 00000100:00100000:0.0:1763334965.449824:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53023:x1848989694445184:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334965.449838:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.449851:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab66 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa71 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.449914:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ab6d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.449928:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ab6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.449942:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ab6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:0.0:1763334965.449955:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x199:0x0]: returning size 0 00010000:00010000:0.0:1763334965.450142:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ab6d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.450152:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ab6d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.450161:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ab6d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.450167:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.450173:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ab6d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.450181:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ab6d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.450197:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac7d60b00) 00010000:00010000:0.0:1763334965.450200:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763334965.450206:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ab6d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.450213:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ab6d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:2.0:1763334965.450648:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1b40 going to sleep for 11 seconds 00010000:00010000:0.0:1763334965.450733:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab66 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa71 expref: 193 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.450747:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.450749:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334965.450753:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ab66 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa71 expref: 193 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.450764:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334965.450842:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53023:x1848989694445184:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1019us (1324us total) trans 8589938854 rc 301/301 00000100:00100000:0.0:1763334965.450851:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4632 00000100:00100000:1.0:1763334965.457380:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.457485:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.457677:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa765180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701829760:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334965.457719:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334965.457803:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694445312 00000100:00100000:3.0:1763334965.457814:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694445312 00010000:00010000:3.0:1763334965.457869:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ab4a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa63 expref: 192 pid: 32232 timeout: 1130 lvb_type: 0 00000100:00100000:3.0:1763334965.457920:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2498 00000100:00100000:3.0:1763334965.457932:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694445312:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334965.457953:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334965.457960:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ab4a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa63 expref: 192 pid: 32232 timeout: 1130 lvb_type: 0 00010000:00010000:3.0:1763334965.457974:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ab4a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa63 expref: 192 pid: 32232 timeout: 1130 lvb_type: 0 00010000:00010000:3.0:1763334965.458004:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ab4a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa63 expref: 192 pid: 32232 timeout: 1130 lvb_type: 0 00010000:00010000:3.0:1763334965.458024:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac7d60b00) 00010000:00010000:3.0:1763334965.458031:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.458042:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.458051:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.458078:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334965.458145:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88ed050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+191:2360:x1848989694445312:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 215us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334965.458153:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2498 00010000:00010000:2.0:1763334965.458428:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.458437:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334965.458463:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x199:0x0]: returning size 0 00000100:00100000:0.0:1763334965.458665:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694445568 00000100:00100000:0.0:1763334965.458671:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694445568 00000100:00100000:0.0:1763334965.458707:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1703 00000100:00100000:0.0:1763334965.458715:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53023:x1848989694445568:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334965.458974:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53023:x1848989694445568:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 260us (1489us total) trans 8589938855 rc 0/0 00000100:00100000:0.0:1763334965.458983:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1703 00000004:00080000:2.0:1763334965.459930:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x230:0x0], index 0: 0 00000004:00080000:2.0:1763334965.459946:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x234:0x0], index 1: 0 00000004:00080000:2.0:1763334965.459954:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x235:0x0], index 1: 0 00000004:00080000:2.0:1763334965.459959:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x231:0x0], index 0: 0 00010000:00010000:2.0:1763334965.460173:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.460186:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.460194:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.460201:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.460207:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.460216:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.460233:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac7d60b00) 00010000:00010000:2.0:1763334965.460237:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334965.461106:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.461129:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ab5f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.461216:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849ab58 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa6a expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.461231:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.461234:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334965.461240:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849ab58 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa6a expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.461264:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:2.0:1763334965.461348:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53020:x1848989694444928:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 12537us (12927us total) trans 8589938856 rc 301/301 00000100:00100000:2.0:1763334965.462421:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4631 00000100:00100000:1.0:1763334965.465759:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.465855:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694445824 00000100:00100000:2.0:1763334965.465872:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694445824 00000100:00100000:2.0:1763334965.466159:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4633 00000100:00100000:2.0:1763334965.466171:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53023:x1848989694445824:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.466198:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.466226:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ab82 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa78 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.466751:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ab89 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.466771:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ab89 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.466785:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ab89 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.466802:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ab90 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.466809:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ab90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.466815:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ab90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.466991:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ab97 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467001:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ab97 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467009:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ab97 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467159:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ab89 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467168:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ab89 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467176:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ab89 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467184:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.467189:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ab89 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467199:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ab89 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467214:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.467218:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.467225:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ab89 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467231:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ab89 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467367:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ab90 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467375:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ab90 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467381:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ab90 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467385:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.467388:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ab90 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467396:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ab90 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467405:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab500) 00010000:00010000:2.0:1763334965.467408:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.467412:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ab90 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467418:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ab90 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.467480:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ab82 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa78 expref: 194 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.467495:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ab97 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa78 expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.467504:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:2.0:1763334965.467506:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334965.467509:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066c00, rc 0) 00000100:00100000:2.0:1763334965.467834:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53023:x1848989694445824:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1662us (2090us total) trans 8589938857 rc 0/0 00000100:00100000:2.0:1763334965.467845:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4633 00000100:00100000:3.0:1763334965.468402:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.468846:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694446080 00000100:00100000:2.0:1763334965.468860:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694446080 00000100:00100000:2.0:1763334965.468924:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1704 00000100:00100000:2.0:1763334965.468934:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53020:x1848989694446080:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334965.471305:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53020:x1848989694446080:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 2358us (2893us total) trans 8589938858 rc 0/0 00000100:00100000:2.0:1763334965.471322:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1704 00000100:00100000:3.0:1763334965.473538:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.473648:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694446208 00000100:00100000:0.0:1763334965.473663:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694446208 00000100:00100000:0.0:1763334965.473729:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4732 00000100:00100000:0.0:1763334965.473740:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2361:x1848989694446208:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334965.473762:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.473791:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849aba5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa7f expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334965.473823:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x235:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334965.473847:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.473850:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.473861:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849aba5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa7f expref: 30 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334965.473883:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849aba5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa7f expref: 30 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334965.473899:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334965.473975:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2361:x1848989694446208:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 236us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334965.473986:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4732 00000100:00100000:1.0:1763334965.474207:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.474251:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694446336 00000100:00100000:2.0:1763334965.474257:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694446336 00000100:00100000:2.0:1763334965.474299:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4733 00000100:00100000:2.0:1763334965.474307:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694446336:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.474316:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.474331:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849abac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa86 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334965.474351:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x231:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334965.474362:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.474365:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.474370:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849abac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa86 expref: 15 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334965.474385:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849abac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa86 expref: 15 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334965.474395:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:2.0:1763334965.474421:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2361:x1848989694446336:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 115us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334965.474428:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4733 00000100:00100000:0.0:1763334965.478726:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.478772:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.479240:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694446592 00000100:00100000:3.0:1763334965.479265:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694446592 00000100:00100000:2.0:1763334965.479281:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694446848 00000100:00100000:2.0:1763334965.479286:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694446848 00000100:00100000:3.0:1763334965.479400:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1705 00000100:00100000:2.0:1763334965.479407:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1706 00000100:00100000:3.0:1763334965.479412:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01d12850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53020:x1848989694446592:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334965.479414:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53023:x1848989694446848:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334965.479817:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53023:x1848989694446848:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 401us (1041us total) trans 8589938859 rc 0/0 00000100:00100000:2.0:1763334965.479826:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1706 00000100:00100000:0.0:1763334965.480871:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01d12850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53020:x1848989694446592:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1451us (2149us total) trans 8589938860 rc 0/0 00000100:00100000:0.0:1763334965.480883:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1705 00000100:00100000:0.0:1763334965.485644:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.485891:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694447104 00000100:00100000:2.0:1763334965.485906:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694447104 00000100:00100000:2.0:1763334965.485984:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4634 00000100:00100000:2.0:1763334965.485996:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53023:x1848989694447104:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.486030:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.486060:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849abb3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa8d expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.486199:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849abba lrc: 3/0,1 mode: --/CW res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.486217:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ab97 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa78 expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.486229:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849abba lrc: 4/0,1 mode: --/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.486287:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ab97 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa78 expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.486305:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ab97 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa78 expref: 197 pid: 32232 timeout: 1130 lvb_type: 0 00000100:00100000:2.0:1763334965.486321:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa765180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701829888:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334965.486424:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1000 going to sleep for 11 seconds 00000100:00100000:3.0:1763334965.487256:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.487519:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694447360 00000100:00100000:0.0:1763334965.487530:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694447360 00000100:00100000:0.0:1763334965.487613:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4635 00000100:00100000:0.0:1763334965.487625:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+198:52274:x1848989694447360:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334965.487645:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.487667:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849abc1 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa94 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.487775:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.487790:0:29629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.487801:0:29629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:2.0:1763334965.490232:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa765180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701829888:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334965.490310:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849abba lrc: 3/0,1 mode: --/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334965.491117:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.491222:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694447488 00000100:00100000:2.0:1763334965.491235:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694447488 00010000:00010000:2.0:1763334965.491433:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ab97 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa78 expref: 200 pid: 32232 timeout: 1130 lvb_type: 0 00000100:00100000:2.0:1763334965.491489:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2499 00000100:00100000:2.0:1763334965.491502:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:2359:x1848989694447488:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334965.491526:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334965.491534:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ab97 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa78 expref: 200 pid: 32232 timeout: 1130 lvb_type: 0 00010000:00010000:2.0:1763334965.491550:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ab97 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa78 expref: 200 pid: 32232 timeout: 1130 lvb_type: 0 00010000:00010000:2.0:1763334965.491652:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ab97 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa78 expref: 200 pid: 32232 timeout: 1130 lvb_type: 0 00010000:00010000:2.0:1763334965.491680:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:2.0:1763334965.491686:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849abba lrc: 3/0,1 mode: --/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.491698:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849abba lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.491707:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849abba lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.491717:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.491724:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.491731:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.491775:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334965.491843:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:2359:x1848989694447488:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 343us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334965.491851:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2499 00010000:00010000:0.0:1763334965.492139:0:29629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.492149:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:0.0:1763334965.492184:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x199:0x0]: returning size 0 00010000:00010000:1.0:1763334965.492347:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849abba lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.492357:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849abba lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334965.492373:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x199:0x0]: returning size 0 00010000:00010000:1.0:1763334965.492618:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849abb3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa8d expref: 200 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.492640:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849abba lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa8d expref: 199 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.492648:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:1.0:1763334965.492651:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334965.492655:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:1.0:1763334965.492733:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53023:x1848989694447104:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6740us (7105us total) trans 8589938861 rc 0/0 00000100:00100000:1.0:1763334965.492742:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4634 00010000:00010000:0.0:1763334965.492876:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849abc1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa94 expref: 200 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.492890:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa94 expref: 199 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.492898:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:0.0:1763334965.492900:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763334965.492902:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334965.492927:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+199:52274:x1848989694447360:12345-192.168.201.60@tcp:101:bash.0 Request processed in 5306us (5690us total) trans 8589938862 rc 0/0 00000100:00100000:0.0:1763334965.492934:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4635 00000100:00100000:1.0:1763334965.496550:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.496668:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694447744 00000100:00100000:0.0:1763334965.496683:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694447744 00000100:00100000:0.0:1763334965.496756:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4636 00000100:00100000:0.0:1763334965.496769:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+199:52274:x1848989694447744:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:0.0:1763334965.497191:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abdd lrc: 3/0,1 mode: --/PW res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.497214:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abdd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.497229:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abdd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000001:00080000:0.0:1763334965.497316:0:29629:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938863 00000004:00010000:0.0:1763334965.497342:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b8318666 reply state 00000000b3b8c567 transno 8589938864 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abdd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:0.0:1763334965.497354:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334965.497487:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+202:52274:x1848989694447744:12345-192.168.201.60@tcp:36:bash.0 Request processed in 719us (951us total) trans 8589938864 rc 0/0 00000100:00100000:0.0:1763334965.497497:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4636 00000020:00080000:0.0:1763334965.497503:0:29629:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763334965.498254:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.498310:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.498395:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694447872 00000100:00100000:1.0:1763334965.498409:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694447872 00000100:00100000:1.0:1763334965.498487:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 389 00000100:00100000:1.0:1763334965.498499:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+202:2359:x1848989694447872:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.498522:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.498555:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849abba lrc: 0/0,0 mode: --/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa8d expref: 202 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334965.498677:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694448128 00000100:00100000:0.0:1763334965.498682:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694448128 00000100:00100000:0.0:1763334965.498718:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1707 00000100:00100000:0.0:1763334965.498725:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53023:x1848989694448128:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334965.499117:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53023:x1848989694448128:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 391us (805us total) trans 8589938865 rc 0/0 00000100:00100000:0.0:1763334965.499126:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1707 00010000:00010000:1.0:1763334965.499357:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:1.0:1763334965.499364:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.499402:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+202:2359:x1848989694447872:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 906us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.499409:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 389 00010000:00010000:0.0:1763334965.501218:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abdd lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.501240:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abdd lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.501266:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abdd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.501273:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.501279:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abdd lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.501287:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abdd lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.501304:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:0.0:1763334965.501308:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.501313:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abdd lrc: 2/0,0 mode: --/PW res: [0x200000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.501319:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abdd lrc: 0/0,0 mode: --/PW res: [0x200000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:0.0:1763334965.502380:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.502626:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694448256 00000100:00100000:1.0:1763334965.502640:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694448256 00000100:00100000:1.0:1763334965.502709:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4637 00000100:00100000:1.0:1763334965.502720:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+201:52274:x1848989694448256:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334965.502751:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.502776:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849abe4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afa9b expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.502853:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849abe4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa9b expref: 202 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.502872:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849abe4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa9b expref: 202 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.502895:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:1.0:1763334965.502899:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334965.502902:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478000, rc 0) 00000100:00100000:1.0:1763334965.502975:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+202:52274:x1848989694448256:12345-192.168.201.60@tcp:101:bash.0 Request processed in 256us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.502983:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4637 00000100:00100000:3.0:1763334965.503981:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.504315:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694448384 00000100:00100000:2.0:1763334965.504328:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694448384 00000100:00100000:2.0:1763334965.504386:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1708 00000100:00100000:2.0:1763334965.504396:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53023:x1848989694448384:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:2.0:1763334965.504563:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53023:x1848989694448384:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 168us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334965.504604:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1708 00000100:00100000:0.0:1763334965.507241:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.507393:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694448640 00000100:00100000:3.0:1763334965.507407:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694448640 00000100:00100000:3.0:1763334965.507479:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4638 00000100:00100000:3.0:1763334965.507490:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+202:52274:x1848989694448640:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334965.507518:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334965.507522:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334965.507558:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849abe4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa9b expref: 202 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.507614:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:3.0:1763334965.507621:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334965.507640:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849abeb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afaa2 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.507707:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849abf2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.507722:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849abf2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.507733:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849abf2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:3.0:1763334965.508558:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1078, 88 off92464 00000004:00080000:3.0:1763334965.509074:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1030142501353ns, next at 1030101395439ns, rc = 0 00000040:00080000:2.0:1763334965.509648:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1089, 88 off93552 00000004:00080000:2.0:1763334965.509659:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1030143086962ns, next at 1030101436569ns, rc = 0 00000040:00080000:2.0:1763334965.509690:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1090, 88 off93640 00000004:00080000:2.0:1763334965.509695:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1030143123082ns, next at 1030101436569ns, rc = 0 00000040:00080000:2.0:1763334965.509719:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1079, 88 off92552 00000004:00080000:2.0:1763334965.509723:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1030143151668ns, next at 1030101395439ns, rc = 0 00000100:00100000:2.0:1763334965.523206:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.523595:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694448896 00000100:00100000:0.0:1763334965.523610:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694448896 00000100:00100000:0.0:1763334965.523687:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4639 00000100:00100000:0.0:1763334965.523698:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53024:x1848989694448896:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334965.523727:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.523758:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abf9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afaa9 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.523873:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac00 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.523891:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac00 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.523942:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac00 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.523959:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac07 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.523967:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.523974:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524151:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ac0e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524161:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ac0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524168:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ac0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:0.0:1763334965.524180:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x199:0x0]: returning size 2 00010000:00010000:0.0:1763334965.524415:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ac0e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524424:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ac0e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524431:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ac0e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524438:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.524444:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ac0e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524452:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ac0e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524467:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:0.0:1763334965.524470:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1763334965.524476:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ac0e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524483:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ac0e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524504:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac00 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524510:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac00 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524515:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac00 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524520:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.524522:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac00 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524528:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac00 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524534:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.524537:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.524540:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac00 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524545:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac00 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524553:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac07 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524558:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac07 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524564:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524568:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.524593:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac07 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524599:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac07 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524606:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60c00) 00010000:00010000:0.0:1763334965.524608:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.524611:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac07 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524616:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac07 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334965.524669:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abf9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afaa9 expref: 206 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.524682:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.524685:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334965.524689:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849abf9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afaa9 expref: 206 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.524700:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334965.524801:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa765180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53024:x1848989694448896:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1104us (1610us total) trans 8589938867 rc 301/301 00000100:00100000:0.0:1763334965.524811:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4639 00000100:00100000:3.0:1763334965.529901:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.529946:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694449024 00000100:00100000:3.0:1763334965.529960:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694449024 00000100:00100000:3.0:1763334965.530037:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4640 00000100:00100000:3.0:1763334965.530051:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53024:x1848989694449024:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334965.530081:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334965.530110:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849ac1c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afab0 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.530239:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.530284:0:29629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa94 expref: 206 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.530292:0:29629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849abf2 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.530301:0:29629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.530329:0:29629:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849abf2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.530364:0:29629:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa94 expref: 206 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.530379:0:29629:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa94 expref: 206 pid: 29629 timeout: 1130 lvb_type: 0 00000100:00100000:3.0:1763334965.530399:0:29629:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701830016:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334965.530517:0:29629:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa806b40 going to sleep for 11 seconds 00000100:00100000:3.0:1763334965.533478:0:29629:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701830016:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334965.533522:0:29629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:2.0:1763334965.533689:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.534398:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694449152 00000100:00100000:1.0:1763334965.534413:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694449152 00010000:00010000:1.0:1763334965.534461:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa94 expref: 207 pid: 29629 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.534502:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2500 00000100:00100000:1.0:1763334965.534514:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+207:2359:x1848989694449152:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.534533:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.534541:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa94 expref: 207 pid: 29629 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.534555:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa94 expref: 207 pid: 29629 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.535178:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849abc8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x199:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa94 expref: 207 pid: 29629 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.535210:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:1.0:1763334965.535217:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334965.535228:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334965.535234:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334965.535239:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.535345:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa764000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+206:2359:x1848989694449152:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 831us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.535355:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2500 00000001:00080000:3.0:1763334965.548017:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938865 is committed 00000001:00080000:0.0:1763334965.548235:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938866 is committed 00000004:00080000:0.0:1763334965.548256:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 706 committed 00000004:00080000:0.0:1763334965.548276:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 718 committed 00000004:00080000:0.0:1763334965.548287:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 717 committed 00000004:00080000:0.0:1763334965.548290:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 705 committed 00000100:00100000:2.0:1763334965.548624:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701830528:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334965.548729:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334965.548785:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1763334965.548792:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701830144:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334965.548814:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334965.548832:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701830656:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334965.548850:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334965.548881:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701830272:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334965.548904:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334965.548920:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701830784:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334965.548944:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334965.548961:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763334965.548966:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701830400:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334965.548987:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334965.549025:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701830528 00000100:00100000:2.0:1763334965.549036:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701830528 00000100:00100000:2.0:1763334965.549106:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701830144 00000100:00100000:2.0:1763334965.549110:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701830144 00000100:00100000:2.0:1763334965.549130:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701830656 00000100:00100000:2.0:1763334965.549133:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701830656 00000100:00100000:2.0:1763334965.549149:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701830272 00000100:00100000:2.0:1763334965.549151:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701830272 00000100:00100000:2.0:1763334965.549164:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701830784 00000100:00100000:2.0:1763334965.549167:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701830784 00000100:00100000:2.0:1763334965.549178:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701830400 00000100:00100000:2.0:1763334965.549181:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701830400 00000100:00100000:2.0:1763334965.549196:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4734 00000100:00100000:2.0:1763334965.549207:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701830528:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334965.549255:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:559 count 1 00002000:00010000:2.0:1763334965.549302:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x22f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334965.549312:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ac2a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.549332:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.549335:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.549342:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ac2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.549359:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ac2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.549371:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ac2a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.549380:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ac2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.549409:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334965.549843:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701830528:12345-0@lo:6:osp-syn-0-0.0 Request processed in 636us (1114us total) trans 21474838341 rc 0/0 00000100:00100000:2.0:1763334965.549854:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4734 00000100:00100000:2.0:1763334965.549882:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4735 00000100:00100000:2.0:1763334965.549891:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701830144:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334965.549907:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:554 count 1 00010000:00010000:2.0:1763334965.549923:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.549943:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a71b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af913 expref: 14 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.549951:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334965.549953:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334965.549957:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.550017:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a71b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af913 expref: 14 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.550035:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a71b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af913 expref: 14 pid: 26564 timeout: 1130 lvb_type: 0 00000100:00100000:2.0:1763334965.550050:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7218700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701830912:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334965.550145:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334965.550177:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4736 00000100:00100000:2.0:1763334965.550186:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701830656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334965.550440:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4737 00000100:00100000:1.0:1763334965.550452:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701830272:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763334965.550471:0:32239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:555 count 1 00010000:00010000:1.0:1763334965.550486:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.550501:0:32239:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a93d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9c2 expref: 14 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.550508:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334965.550510:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334965.550513:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.550538:0:32239:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a93d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9c2 expref: 14 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.550549:0:32239:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a93d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9c2 expref: 14 pid: 26564 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.550560:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701831040:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334965.551032:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4738 00000100:00100000:3.0:1763334965.551042:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701830784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334965.551187:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x231:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334965.551191:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x231:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1763334965.551194:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x231:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334965.551196:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x231:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1763334965.551198:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x231:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334965.551269:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701831168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334965.551537:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334965.551556:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8eee40 going to sleep for 11 seconds 00000100:00100000:0.0:1763334965.551564:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701831680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334965.551602:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334965.551618:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763334965.551624:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701831552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334965.551644:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334965.551745:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701830784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 703us (2798us total) trans 21474838343 rc 0/0 00000100:00100000:3.0:1763334965.551753:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4738 00000100:00100000:3.0:1763334965.551780:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701831168 00000100:00100000:3.0:1763334965.551790:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701831168 00000100:00100000:3.0:1763334965.551818:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701831680 00000100:00100000:3.0:1763334965.551820:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701831680 00000100:00100000:3.0:1763334965.551830:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701831552 00000100:00100000:3.0:1763334965.551833:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701831552 00000100:00100000:3.0:1763334965.551845:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4739 00000100:00100000:3.0:1763334965.551852:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701830400:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334965.551873:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:558 count 1 00010000:00010000:3.0:1763334965.551897:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.551916:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849aa55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa1d expref: 14 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.551923:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334965.551925:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334965.551929:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.551953:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849aa55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa1d expref: 14 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.551966:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849aa55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa1d expref: 14 pid: 32241 timeout: 1130 lvb_type: 0 00000100:00100000:3.0:1763334965.551978:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701831936:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334965.552011:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa8069c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334965.552021:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701830656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1835us (3167us total) trans 21474838342 rc 0/0 00000100:00100000:2.0:1763334965.552028:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4736 00000100:00100000:3.0:1763334965.552032:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4740 00000100:00100000:3.0:1763334965.552039:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3290:x1848989701831168:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334965.552045:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4741 00000100:00100000:2.0:1763334965.552052:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3290:x1848989701831680:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:3.0:1763334965.552054:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:558 count 1 00010000:00010000:3.0:1763334965.552070:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.552085:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a895 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af98a expref: 29 pid: 26216 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1763334965.552223:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4742 00000100:00100000:0.0:1763334965.552233:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3290:x1848989701831552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334965.552257:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:563 count 1 00002000:00010000:0.0:1763334965.552282:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x233:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334965.552288:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849ac4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.552296:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.552298:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.552304:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849ac4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.552319:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849ac4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.552329:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849ac4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.552337:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849ac4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334965.552373:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3290:x1848989701831680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 322us (769us total) trans 17179871060 rc 0/0 00000100:00100000:2.0:1763334965.552385:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4741 00010000:00010000:0.0:1763334965.552440:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1763334965.552462:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334965.552462:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334965.552469:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849ac4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.552471:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ac2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.552480:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334965.552480:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334965.552485:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849ac4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.552485:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ac2a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.552498:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849ac4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.552498:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ac2a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.552518:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849ac4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.552518:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ac2a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.552526:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ac2a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.552527:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849ac4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.552547:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334965.552548:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.552549:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334965.552550:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334965.552551:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.552551:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334965.552702:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701831296:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334965.552732:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334965.552800:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701831296 00000100:00100000:1.0:1763334965.552805:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701831296 00000100:00100000:1.0:1763334965.552840:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4743 00000100:00100000:1.0:1763334965.552847:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3291:x1848989701831296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763334965.552862:0:25383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:559 count 1 00010000:00010000:1.0:1763334965.552877:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.552893:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849a952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d0 expref: 29 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.552900:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334965.552902:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334965.552906:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.552940:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849a952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d0 expref: 29 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.552952:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849a952 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d0 expref: 29 pid: 32241 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.552963:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701832064:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334965.552995:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763334965.553354:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334965.553356:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334965.553359:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.553384:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af98a expref: 29 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334965.553395:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af98a expref: 29 pid: 26216 timeout: 1130 lvb_type: 1 00000100:00100000:3.0:1763334965.553405:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701832192:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334965.553447:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa806cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334965.553466:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701831424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334965.553503:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334965.553648:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3290:x1848989701831552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1414us (1999us total) trans 17179871061 rc 0/0 00000100:00100000:0.0:1763334965.553657:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4742 00000100:00100000:0.0:1763334965.553858:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701831424 00000100:00100000:0.0:1763334965.553865:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701831424 00000100:00100000:1.0:1763334965.553924:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4744 00000100:00100000:1.0:1763334965.553935:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3292:x1848989701831424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763334965.553954:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:562 count 1 00010000:00010000:1.0:1763334965.553976:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.553990:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849aa40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa0f expref: 29 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.553997:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334965.553999:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334965.554002:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.554023:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849aa40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa0f expref: 29 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.554033:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849aa40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa0f expref: 29 pid: 32241 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.554043:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701832320:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334965.554077:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee780 going to sleep for 11 seconds 00000004:00080000:0.0:1763334965.554214:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa767480/2, rc 0, transno 21474838343 00000100:00100000:0.0:1763334965.554223:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa767480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701830784:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1763334965.554599:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849abf2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x199:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afaa2 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.554614:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:3.0:1763334965.554617:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000100:00100000:2.0:1763334965.554937:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701831808:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334965.554988:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763334965.555029:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa767100/2, rc 0, transno 21474838342 00000100:00100000:2.0:1763334965.555034:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa767100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701830656:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334965.555045:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa766d80/2, rc 0, transno 21474838341 00000100:00100000:2.0:1763334965.555048:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701830528:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763334965.555086:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5b01f2c700/2, rc 0, transno 17179871061 00010000:00010000:3.0:1763334965.555227:0:32232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.555241:0:32232:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.555257:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.555314:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849abeb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x199:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afaa2 expref: 183 pid: 32232 timeout: 0 lvb_type: 3 00000100:00100000:2.0:1763334965.555657:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701831552:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1763334965.555679:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeefe6a00/2, rc 0, transno 17179871060 00000100:00100000:2.0:1763334965.555684:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701831680:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763334965.555782:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849abf2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x199:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afaa2 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.555822:0:29629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.555830:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334965.555884:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x199:0x0]: returning size 2 00000004:00200000:3.0:1763334965.555889:0:29629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334965.555915:0:29629:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.555945:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849ac1c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x199:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afab0 expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.555956:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afab0 expref: 182 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.555965:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:3.0:1763334965.555968:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334965.555971:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7200, rc 0) 00000100:00100000:3.0:1763334965.556052:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53024:x1848989694449024:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 26003us (26164us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334965.556062:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4640 00000100:00100000:0.0:1763334965.556189:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701831808 00000100:00100000:0.0:1763334965.556198:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701831808 00000100:00100000:0.0:1763334965.556289:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4745 00000100:00100000:0.0:1763334965.556300:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3291:x1848989701831808:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763334965.556812:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7600, rc 0) 00000100:00100000:3.0:1763334965.556890:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+181:52274:x1848989694448640:12345-192.168.201.60@tcp:101:bash.0 Request processed in 49399us (49662us total) trans 8589938866 rc 0/0 00000100:00100000:3.0:1763334965.556899:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4638 00002000:00010000:0.0:1763334965.558118:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334965.558130:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763334965.558140:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334965.558142:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763334965.558145:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x235:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334965.558236:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3291:x1848989701831808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1933us (3241us total) trans 17179871062 rc 0/0 00000100:00100000:0.0:1763334965.558262:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4745 00000004:00080000:2.0:1763334965.559320:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeefe6680/2, rc 0, transno 17179871062 00000100:00100000:2.0:1763334965.559339:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701831808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334965.563908:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.563943:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.563966:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.564023:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694449280 00000100:00100000:0.0:1763334965.564042:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694449280 00010000:00010000:0.0:1763334965.564096:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849aa55 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa1d expref: 15 pid: 32241 timeout: 1130 lvb_type: 0 00000100:00100000:0.0:1763334965.564157:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694449536 00000100:00100000:0.0:1763334965.564161:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694449536 00010000:00010000:0.0:1763334965.564178:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a895 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af98a expref: 30 pid: 26216 timeout: 1130 lvb_type: 1 00000100:00100000:0.0:1763334965.564195:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694449408 00000100:00100000:0.0:1763334965.564198:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694449408 00010000:00010000:0.0:1763334965.564210:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849a952 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d0 expref: 31 pid: 32241 timeout: 1130 lvb_type: 0 00000100:00100000:0.0:1763334965.564229:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2501 00000100:00100000:0.0:1763334965.564240:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694449280:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334965.564274:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334965.564281:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849aa55 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa1d expref: 15 pid: 32241 timeout: 1130 lvb_type: 0 00010000:00010000:0.0:1763334965.564295:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849aa55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa1d expref: 15 pid: 32241 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.565053:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2502 00000100:00100000:1.0:1763334965.565069:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694449536:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763334965.565080:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701832192:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334965.565082:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.565088:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a895 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af98a expref: 31 pid: 26216 timeout: 1130 lvb_type: 1 00010000:00010000:1.0:1763334965.565100:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a895 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af98a expref: 31 pid: 26216 timeout: 1130 lvb_type: 1 00010000:00010000:1.0:1763334965.565128:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849a895 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af98a expref: 31 pid: 26216 timeout: 1130 lvb_type: 1 00010000:00010000:0.0:1763334965.565223:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.565227:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.565233:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.565254:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.565286:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334965.565359:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849aa55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa1d expref: 15 pid: 32241 timeout: 1130 lvb_type: 0 00000100:00100000:0.0:1763334965.565369:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694449280:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1128us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334965.565376:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701831936:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334965.565391:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.565402:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.565408:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.565418:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.565425:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.565445:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334965.565592:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2501 00000100:00100000:0.0:1763334965.565629:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2503 00000100:00100000:0.0:1763334965.565640:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694449408:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334965.565655:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334965.565661:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849a952 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d0 expref: 30 pid: 32241 timeout: 1130 lvb_type: 0 00010000:00010000:0.0:1763334965.565673:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849a952 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d0 expref: 30 pid: 32241 timeout: 1130 lvb_type: 0 00010000:00010000:0.0:1763334965.565689:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.565692:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.565696:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.565704:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.565719:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334965.565748:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694449408:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 110us (1780us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334965.565755:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2503 00000100:00100000:3.0:1763334965.565891:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701830400:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14037us (16901us total) trans 21474838344 rc 0/0 00000100:00100000:3.0:1763334965.565900:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4739 00000004:00080000:3.0:1763334965.565950:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa766300/2, rc 0, transno 21474838344 00000100:00100000:3.0:1763334965.565958:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa766300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701830400:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334965.566005:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334965.566055:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.566059:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.566064:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.566074:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.566090:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.566115:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694449536:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1052us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.566127:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2502 00010000:00010000:2.0:1763334965.566152:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.566163:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.566171:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.566180:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.566188:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.566207:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763334965.566470:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694449664 00000100:00100000:1.0:1763334965.566479:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694449664 00010000:00010000:1.0:1763334965.566512:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849aa40 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa0f expref: 29 pid: 32241 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.566531:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2504 00000100:00100000:1.0:1763334965.566539:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694449664:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.566549:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.566552:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849aa40 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa0f expref: 29 pid: 32241 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.566561:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849aa40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa0f expref: 29 pid: 32241 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.566600:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.566603:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.566607:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.566615:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334965.566661:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+34:3290:x1848989701831168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14621us (15124us total) trans 17179871063 rc 0/0 00000100:00100000:2.0:1763334965.566670:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4740 00000100:00100000:2.0:1763334965.566779:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.566802:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694449792 00000100:00100000:2.0:1763334965.566805:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694449792 00010000:00010000:2.0:1763334965.566825:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a93d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9c2 expref: 14 pid: 26564 timeout: 1130 lvb_type: 0 00000100:00100000:2.0:1763334965.566842:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2505 00000100:00100000:2.0:1763334965.566848:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2362:x1848989694449792:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334965.566857:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334965.566861:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a93d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9c2 expref: 14 pid: 26564 timeout: 1130 lvb_type: 0 00010000:00010000:2.0:1763334965.566875:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a93d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9c2 expref: 14 pid: 26564 timeout: 1130 lvb_type: 0 00010000:00010000:2.0:1763334965.566889:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.566891:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.566896:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.566904:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.566918:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334965.566938:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2362:x1848989694449792:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 91us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334965.566946:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2505 00010000:00010000:1.0:1763334965.566990:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.567011:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694449664:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 473us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.567018:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2504 00010000:00010000:1.0:1763334965.567087:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763334965.567095:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567102:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d62400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334965.567107:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567118:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567131:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567139:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ac3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567160:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334965.567164:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567170:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d63600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334965.567173:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567179:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567193:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567200:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ac46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567213:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.567215:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.567217:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.567224:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.567286:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849a952 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9d0 expref: 28 pid: 32241 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.567296:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701832064:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334965.567316:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567324:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567331:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567339:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567354:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.567373:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:2.0:1763334965.568229:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77e300/2, rc 0, transno 17179871063 00000100:00100000:2.0:1763334965.568238:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701831168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334965.568302:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.568332:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.568358:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.568385:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694450048 00000100:00100000:2.0:1763334965.568391:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694450048 00000100:00100000:2.0:1763334965.568426:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694450176 00000100:00100000:2.0:1763334965.568429:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694450176 00000100:00100000:2.0:1763334965.568454:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4746 00000100:00100000:2.0:1763334965.568463:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+15:52274:x1848989694450048:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334965.568484:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.568508:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849ac62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afab7 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334965.568538:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x230:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334965.568566:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.568592:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.568603:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849ac62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afab7 expref: 16 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334965.568611:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3291:x1848989701831296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15760us (15875us total) trans 17179871064 rc 0/0 00010000:00010000:2.0:1763334965.568622:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849ac62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afab7 expref: 16 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334965.568623:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4743 00010000:00010000:2.0:1763334965.568640:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:1.0:1763334965.568652:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4747 00000100:00100000:1.0:1763334965.568662:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694450176:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334965.568670:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.568682:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849ac69 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afabe expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334965.568687:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+16:52274:x1848989694450048:12345-192.168.201.60@tcp:101:bash.0 Request processed in 223us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334965.568700:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4746 00000100:00100000:2.0:1763334965.568745:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7218700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701830912:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334965.568746:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701832448:192.168.201.60@tcp:106: 00010000:00010000:2.0:1763334965.568768:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334965.568819:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee240 going to sleep for 11 seconds 00010000:00010000:1.0:1763334965.568842:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334965.568849:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.568859:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334965.568864:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.568875:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.568964:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.568974:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849ac54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.568994:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.568996:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.568997:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.569025:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849aa40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa0f expref: 27 pid: 32241 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.569049:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701832320:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334965.569065:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.569074:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.569082:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.569093:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.569101:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.569126:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334965.569276:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694449920 00000100:00100000:3.0:1763334965.569282:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694449920 00010000:00010000:3.0:1763334965.569309:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a71b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af913 expref: 17 pid: 26564 timeout: 1130 lvb_type: 0 00000100:00100000:3.0:1763334965.569343:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2506 00000100:00100000:3.0:1763334965.569351:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2362:x1848989694449920:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334965.569364:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334965.569370:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a71b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af913 expref: 17 pid: 26564 timeout: 1130 lvb_type: 0 00010000:00010000:3.0:1763334965.569382:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a71b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af913 expref: 17 pid: 26564 timeout: 1130 lvb_type: 0 00010000:00010000:3.0:1763334965.569401:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849a71b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af913 expref: 17 pid: 26564 timeout: 1130 lvb_type: 0 00010000:00010000:3.0:1763334965.569411:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334965.569413:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334965.569417:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.569425:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.569448:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334965.569489:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2362:x1848989694449920:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 138us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334965.569496:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2506 00000004:00080000:0.0:1763334965.569517:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77dc00/2, rc 0, transno 17179871064 00010000:00010000:3.0:1763334965.569520:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334965.569523:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701831296:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763334965.569528:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.569537:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.569544:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.569560:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1763334965.569705:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763334965.569712:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.569720:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334965.569724:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.569733:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.569745:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.569753:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334965.569757:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.569764:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334965.569767:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.569773:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.569784:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.569786:0:32239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849a93d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833af9c2 expref: 15 pid: 26564 timeout: 1130 lvb_type: 0 00010000:00010000:2.0:1763334965.569798:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ac31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334965.569809:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701831040:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334965.569819:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334965.569822:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334965.569824:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334965.569829:0:32239:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.569839:0:32239:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.569852:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.569865:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.569873:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.569904:0:32239:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334965.569978:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa767b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701830144:12345-0@lo:6:osp-syn-0-0.0 Request processed in 20088us (21161us total) trans 21474838345 rc 0/0 00000100:00100000:3.0:1763334965.569988:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4735 00000004:00080000:3.0:1763334965.570028:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa765c00/2, rc 0, transno 21474838345 00000100:00100000:3.0:1763334965.570035:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa765c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701830144:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334965.570178:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa767800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701830272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19728us (21272us total) trans 21474838346 rc 0/0 00000100:00100000:0.0:1763334965.570185:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4737 00000004:00080000:3.0:1763334965.570287:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa766680/2, rc 0, transno 21474838346 00000100:00100000:3.0:1763334965.570293:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701830272:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763334965.570623:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ac5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334965.570825:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+34:3292:x1848989701831424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16893us (17321us total) trans 17179871065 rc 0/0 00000100:00100000:1.0:1763334965.570833:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4744 00010000:00010000:1.0:1763334965.570876:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334965.570882:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.570889:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334965.570892:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.570900:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.570914:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.570921:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ac38 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.570933:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.570934:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.570936:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334965.571022:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5b01f2e300/2, rc 0, transno 17179871065 00000100:00100000:3.0:1763334965.571028:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701831424:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763334965.571086:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1763334965.572191:0:25383:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x240000400:0x230:0x0] updating lvb mtime: 0 -> 1763334966 00002000:00010000:1.0:1763334965.572202:0:25383:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x230:0x0] updating lvb atime: 0 -> 1763334966 00002000:00010000:1.0:1763334965.572204:0:25383:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x240000400:0x230:0x0] updating lvb ctime: 0 -> 1763334966 00000100:00100000:1.0:1763334965.572232:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701832448:192.168.201.60@tcp:106: 00010000:00010000:1.0:1763334965.572285:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849ac69 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afabe expref: 14 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334965.572314:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849ac69 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afabe expref: 14 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334965.572326:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334965.572402:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694450176:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3740us (4041us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334965.572411:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4747 00000100:00100000:3.0:1763334965.573014:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.573157:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694450304 00000100:00100000:1.0:1763334965.573167:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694450304 00000100:00100000:1.0:1763334965.573291:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4748 00000100:00100000:1.0:1763334965.573305:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+27:52274:x1848989694450304:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334965.573327:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.573356:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849ac70 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afac5 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334965.573380:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x234:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334965.573404:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.573407:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.573419:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849ac70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afac5 expref: 28 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.573443:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849ac70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afac5 expref: 28 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.573454:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334965.573505:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:52274:x1848989694450304:12345-192.168.201.60@tcp:101:bash.0 Request processed in 204us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.574271:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4748 00000100:00100000:2.0:1763334965.578391:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.578494:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694450560 00000100:00100000:3.0:1763334965.578510:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694450560 00000100:00100000:3.0:1763334965.578622:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1709 00000100:00100000:3.0:1763334965.578734:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53024:x1848989694450560:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334965.579979:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.580192:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694450816 00000100:00100000:1.0:1763334965.580202:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694450816 00002000:00010000:1.0:1763334965.580254:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/564 (0->18446744073709551615) 00002000:00100000:1.0:1763334965.580261:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee93e680 with x1848989694450816 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334965.580277:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee93e680. 00000100:00100000:1.0:1763334965.580306:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1730 00000100:00100000:1.0:1763334965.580316:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694450816:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334965.580709:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x234:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334965.580715:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x234:0x0] updating lvb mtime from disk: 0 -> 1763334966 00002000:00010000:1.0:1763334965.580718:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x234:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334965.580720:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x234:0x0] updating lvb ctime from disk: 0 -> 1763334966 00002000:00010000:1.0:1763334965.580722:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x234:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334965.580763:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694450816:12345-192.168.201.60@tcp:10:bash.0 Request processed in 447us (787us total) trans 17179871066 rc 0/0 00000100:00100000:1.0:1763334965.580771:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1730 00002000:00010000:1.0:1763334965.580777:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/564 (0->18446744073709551615) 00002000:00100000:1.0:1763334965.580779:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee93e680 with x1848989694450816 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334965.580785:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee93e680. 00000100:00100000:0.0:1763334965.581193:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.581403:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53024:x1848989694450560:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1138us (1495us total) trans 8589938868 rc 0/0 00000100:00100000:3.0:1763334965.581417:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1709 00000100:00100000:1.0:1763334965.582152:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694450688 00000100:00100000:1.0:1763334965.582164:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694450688 00002000:00010000:1.0:1763334965.582204:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/560 (0->18446744073709551615) 00002000:00100000:1.0:1763334965.582210:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee93df80 with x1848989694450688 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334965.582222:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aee93df80. 00000100:00100000:3.0:1763334965.582851:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.582957:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1731 00000100:00100000:1.0:1763334965.582968:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694450688:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:0.0:1763334965.583429:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694450944 00000100:00100000:0.0:1763334965.583437:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694450944 00000100:00100000:0.0:1763334965.583486:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4641 00000100:00100000:0.0:1763334965.583493:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53024:x1848989694450944:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334965.583511:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.583537:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ac77 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afacc expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.583640:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac7e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583659:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac7e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583673:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac7e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583689:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ac85 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583697:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ac85 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583703:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ac85 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583835:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac8c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583845:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583853:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334965.583894:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x199:0x0]: returning size 2 00000004:00200000:0.0:1763334965.583900:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334965.583921:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583933:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac8c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583942:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac7e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583949:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac7e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583956:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583962:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.583967:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac7e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583975:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac7e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.583988:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.583991:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.583997:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac7e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.584003:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ac7e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.584017:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ac85 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.584023:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ac85 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.584028:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ac85 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.584033:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.584036:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ac85 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.584041:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ac85 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.584048:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60a00) 00010000:00010000:0.0:1763334965.584051:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.584053:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ac85 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.584057:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ac85 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.584105:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ac77 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afacc expref: 184 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.584120:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac8c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afacc expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.584128:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:0.0:1763334965.584131:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334965.584134:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:0.0:1763334965.584226:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53024:x1848989694450944:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 732us (1378us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334965.584235:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4641 00002000:00010000:1.0:1763334965.584687:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x230:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334965.584692:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x230:0x0] updating lvb mtime from disk: 1763334966 -> 1763334966 00002000:00010000:1.0:1763334965.584695:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x230:0x0] updating lvb atime from disk: 1763334966 -> 0 00002000:00010000:1.0:1763334965.584697:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x230:0x0] updating lvb ctime from disk: 1763334966 -> 1763334966 00002000:00010000:1.0:1763334965.584700:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x230:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334965.584746:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694450688:12345-192.168.201.60@tcp:10:bash.0 Request processed in 1778us (3552us total) trans 21474838347 rc 0/0 00000100:00100000:1.0:1763334965.584755:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1731 00002000:00010000:1.0:1763334965.584760:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/560 (0->18446744073709551615) 00002000:00100000:1.0:1763334965.584764:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee93df80 with x1848989694450688 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334965.584772:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aee93df80. 00000100:00100000:3.0:1763334965.597485:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.598437:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694451200 00000100:00100000:0.0:1763334965.598457:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694451200 00000100:00100000:2.0:1763334965.600224:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1710 00000100:00100000:2.0:1763334965.600503:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52274:x1848989694451200:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:2.0:1763334965.603439:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52274:x1848989694451200:12345-192.168.201.60@tcp:35:bash.0 Request processed in 3174us (5948us total) trans 8589938869 rc 0/0 00000100:00100000:2.0:1763334965.603461:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1710 00000100:00100000:0.0:1763334965.613719:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.614801:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694451456 00000100:00100000:3.0:1763334965.614820:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694451456 00000100:00100000:3.0:1763334965.614903:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4642 00000100:00100000:3.0:1763334965.614913:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53026:x1848989694451456:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:3.0:1763334965.614985:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1763334965.615019:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ac8c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afacc expref: 184 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.615047:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7200/0xcedf0054f849ac23 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x199:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afab0 expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.615062:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849abf2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x199:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afaa2 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.615073:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:3.0:1763334965.615085:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334965.615116:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ac93 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.615138:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ac93 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.615148:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ac93 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.615165:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ac9a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.615171:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ac9a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.615177:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ac9a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.615721:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aca1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.615731:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aca1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.615739:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aca1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000040:00080000:2.0:1763334965.619222:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1080, 64 off92616 00000004:00080000:2.0:1763334965.619267:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1030252693831ns, next at 1031252687124ns, rc = 0 00000040:00080000:2.0:1763334965.619329:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1091, 64 off93704 00000004:00080000:2.0:1763334965.619335:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1030252763043ns, next at 1031252761634ns, rc = 0 00000040:00080000:2.0:1763334965.619352:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1092, 64 off93768 00000040:00080000:2.0:1763334965.619367:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1081, 64 off92680 00010000:00010000:2.0:1763334965.619494:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aca8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x199:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619516:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aca8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619528:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aca8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619537:0:29629:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aca8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619544:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aca8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619549:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aca8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619604:0:29629:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334965.619637:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aca1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619643:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aca1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619649:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aca1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619655:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d63600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.619661:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aca1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619669:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aca1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619683:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:2.0:1763334965.619688:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763334965.619693:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aca1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619699:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849aca1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x199:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619783:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ac93 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619789:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ac93 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619794:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ac93 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619803:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d63c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.619805:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ac93 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619810:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ac93 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619818:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.619821:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.619824:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ac93 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.619828:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ac93 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000004:00010000:2.0:1763334965.619838:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d7920d0a reply state 000000007340a190 transno 8589938870 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ac9a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:2.0:1763334965.619846:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334965.620000:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53026:x1848989694451456:12345-192.168.201.60@tcp:36:rm.0 Request processed in 5082us (6292us total) trans 8589938870 rc 0/0 00000100:00100000:2.0:1763334965.620010:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4642 00010000:00010000:1.0:1763334965.620809:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334965.620821:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aca8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334965.620831:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334965.620834:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aca8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334965.620843:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aca8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334965.620857:0:8206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x199:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334965.620860:0:8206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763334965.620864:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aca8 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334965.620870:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849aca8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x199:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334965.620892:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.620894:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.620896:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334965.627437:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ac9a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.627459:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ac9a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.627468:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ac9a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.627474:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d63000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.627481:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ac9a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.627490:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ac9a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.627512:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4800) 00010000:00010000:2.0:1763334965.627515:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.627522:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ac9a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.627529:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ac9a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:0.0:1763334965.628792:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.629449:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694451712 00000100:00100000:2.0:1763334965.629465:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694451712 00000100:00100000:2.0:1763334965.629551:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4643 00000100:00100000:2.0:1763334965.629563:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53025:x1848989694451712:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.629636:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.629666:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849acaf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afad3 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.629773:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acb6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.629790:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acb6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.629803:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acb6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.629818:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849acbd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.629826:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849acbd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.629833:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849acbd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.629918:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acb6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.629927:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acb6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.629935:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acb6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.629942:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.629947:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acb6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.629956:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acb6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.629969:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.629973:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.629978:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acb6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.629984:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acb6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.629999:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849acbd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.630006:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849acbd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.630012:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849acbd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.630017:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.630020:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849acbd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.630025:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849acbd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.632991:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab200) 00010000:00010000:2.0:1763334965.632999:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.633008:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849acbd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.633018:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849acbd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.633111:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849acaf lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afad3 expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.633123:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.633125:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334965.633129:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849acaf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afad3 expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.633139:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:2.0:1763334965.633331:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53025:x1848989694451712:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3767us (4550us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334965.633342:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4643 00000100:00100000:0.0:1763334965.637728:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.637971:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694451840 00000100:00100000:2.0:1763334965.637985:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694451840 00000100:00100000:2.0:1763334965.638059:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4644 00000100:00100000:2.0:1763334965.638071:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53027:x1848989694451840:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.638096:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.638123:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849acc4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afada expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.638216:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849accb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638235:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849accb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638258:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849accb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638276:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acd2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638283:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638290:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638384:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849accb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638392:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849accb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638399:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849accb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638407:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.638412:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849accb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638420:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849accb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638434:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.638438:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.638445:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849accb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638451:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849accb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638465:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acd2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638470:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acd2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638476:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acd2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638481:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.638483:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acd2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638488:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acd2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638493:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab200) 00010000:00010000:2.0:1763334965.638496:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.638499:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acd2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638504:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849acd2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.638538:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849acc4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afada expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.638547:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.638549:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.638552:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849acc4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afada expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.638562:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:2.0:1763334965.638702:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53027:x1848989694451840:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 631us (991us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334965.638710:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4644 00000100:00100000:0.0:1763334965.645197:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.645610:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694451968 00000100:00100000:1.0:1763334965.645627:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694451968 00000100:00100000:1.0:1763334965.645717:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4645 00000100:00100000:1.0:1763334965.645730:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53025:x1848989694451968:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334965.645758:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.645792:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849acd9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afae1 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.646210:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ace0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646230:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ace0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646255:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ace0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646277:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ace7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646290:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ace7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646297:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ace7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646386:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ace0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646400:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ace0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646408:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ace0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646416:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334965.646421:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ace0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646430:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ace0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646443:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334965.646447:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334965.646453:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ace0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646460:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ace0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646477:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ace7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646484:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ace7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646492:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ace7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646497:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334965.646501:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ace7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646506:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ace7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646633:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334965.646636:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334965.646639:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ace7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646645:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849ace7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.646692:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849acd9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afae1 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.646703:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334965.646706:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334965.646709:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849acd9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afae1 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.646719:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334965.646807:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53025:x1848989694451968:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1079us (1626us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334965.646816:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4645 00000100:00100000:0.0:1763334965.654874:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.656022:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694452096 00000100:00100000:1.0:1763334965.656040:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694452096 00000100:00100000:1.0:1763334965.656132:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4646 00000100:00100000:1.0:1763334965.656145:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53027:x1848989694452096:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334965.656177:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.656209:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849acee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afae8 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.656350:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849acf5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656370:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849acf5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656383:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849acf5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656405:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849acfc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656412:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849acfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656419:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849acfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656507:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849acf5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656515:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849acf5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656523:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849acf5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656530:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334965.656535:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849acf5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656543:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849acf5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656557:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334965.656561:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334965.656567:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849acf5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656598:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849acf5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656611:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849acfc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656616:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849acfc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656621:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849acfc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656626:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334965.656629:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849acfc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656634:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849acfc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656641:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334965.656644:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334965.656647:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849acfc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656652:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849acfc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.656688:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849acee lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afae8 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.656700:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334965.656702:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334965.656706:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849acee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afae8 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.656715:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334965.656792:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53027:x1848989694452096:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 650us (1936us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334965.656800:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4646 00000100:00100000:0.0:1763334965.664214:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.664792:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694452224 00000100:00100000:2.0:1763334965.664807:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694452224 00000100:00100000:2.0:1763334965.664883:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4647 00000100:00100000:2.0:1763334965.664895:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53027:x1848989694452224:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.664923:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.664951:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ad03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afaef expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.665507:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ad0a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.665535:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ad0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.665551:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ad0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:2.0:1763334965.665714:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:2.0:1763334965.665721:0:29629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334965.665751:0:29629:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ad0a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.665786:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ad03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afaef expref: 184 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.665809:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ad0a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afaef expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.665820:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.665824:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334965.665828:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:2.0:1763334965.665923:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee93f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53027:x1848989694452224:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1030us (1726us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334965.665932:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4647 00000100:00100000:0.0:1763334965.666399:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.666455:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694452480 00000100:00100000:2.0:1763334965.666463:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694452480 00000100:00100000:1.0:1763334965.667089:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4648 00000100:00100000:1.0:1763334965.667103:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53028:x1848989694452480:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334965.667132:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.667150:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ad11 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afaf6 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.667227:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ad18 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667239:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ad18 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667270:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ad18 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667285:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad1f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667292:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667298:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667362:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ad18 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667368:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ad18 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667375:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ad18 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667381:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334965.667387:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ad18 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667394:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ad18 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667405:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334965.667408:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334965.667412:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ad18 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667419:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ad18 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667434:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667440:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad1f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667446:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667451:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334965.667453:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667458:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad1f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667464:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa200) 00010000:00010000:1.0:1763334965.667466:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334965.667468:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad1f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667474:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad1f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.667502:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ad11 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afaf6 expref: 184 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.667511:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334965.667513:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334965.667516:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ad11 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afaf6 expref: 184 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.667529:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334965.667599:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53028:x1848989694452480:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 501us (1203us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334965.667606:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4648 00000100:00100000:0.0:1763334965.673021:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.673225:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694452736 00000100:00100000:2.0:1763334965.673238:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694452736 00000100:00100000:2.0:1763334965.673370:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4649 00000100:00100000:2.0:1763334965.673382:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53027:x1848989694452736:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.673413:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.673417:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334965.673456:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ad0a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afaef expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.673479:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.673486:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334965.673502:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ad26 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afafd expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.673714:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad2d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.673730:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad2d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.673741:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad2d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.673756:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ad34 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.673763:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ad34 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.673770:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ad34 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.674473:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ad3b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.674485:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ad3b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.674493:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ad3b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:2.0:1763334965.674505:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19a:0x0]: returning size 0 00010000:00010000:2.0:1763334965.674540:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad2d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.674554:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad2d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.674561:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad2d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.674567:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.674600:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad2d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.674609:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad2d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.674618:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.674622:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.674627:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad2d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.674633:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad2d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000004:00010000:2.0:1763334965.674645:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006055e2b7 reply state 00000000acc50c68 transno 8589938871 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ad34 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:2.0:1763334965.674654:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334965.674688:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ad26 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afafd expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.674702:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ad3b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afafd expref: 184 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.674709:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:2.0:1763334965.674711:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334965.674714:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067c00, rc 0) 00000100:00100000:2.0:1763334965.674800:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53027:x1848989694452736:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1420us (1796us total) trans 8589938871 rc 0/0 00000100:00100000:2.0:1763334965.674810:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4649 00010000:00010000:3.0:1763334965.678998:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ad34 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.679023:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ad34 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.679032:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ad34 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.679039:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.679046:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ad34 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.679055:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ad34 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.679079:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab200) 00010000:00010000:3.0:1763334965.679082:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.679088:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ad34 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334965.679095:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ad34 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:0.0:1763334965.681949:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.683222:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694452992 00000100:00100000:1.0:1763334965.683256:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694452992 00000100:00100000:1.0:1763334965.683468:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4650 00000100:00100000:1.0:1763334965.683481:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53027:x1848989694452992:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334965.683515:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.683547:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ad49 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb04 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.683717:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.683736:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ad3b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afafd expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.683746:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.683793:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ad3b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afafd expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.683808:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ad3b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afafd expref: 185 pid: 29629 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.683822:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701832576:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334965.683931:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee240 going to sleep for 11 seconds 00000100:00100000:0.0:1763334965.688294:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.688455:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694453248 00000100:00100000:2.0:1763334965.688470:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694453248 00000100:00100000:2.0:1763334965.688543:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4651 00000100:00100000:2.0:1763334965.688556:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53029:x1848989694453248:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.688645:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.688675:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ad57 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb0b expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.688827:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad5e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.688849:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.688864:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:2.0:1763334965.688878:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19a:0x0]: returning size 0 00010000:00010000:2.0:1763334965.689032:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad5e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.689043:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad5e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.689051:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad5e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.689058:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.689063:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad5e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.689072:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad5e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.689087:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:2.0:1763334965.689090:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334965.689097:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad5e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.689113:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad5e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334965.689171:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ad57 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb0b expref: 188 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.689183:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.689186:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334965.689191:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ad57 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb0b expref: 188 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.689202:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:2.0:1763334965.689293:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53029:x1848989694453248:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 739us (1021us total) trans 8589938872 rc 301/301 00000100:00100000:2.0:1763334965.689304:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4651 00000100:00100000:0.0:1763334965.697116:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.698331:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694453504 00000100:00100000:2.0:1763334965.698350:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694453504 00000100:00100000:2.0:1763334965.698443:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1711 00000100:00100000:2.0:1763334965.698456:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01d11450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53029:x1848989694453504:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334965.699957:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701832576:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334965.699998:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334965.700083:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.700471:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01d11450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53029:x1848989694453504:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 2015us (3370us total) trans 8589938873 rc 0/0 00000100:00100000:2.0:1763334965.700483:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1711 00000100:00100000:1.0:1763334965.701097:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694453632 00000100:00100000:1.0:1763334965.701209:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694453632 00010000:00010000:1.0:1763334965.701272:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ad3b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afafd expref: 188 pid: 29629 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.701322:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2507 00000100:00100000:1.0:1763334965.701334:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:2362:x1848989694453632:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.701355:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.701362:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ad3b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afafd expref: 188 pid: 29629 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.701378:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ad3b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afafd expref: 188 pid: 29629 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.701410:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849ad3b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afafd expref: 188 pid: 29629 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.701431:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:1.0:1763334965.701438:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.701450:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.701465:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.701505:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.701557:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+187:2362:x1848989694453632:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 225us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.701565:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2507 00010000:00010000:0.0:1763334965.701933:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.701944:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334965.701968:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19a:0x0]: returning size 0 00000004:00080000:0.0:1763334965.702455:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x236:0x0], index 1: 0 00000004:00080000:0.0:1763334965.702469:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x232:0x0], index 0: 0 00000004:00080000:0.0:1763334965.702476:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x233:0x0], index 0: 0 00000004:00080000:0.0:1763334965.702481:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x237:0x0], index 1: 0 00010000:00010000:0.0:1763334965.702727:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.702740:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.702747:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.702753:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.702758:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.702766:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.702779:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:0.0:1763334965.702782:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334965.702786:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.702791:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ad50 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.702860:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ad49 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb04 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.702871:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.702873:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334965.702877:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ad49 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb04 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.702884:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:0.0:1763334965.702947:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53027:x1848989694452992:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 19469us (21013us total) trans 8589938874 rc 301/301 00000100:00100000:0.0:1763334965.702956:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4650 00000100:00100000:1.0:1763334965.704530:0:29651:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:29651:1848989701832704:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1763334965.704647:0:29651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334965.704682:0:29651:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee240 going to sleep for 11 seconds 00000100:00100000:2.0:1763334965.704747:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701832704 00000100:00100000:2.0:1763334965.704757:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701832704 00000100:00100000:2.0:1763334965.704830:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4749 00000100:00100000:2.0:1763334965.704840:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:29651:x1848989701832704:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1763334965.704901:0:25383:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 578 00000100:00100000:1.0:1763334965.709666:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.709883:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694453888 00000100:00100000:3.0:1763334965.709899:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694453888 00000100:00100000:3.0:1763334965.709976:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4652 00000100:00100000:3.0:1763334965.709989:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53029:x1848989694453888:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334965.710024:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334965.710054:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ad73 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb12 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.710172:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ad7a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710192:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ad7a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710206:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ad7a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710222:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ad81 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710229:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ad81 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710235:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ad81 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710456:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ad88 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710466:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ad88 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710475:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ad88 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334965.710588:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:29651:x1848989701832704:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5733us (5924us total) trans 21474838348 rc 0/0 00000100:00100000:2.0:1763334965.710602:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4749 00010000:00010000:3.0:1763334965.710653:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ad7a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710662:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ad7a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710669:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ad7a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710675:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d63000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.710681:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ad7a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710688:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ad7a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710701:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334965.710705:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.710711:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ad7a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710717:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ad7a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710732:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ad81 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710738:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ad81 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710742:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ad81 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710747:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d63c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.710750:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ad81 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710754:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ad81 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710760:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4800) 00010000:00010000:3.0:1763334965.710763:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.710765:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ad81 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710770:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ad81 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334965.710819:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ad73 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb12 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.710834:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ad88 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb12 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.710842:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:3.0:1763334965.710845:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334965.710848:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac7d63600, rc 0) 00000100:00100000:3.0:1763334965.710918:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53029:x1848989694453888:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 932us (1271us total) trans 8589938875 rc 0/0 00000100:00100000:3.0:1763334965.710925:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4652 00000100:00100000:1.0:1763334965.711316:0:29651:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:29651:1848989701832704:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1763334965.711334:0:29651:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x233:0x0]-[0x240000400:0x261:0x0] 00000100:00100000:2.0:1763334965.712224:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.712423:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694454144 00000100:00100000:3.0:1763334965.712433:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694454144 00000100:00100000:3.0:1763334965.712529:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1712 00000100:00100000:3.0:1763334965.712541:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53027:x1848989694454144:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334965.713945:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53027:x1848989694454144:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1393us (1715us total) trans 8589938876 rc 0/0 00000100:00100000:3.0:1763334965.713961:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1712 00000100:00100000:2.0:1763334965.720370:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.720482:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694454400 00000100:00100000:3.0:1763334965.720497:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694454400 00000100:00100000:1.0:1763334965.721491:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.721723:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1713 00000100:00100000:2.0:1763334965.721746:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53027:x1848989694454400:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334965.722110:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53027:x1848989694454400:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 372us (1756us total) trans 8589938877 rc 0/0 00000100:00100000:2.0:1763334965.722120:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1713 00000100:00100000:3.0:1763334965.722280:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694454528 00000100:00100000:3.0:1763334965.722290:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694454528 00000100:00100000:3.0:1763334965.722342:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4750 00000100:00100000:3.0:1763334965.722353:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694454528:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334965.722367:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334965.722397:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ad96 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb19 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334965.722430:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x236:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334965.722454:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334965.722458:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334965.722473:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ad96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb19 expref: 30 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334965.722493:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ad96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb19 expref: 30 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334965.722508:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac7d62400, rc 0) 00000100:00100000:3.0:1763334965.722534:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694454528:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 184us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334965.722540:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4750 00000100:00100000:2.0:1763334965.727009:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.727380:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694454784 00000100:00100000:3.0:1763334965.727397:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694454784 00000100:00100000:2.0:1763334965.728501:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4653 00000100:00100000:2.0:1763334965.728525:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52274:x1848989694454784:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334965.728562:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.728615:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad9d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb20 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.728771:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.728792:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ad88 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb12 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.728804:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.728860:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ad88 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb12 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.728878:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ad88 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb12 expref: 191 pid: 32232 timeout: 1130 lvb_type: 0 00000100:00100000:2.0:1763334965.728894:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac721a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701832832:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334965.729037:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1480 going to sleep for 11 seconds 00000100:00100000:1.0:1763334965.731465:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.732819:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694455040 00000100:00100000:0.0:1763334965.732840:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694455040 00000100:00100000:0.0:1763334965.732921:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1714 00000100:00100000:0.0:1763334965.732934:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53029:x1848989694455040:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334965.733421:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53029:x1848989694455040:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 487us (1971us total) trans 8589938878 rc 0/0 00000100:00100000:0.0:1763334965.733431:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1714 00000100:00100000:2.0:1763334965.736225:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac721a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701832832:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334965.736287:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334965.738966:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.739196:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.739798:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694455424 00000100:00100000:2.0:1763334965.739813:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694455424 00000100:00100000:0.0:1763334965.740015:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694455168 00000100:00100000:0.0:1763334965.740022:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694455168 00010000:00010000:0.0:1763334965.740060:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ad88 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb12 expref: 194 pid: 32232 timeout: 1130 lvb_type: 0 00000100:00100000:2.0:1763334965.740146:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4654 00000100:00100000:2.0:1763334965.740160:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53029:x1848989694455424:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.740184:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.740211:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849adab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb27 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334965.740453:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2508 00000100:00100000:0.0:1763334965.740461:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2359:x1848989694455168:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334965.740478:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334965.740485:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ad88 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb12 expref: 195 pid: 32232 timeout: 1130 lvb_type: 0 00010000:00010000:0.0:1763334965.740501:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ad88 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb12 expref: 195 pid: 32232 timeout: 1130 lvb_type: 0 00010000:00010000:0.0:1763334965.740525:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac7d63600/0xcedf0054f849ad88 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb12 expref: 195 pid: 32232 timeout: 1130 lvb_type: 0 00010000:00010000:0.0:1763334965.740543:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:0.0:1763334965.740550:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.740562:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.740709:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849adb2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.740723:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849adb2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.740734:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849adb2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.740749:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adb9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.740756:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adb9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.740762:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adb9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.740921:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849adc0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.741053:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.741322:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849adc0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741331:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849adc0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334965.741344:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19a:0x0]: returning size 0 00010000:00010000:2.0:1763334965.741479:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849adb2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741487:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849adb2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741495:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849adb2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741502:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.741506:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849adb2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741513:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849adb2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741522:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.741525:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.741529:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849adb2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741536:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849adb2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741546:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adb9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741551:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adb9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741557:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adb9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741562:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.741565:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adb9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741597:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adb9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741604:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab700) 00010000:00010000:2.0:1763334965.741607:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.741610:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adb9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741616:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adb9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.741663:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849adab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb27 expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.741676:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849adc0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb27 expref: 195 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.741683:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:2.0:1763334965.741686:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763334965.741688:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:2.0:1763334965.741769:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53029:x1848989694455424:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1613us (2573us total) trans 8589938879 rc 0/0 00000100:00100000:2.0:1763334965.741778:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4654 00010000:00010000:0.0:1763334965.742801:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.743036:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2359:x1848989694455168:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 2570us (4080us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.743049:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2508 00010000:00010000:2.0:1763334965.743873:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.743892:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334965.743919:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19a:0x0]: returning size 0 00010000:00010000:2.0:1763334965.744321:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ad9d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb20 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.744349:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb20 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.744359:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:2.0:1763334965.744363:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334965.744368:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:2.0:1763334965.744441:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:52274:x1848989694454784:12345-192.168.201.60@tcp:101:bash.0 Request processed in 15928us (17447us total) trans 8589938880 rc 0/0 00000100:00100000:2.0:1763334965.744450:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4653 00000100:00100000:2.0:1763334965.747488:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.748215:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694455552 00000100:00100000:3.0:1763334965.748234:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694455552 00000100:00100000:3.0:1763334965.748325:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1715 00000100:00100000:3.0:1763334965.748339:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53029:x1848989694455552:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:3.0:1763334965.748633:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53029:x1848989694455552:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 297us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334965.748643:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1715 00000100:00100000:1.0:1763334965.751620:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.752421:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694455808 00000100:00100000:0.0:1763334965.752437:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694455808 00000100:00100000:0.0:1763334965.752511:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1716 00000100:00100000:0.0:1763334965.752521:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:52274:x1848989694455808:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:0.0:1763334965.752887:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52274:x1848989694455808:12345-192.168.201.60@tcp:35:bash.0 Request processed in 366us (1282us total) trans 8589938881 rc 0/0 00000100:00100000:0.0:1763334965.752895:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1716 00000100:00100000:2.0:1763334965.756958:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.757710:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694456064 00000100:00100000:1.0:1763334965.757728:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694456064 00000100:00100000:1.0:1763334965.757813:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4655 00000100:00100000:1.0:1763334965.757826:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52274:x1848989694456064:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1763334965.757915:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.757956:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849adc0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb27 expref: 195 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.757979:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334965.757986:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334965.758363:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849add5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.758383:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849add5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.758397:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849add5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:1.0:1763334965.758468:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938882 00000004:00010000:1.0:1763334965.758495:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bfe716dc reply state 0000000099c182cb transno 8589938883 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849add5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334965.758505:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334965.758685:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:52274:x1848989694456064:12345-192.168.201.60@tcp:36:bash.0 Request processed in 860us (1740us total) trans 8589938883 rc 0/0 00000100:00100000:1.0:1763334965.758694:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4655 00000020:00080000:1.0:1763334965.758701:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1763334965.762131:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849add5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.762153:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849add5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.762162:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849add5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.762168:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.762174:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849add5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.762184:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849add5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.762209:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:0.0:1763334965.762213:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.762219:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849add5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.762226:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849add5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334965.767195:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.767269:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694456192 00000100:00100000:0.0:1763334965.767285:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694456192 00000100:00100000:0.0:1763334965.767372:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4656 00000100:00100000:0.0:1763334965.767386:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:52274:x1848989694456192:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334965.767427:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.767460:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849addc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb2e expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.767544:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849addc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb2e expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.767563:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849addc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb2e expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.767637:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:0.0:1763334965.767642:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334965.767646:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334965.767731:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:52274:x1848989694456192:12345-192.168.201.60@tcp:101:bash.0 Request processed in 346us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334965.767740:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4656 00000100:00100000:2.0:1763334965.769792:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.770089:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694456448 00000100:00100000:0.0:1763334965.770100:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694456448 00000100:00100000:0.0:1763334965.770171:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4657 00000100:00100000:0.0:1763334965.770182:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:52274:x1848989694456448:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334965.770207:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.770211:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334965.770259:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849addc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb2e expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.770281:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:0.0:1763334965.770286:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334965.770302:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ade3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb35 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.770363:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849adea lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.770377:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849adea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.770387:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849adea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:0.0:1763334965.770881:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1093, 88 off93856 00000004:00080000:0.0:1763334965.770892:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1030404319192ns, next at 1031252761634ns, rc = 0 00000040:00080000:0.0:1763334965.770937:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1082, 88 off92768 00000004:00080000:0.0:1763334965.770943:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1030404371130ns, next at 1031252687124ns, rc = 0 00000040:00080000:0.0:1763334965.770975:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1083, 88 off92856 00000004:00080000:0.0:1763334965.770981:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1030404409554ns, next at 1031252687124ns, rc = 0 00000040:00080000:0.0:1763334965.771025:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1094, 88 off93944 00000004:00080000:0.0:1763334965.771032:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1030404460430ns, next at 1031252761634ns, rc = 0 00000100:00100000:2.0:1763334965.781100:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.782482:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694456704 00000100:00100000:2.0:1763334965.782500:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694456704 00000100:00100000:2.0:1763334965.782584:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4658 00000100:00100000:2.0:1763334965.782597:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53030:x1848989694456704:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.782625:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.782652:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849adf1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb3c expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.782754:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849adf8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.782772:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849adf8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.782786:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849adf8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.782800:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.782806:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.782811:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783039:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ae06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783050:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ae06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783058:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ae06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334965.783070:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19a:0x0]: returning size 2 00010000:00010000:2.0:1763334965.783318:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ae06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783327:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ae06 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783335:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ae06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783341:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.783346:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ae06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783355:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ae06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783369:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:2.0:1763334965.783373:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:2.0:1763334965.783379:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ae06 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783386:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ae06 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783404:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849adf8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783411:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849adf8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783416:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849adf8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783422:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.783424:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849adf8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783430:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849adf8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783438:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.783439:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.783443:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849adf8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783448:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849adf8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783457:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783463:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adff lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783468:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783473:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334965.783476:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783482:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783488:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab700) 00010000:00010000:2.0:1763334965.783491:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334965.783494:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adff lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783499:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849adff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.783545:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849adf1 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb3c expref: 201 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.783557:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334965.783560:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334965.783563:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849adf1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb3c expref: 201 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.783611:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:2.0:1763334965.783706:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53030:x1848989694456704:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1111us (2621us total) trans 8589938885 rc 301/301 00000100:00100000:2.0:1763334965.783714:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4658 00000100:00100000:2.0:1763334965.789703:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.789757:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694456832 00000100:00100000:2.0:1763334965.789770:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694456832 00000100:00100000:2.0:1763334965.789842:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4659 00000100:00100000:2.0:1763334965.789853:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53030:x1848989694456832:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334965.789881:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.789909:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ae14 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb43 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.790032:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.790050:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb20 expref: 201 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.790058:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849adea lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.790066:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 5/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.790088:0:30972:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849adea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334965.790120:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb20 expref: 201 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.790136:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb20 expref: 201 pid: 30972 timeout: 1130 lvb_type: 0 00000100:00100000:2.0:1763334965.790152:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af59f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701832960:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334965.790268:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334965.793696:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af59f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701832960:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334965.793742:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334965.797751:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.797806:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694456960 00000100:00100000:1.0:1763334965.797818:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694456960 00010000:00010000:1.0:1763334965.797870:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb20 expref: 202 pid: 30972 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.797917:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2509 00000100:00100000:1.0:1763334965.797929:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+202:2359:x1848989694456960:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.797952:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.797959:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb20 expref: 202 pid: 30972 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.797974:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb20 expref: 202 pid: 30972 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.798002:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ada4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb20 expref: 202 pid: 30972 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.798020:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334965.798025:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.798034:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.798040:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.798047:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.798111:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+201:2359:x1848989694456960:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 184us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.798119:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2509 00000001:00080000:3.0:1763334965.849194:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938884 is committed 00000004:00080000:3.0:1763334965.849215:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 721 committed 00000004:00080000:3.0:1763334965.849227:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 709 committed 00000004:00080000:3.0:1763334965.849245:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 708 committed 00000004:00080000:3.0:1763334965.849251:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 720 committed 00000100:00100000:3.0:1763334965.849569:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701833088:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334965.849691:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334965.849743:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334965.849750:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701833472:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334965.849772:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334965.849808:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701833216:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334965.849831:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334965.849851:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763334965.849857:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701833344:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334965.849878:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334965.849924:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701833088 00000100:00100000:3.0:1763334965.849933:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701833088 00000100:00100000:3.0:1763334965.849987:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701833472 00000100:00100000:3.0:1763334965.849991:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701833472 00000100:00100000:3.0:1763334965.850009:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701833216 00000100:00100000:3.0:1763334965.850011:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701833216 00000100:00100000:3.0:1763334965.850030:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701833344 00000100:00100000:3.0:1763334965.850033:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701833344 00000100:00100000:3.0:1763334965.850059:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4751 00000100:00100000:3.0:1763334965.850069:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+37:3292:x1848989701833088:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334965.850087:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4752 00000100:00100000:0.0:1763334965.850101:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3292:x1848989701833472:12345-0@lo:2:osp-syn-1-0.0 00002000:00080000:3.0:1763334965.850102:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:564 count 1 00010000:00010000:3.0:1763334965.850149:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.850174:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849ac70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afac5 expref: 29 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.850183:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334965.850185:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334965.850190:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.850231:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849ac70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afac5 expref: 29 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.850258:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849ac70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afac5 expref: 29 pid: 25383 timeout: 1130 lvb_type: 0 00000100:00100000:3.0:1763334965.850270:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701833600:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334965.850351:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa806cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334965.850371:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4753 00000100:00100000:3.0:1763334965.850380:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3289:x1848989701833216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334965.850393:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:565 count 1 00010000:00010000:3.0:1763334965.850406:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.850425:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849aba5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa7f expref: 29 pid: 26216 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1763334965.850429:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3292:x1848989701833472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 330us (652us total) trans 17179871067 rc 0/0 00010000:00010000:3.0:1763334965.850439:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334965.850442:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1763334965.850446:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4752 00010000:00010000:3.0:1763334965.850447:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.850468:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849aba5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa7f expref: 29 pid: 26216 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1763334965.850473:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4754 00000100:00100000:0.0:1763334965.850485:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+37:3289:x1848989701833344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334965.850619:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334965.850623:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763334965.850625:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334965.850627:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763334965.850630:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334965.850662:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+38:3289:x1848989701833344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 179us (782us total) trans 17179871068 rc 0/0 00000100:00100000:0.0:1763334965.850668:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4754 00000004:00080000:0.0:1763334965.850767:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa7ef480/2, rc 0, transno 17179871067 00000100:00100000:0.0:1763334965.850775:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701833472:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334965.850965:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 719 committed 00000004:00080000:0.0:1763334965.850975:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 707 committed 00000004:00080000:0.0:1763334965.851003:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeefe7800/2, rc 0, transno 17179871068 00000100:00100000:0.0:1763334965.851009:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701833344:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334965.851108:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701833984:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334965.851146:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334965.851168:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763334965.851174:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701834112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334965.851196:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334965.851223:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701833984 00000100:00100000:0.0:1763334965.851228:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701833984 00000100:00100000:0.0:1763334965.851285:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701834112 00000100:00100000:0.0:1763334965.851288:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701834112 00000100:00100000:0.0:1763334965.851308:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4755 00000100:00100000:0.0:1763334965.851315:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3289:x1848989701833984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334965.851333:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:561 count 1 00010000:00010000:0.0:1763334965.851354:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.851371:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849abac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa86 expref: 13 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334965.851379:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.851381:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334965.851384:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.851409:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849abac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa86 expref: 13 pid: 32241 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1763334965.851411:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4756 00010000:00010000:0.0:1763334965.851424:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849abac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa86 expref: 13 pid: 32241 timeout: 1130 lvb_type: 1 00000100:00100000:2.0:1763334965.851428:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3289:x1848989701834112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334965.851443:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701834368:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334965.851500:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c1e48840 going to sleep for 11 seconds 00000100:00100000:0.0:1763334965.851525:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701833856:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334965.851556:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334965.851601:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763334965.851609:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701834240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334965.851635:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334965.851663:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701833856 00000100:00100000:0.0:1763334965.851668:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701833856 00000100:00100000:0.0:1763334965.851695:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701834240 00000100:00100000:0.0:1763334965.851698:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701834240 00000100:00100000:2.0:1763334965.851715:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3289:x1848989701834112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 291us (516us total) trans 21474838349 rc 0/0 00000100:00100000:2.0:1763334965.851724:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4756 00000100:00100000:0.0:1763334965.851731:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4757 00000100:00100000:0.0:1763334965.851741:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3292:x1848989701833856:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334965.851746:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4758 00000100:00100000:2.0:1763334965.851756:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3292:x1848989701834240:12345-0@lo:2:osp-syn-0-0.0 00002000:00080000:0.0:1763334965.851757:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:560 count 1 00010000:00010000:0.0:1763334965.851776:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.851791:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849ac62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afab7 expref: 13 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.851797:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334965.851799:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334965.851802:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.851826:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849ac62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afab7 expref: 13 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.851835:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849ac62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afab7 expref: 13 pid: 26564 timeout: 1130 lvb_type: 0 00000100:00100000:0.0:1763334965.851850:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701834496:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334965.851877:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3292:x1848989701834240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (238us total) trans 21474838350 rc 0/0 00000100:00100000:2.0:1763334965.851884:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4758 00000100:00100000:0.0:1763334965.851885:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c1e48900 going to sleep for 11 seconds 00000004:00080000:0.0:1763334965.851927:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afc8c0a80/2, rc 0, transno 21474838349 00000100:00100000:0.0:1763334965.851933:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701834112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334965.851950:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afc8c0700/2, rc 0, transno 21474838350 00000100:00100000:0.0:1763334965.851954:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701834240:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1763334965.852283:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849adea lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb35 expref: 183 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.852298:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334965.852301:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334965.852306:0:32232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.852317:0:32232:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.852323:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.852371:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ade3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb35 expref: 183 pid: 32232 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763334965.852393:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849adea lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb35 expref: 182 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.852428:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:1.0:1763334965.854134:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52274:x1848989694456448:12345-192.168.201.60@tcp:101:bash.0 Request processed in 83938us (84335us total) trans 8589938884 rc 0/0 00000100:00100000:1.0:1763334965.854151:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4657 00010000:00010000:2.0:1763334965.854617:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.854633:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334965.854693:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19a:0x0]: returning size 2 00000004:00200000:2.0:1763334965.854699:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334965.854725:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334965.854774:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ae14 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb43 expref: 182 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.854799:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb43 expref: 181 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.854810:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:2.0:1763334965.854813:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334965.854818:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066c00, rc 0) 00000100:00100000:2.0:1763334965.854888:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53030:x1848989694456832:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 65036us (65201us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334965.854897:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4659 00010000:00010000:3.0:1763334965.855496:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849aba5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa7f expref: 29 pid: 26216 timeout: 1130 lvb_type: 1 00000100:00100000:3.0:1763334965.855525:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701833728:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334965.855949:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.856032:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694457088 00000100:00100000:1.0:1763334965.856043:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694457088 00010000:00010000:1.0:1763334965.856083:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849ac70 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afac5 expref: 30 pid: 25383 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.856126:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2510 00000100:00100000:1.0:1763334965.856135:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694457088:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.856152:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.856158:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849ac70 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afac5 expref: 30 pid: 25383 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.856177:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849ac70 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afac5 expref: 30 pid: 25383 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.856205:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.856207:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.856213:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.856224:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.856256:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.856299:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694457088:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 165us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.856306:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2510 00000100:00100000:0.0:1763334965.856506:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa8066c0 going to sleep for 11 seconds 00010000:00010000:3.0:1763334965.856694:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849ac70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afac5 expref: 29 pid: 25383 timeout: 1130 lvb_type: 0 00000100:00100000:3.0:1763334965.856710:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701833600:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334965.856733:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.856744:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.856752:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.856763:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.856770:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.856799:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334965.857203:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3292:x1848989701833088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7134us (7512us total) trans 17179871069 rc 0/0 00000100:00100000:3.0:1763334965.857214:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4751 00000004:00080000:3.0:1763334965.857285:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeefe4700/2, rc 0, transno 17179871069 00000100:00100000:3.0:1763334965.857294:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701833088:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334965.857648:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.857669:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694457344 00000100:00100000:3.0:1763334965.857675:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694457344 00000100:00100000:1.0:1763334965.858151:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.858182:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694457216 00000100:00100000:1.0:1763334965.858187:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694457216 00010000:00010000:1.0:1763334965.858224:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849abac lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa86 expref: 14 pid: 32241 timeout: 1130 lvb_type: 1 00000100:00100000:1.0:1763334965.858294:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2511 00000100:00100000:1.0:1763334965.858305:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694457216:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.858322:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.858328:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849abac lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x231:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa86 expref: 14 pid: 32241 timeout: 1130 lvb_type: 1 00010000:00010000:1.0:1763334965.858348:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849abac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x231:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa86 expref: 14 pid: 32241 timeout: 1130 lvb_type: 1 00010000:00010000:1.0:1763334965.858378:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.858381:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.858386:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.858397:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.858422:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.858482:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694457216:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 179us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.858492:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2511 00010000:00010000:0.0:1763334965.858847:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334965.858858:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.858868:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d63c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334965.858874:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.858885:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.858901:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.858910:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63c00/0xcedf0054f849ae22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.858935:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334965.858938:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334965.858940:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334965.858981:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701834496:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334965.859004:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.859037:0:7819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849abac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x231:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa86 expref: 13 pid: 32241 timeout: 1130 lvb_type: 1 00000100:00100000:0.0:1763334965.859048:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8c3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701834368:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334965.859062:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.859071:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.859079:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.859089:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.859098:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.859131:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334965.859522:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334965.859530:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.859540:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334965.859544:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.859553:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.859566:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.859608:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ae30 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.859629:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334965.859631:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334965.859633:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334965.859848:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb344450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3289:x1848989701833984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8529us (8697us total) trans 21474838351 rc 0/0 00000100:00100000:0.0:1763334965.859860:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4755 00000004:00080000:2.0:1763334965.859953:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afc8e8000/2, rc 0, transno 21474838351 00000100:00100000:2.0:1763334965.859961:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701833984:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334965.860402:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4759 00000100:00100000:3.0:1763334965.860415:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+29:52274:x1848989694457344:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334965.860436:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334965.860471:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb4a expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.860506:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ad96 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb19 expref: 30 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334965.860515:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334965.860517:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334965.860522:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 30 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334965.860566:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ad96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb19 expref: 30 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334965.860603:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ad96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb19 expref: 30 pid: 25383 timeout: 1130 lvb_type: 1 00000100:00100000:3.0:1763334965.860619:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701834624:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334965.860713:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa8069c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334965.860770:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.860866:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.860891:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694457728 00000100:00100000:3.0:1763334965.860898:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694457728 00000100:00100000:3.0:1763334965.861010:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1717 00000100:00100000:3.0:1763334965.861018:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01d10c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53030:x1848989694457728:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334965.861327:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01d10c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53030:x1848989694457728:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 308us (460us total) trans 8589938886 rc 0/0 00000100:00100000:3.0:1763334965.861336:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1717 00000100:00100000:3.0:1763334965.861483:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.861524:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701833728:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334965.861543:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334965.861672:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694457472 00000100:00100000:1.0:1763334965.861678:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694457472 00010000:00010000:1.0:1763334965.861707:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849ac62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afab7 expref: 13 pid: 26564 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.861733:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694457856 00000100:00100000:1.0:1763334965.861736:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694457856 00010000:00010000:1.0:1763334965.861750:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849aba5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa7f expref: 31 pid: 26216 timeout: 1130 lvb_type: 1 00000100:00100000:1.0:1763334965.861773:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2512 00000100:00100000:1.0:1763334965.861780:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694457472:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.861793:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.861798:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849ac62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afab7 expref: 13 pid: 26564 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.861809:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849ac62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afab7 expref: 13 pid: 26564 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.861833:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849ac62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x230:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afab7 expref: 13 pid: 26564 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.861846:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.861849:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.861854:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.861864:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.861890:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.861919:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694457472:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 139us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.861927:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2512 00000100:00100000:1.0:1763334965.861943:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2513 00000100:00100000:1.0:1763334965.861950:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694457856:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.861958:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.861962:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849aba5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa7f expref: 31 pid: 26216 timeout: 1130 lvb_type: 1 00010000:00010000:1.0:1763334965.861978:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849aba5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa7f expref: 31 pid: 26216 timeout: 1130 lvb_type: 1 00010000:00010000:1.0:1763334965.861993:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849aba5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x235:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afa7f expref: 31 pid: 26216 timeout: 1130 lvb_type: 1 00010000:00010000:1.0:1763334965.862003:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.862005:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.862008:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862016:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862034:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.862053:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694457856:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 104us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.862061:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2513 00010000:00010000:1.0:1763334965.862110:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862120:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862130:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862143:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862164:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334965.862434:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3292:x1848989701833856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10695us (10876us total) trans 21474838352 rc 0/0 00000100:00100000:1.0:1763334965.862442:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4757 00010000:00010000:1.0:1763334965.862465:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334965.862471:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862478:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334965.862483:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862491:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862501:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862507:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849ae37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862530:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.862532:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.862534:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763334965.862696:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afc8eb100/2, rc 0, transno 21474838352 00000100:00100000:1.0:1763334965.862704:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701833856:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763334965.862724:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862733:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862741:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862749:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862765:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334965.862775:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334965.862780:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862787:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac7d63000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334965.862791:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862798:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862810:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862818:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d63000/0xcedf0054f849ae29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.862832:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.862834:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334965.862836:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334965.863011:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+38:3289:x1848989701833216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12632us (13178us total) trans 17179871070 rc 0/0 00000100:00100000:1.0:1763334965.863019:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4753 00000004:00080000:1.0:1763334965.863168:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeefe4e00/2, rc 0, transno 17179871070 00000100:00100000:1.0:1763334965.863175:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701833216:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334965.867025:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701834624:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334965.867074:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 29 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.867099:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac7d62800, rc 0) 00000100:00100000:2.0:1763334965.868033:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+29:52274:x1848989694457344:12345-192.168.201.60@tcp:101:bash.0 Request processed in 7612us (10378us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334965.868045:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4759 00000100:00100000:0.0:1763334965.869739:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.869935:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.869995:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694457984 00000100:00100000:1.0:1763334965.870009:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694457984 00010000:00010000:1.0:1763334965.870059:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ad96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb19 expref: 29 pid: 25383 timeout: 1130 lvb_type: 1 00000100:00100000:2.0:1763334965.870234:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694458112 00000100:00100000:2.0:1763334965.870247:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694458112 00000100:00100000:0.0:1763334965.870416:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4660 00000100:00100000:0.0:1763334965.870429:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53030:x1848989694458112:12345-192.168.201.60@tcp:101:lfs.0 00000100:00100000:1.0:1763334965.870513:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2514 00000100:00100000:1.0:1763334965.870523:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2361:x1848989694457984:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.870548:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.870555:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ad96 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb19 expref: 29 pid: 25383 timeout: 1130 lvb_type: 1 00010000:00010000:1.0:1763334965.870614:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ad96 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb19 expref: 29 pid: 25383 timeout: 1130 lvb_type: 1 00010000:00010000:1.0:1763334965.870653:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62400/0xcedf0054f849ad96 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb19 expref: 29 pid: 25383 timeout: 1130 lvb_type: 1 00010000:00010000:1.0:1763334965.870680:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.870682:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.870692:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 28 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.870702:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 28 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.870754:0:5734:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 28 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334965.870772:0:5734:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701834752:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334965.870874:0:5734:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1763334965.870984:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.871010:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849ae45 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb51 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.871099:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ae4c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871115:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ae4c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871126:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ae4c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871141:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae53 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871148:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871154:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871492:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ae5a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871503:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ae5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871512:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ae5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334965.871553:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19a:0x0]: returning size 2 00000004:00200000:0.0:1763334965.871558:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334965.871609:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ae5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871621:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ae5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871631:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ae4c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871638:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ae4c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871645:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ae4c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871652:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.871655:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ae4c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871663:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ae4c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871673:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.871676:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.871681:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ae4c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871688:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849ae4c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871700:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871706:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae53 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871712:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae53 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871716:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.871720:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae53 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871726:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae53 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871732:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60d00) 00010000:00010000:0.0:1763334965.871735:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.871738:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae53 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871743:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae53 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.871780:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849ae45 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb51 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.871793:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ae5a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb51 expref: 183 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.871800:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:0.0:1763334965.871803:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334965.871806:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334965.871869:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53030:x1848989694458112:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1443us (1934us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334965.871879:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4660 00000100:00100000:0.0:1763334965.879110:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.879343:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694458240 00000100:00100000:2.0:1763334965.879356:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694458240 00000100:00100000:2.0:1763334965.879435:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4760 00000100:00100000:2.0:1763334965.879449:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+12:52274:x1848989694458240:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334965.879473:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334965.879502:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ae61 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb58 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334965.879541:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x232:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334965.879611:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.879615:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334965.879626:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ae61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb58 expref: 13 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.879648:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ae61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb58 expref: 13 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334965.879665:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:2.0:1763334965.879742:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:52274:x1848989694458240:12345-192.168.201.60@tcp:101:bash.0 Request processed in 296us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334965.879751:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4760 00000100:00100000:1.0:1763334965.880233:0:5734:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701834752:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334965.880278:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.880340:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2361:x1848989694457984:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 9807us (10600us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.880351:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2514 00000100:00100000:0.0:1763334965.888983:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.889884:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334965.890208:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694458496 00000100:00100000:2.0:1763334965.890222:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694458496 00002000:00010000:2.0:1763334965.890291:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/562 (0->18446744073709551615) 00002000:00100000:2.0:1763334965.890297:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec5a680 with x1848989694458496 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334965.890314:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeec5a680. 00000100:00100000:2.0:1763334965.890641:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694458368 00000100:00100000:2.0:1763334965.890646:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694458368 00002000:00010000:2.0:1763334965.890663:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/566 (0->18446744073709551615) 00002000:00100000:2.0:1763334965.890667:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec5b480 with x1848989694458368 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334965.890675:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeec5b480. 00000100:00100000:1.0:1763334965.890803:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1732 00000100:00100000:1.0:1763334965.890819:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2359:x1848989694458496:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:3.0:1763334965.891109:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1733 00000100:00100000:3.0:1763334965.891121:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694458368:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334965.891465:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334965.891470:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb mtime from disk: 0 -> 1763334966 00002000:00010000:3.0:1763334965.891473:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334965.891475:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb ctime from disk: 0 -> 1763334966 00002000:00010000:3.0:1763334965.891477:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334965.891591:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694458368:12345-192.168.201.60@tcp:10:bash.0 Request processed in 454us (1696us total) trans 17179871071 rc 0/0 00000100:00100000:3.0:1763334965.891600:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1733 00002000:00010000:1.0:1763334965.891602:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334965.891605:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/566 (0->18446744073709551615) 00002000:00010000:1.0:1763334965.891605:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb mtime from disk: 0 -> 1763334966 00002000:00010000:1.0:1763334965.891608:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb atime from disk: 0 -> 0 00002000:00100000:3.0:1763334965.891609:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec5b480 with x1848989694458368 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334965.891610:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb ctime from disk: 0 -> 1763334966 00002000:00010000:1.0:1763334965.891612:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:3.0:1763334965.891614:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeec5b480. 00000100:00100000:1.0:1763334965.891637:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694458496:12345-192.168.201.60@tcp:10:bash.0 Request processed in 824us (2672us total) trans 21474838353 rc 0/0 00000100:00100000:1.0:1763334965.891644:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1732 00002000:00010000:1.0:1763334965.891648:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/562 (0->18446744073709551615) 00002000:00100000:1.0:1763334965.891650:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec5a680 with x1848989694458496 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334965.891655:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeec5a680. 00000100:00100000:2.0:1763334965.902760:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334965.902906:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694458752 00000100:00100000:3.0:1763334965.902923:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694458752 00000100:00100000:0.0:1763334965.903143:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1718 00000100:00100000:0.0:1763334965.903160:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52274:x1848989694458752:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:0.0:1763334965.905268:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52274:x1848989694458752:12345-192.168.201.60@tcp:35:bash.0 Request processed in 2095us (2508us total) trans 8589938887 rc 0/0 00000100:00100000:0.0:1763334965.905285:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1718 00000100:00100000:2.0:1763334965.907291:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.908219:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694459008 00000100:00100000:1.0:1763334965.908248:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694459008 00000100:00100000:1.0:1763334965.908338:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4661 00000100:00100000:1.0:1763334965.908350:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53031:x1848989694459008:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334965.908378:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.908407:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ae68 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb5f expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.908547:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849ae6f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.908567:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849ae6f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.908611:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849ae6f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334965.908627:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19a:0x0]: returning size 5 00010000:00010000:1.0:1763334965.908807:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ae68 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb5f expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.908832:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849ae6f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb5f expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.908841:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334965.908845:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763334965.908849:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334965.908924:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53031:x1848989694459008:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 576us (1647us total) trans 8589938888 rc 0/0 00000100:00100000:1.0:1763334965.908931:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4661 00000100:00100000:1.0:1763334965.914808:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.914895:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694459264 00000100:00100000:0.0:1763334965.914910:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694459264 00000100:00100000:0.0:1763334965.914985:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4662 00000100:00100000:0.0:1763334965.914997:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53031:x1848989694459264:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334965.915043:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.915072:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849ae7d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb66 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.915261:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.915282:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb43 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.915291:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ae5a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb51 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.915302:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.915352:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ae5a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb51 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.915370:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ae5a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb51 expref: 187 pid: 30972 timeout: 1130 lvb_type: 0 00000100:00100000:0.0:1763334965.915391:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701834880:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334965.915518:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb43 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.915528:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb43 expref: 187 pid: 30972 timeout: 1130 lvb_type: 0 00000100:00100000:0.0:1763334965.915538:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701835008:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334965.915568:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c1e48f00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334965.922762:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.922852:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694459520 00000100:00100000:0.0:1763334965.922869:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694459520 00010000:00010000:1.0:1763334965.922941:0:30972:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.60@tcp) returned -22 from blocking AST (req@000000000a4754ce x1848989701834880) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ae5a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb51 expref: 188 pid: 30972 timeout: 1130 lvb_type: 0 00000100:00100000:0.0:1763334965.922961:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1719 00010000:00010000:1.0:1763334965.922969:0:30972:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ae5a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb51 expref: 188 pid: 30972 timeout: 1130 lvb_type: 0 00000100:00100000:0.0:1763334965.922974:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53032:x1848989694459520:12345-192.168.201.60@tcp:35:rm.0 00010000:00010000:1.0:1763334965.923004:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ae5a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb51 expref: 188 pid: 30972 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.923022:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec5aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701834880:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334965.923036:0:30972:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.60@tcp) returned -22 from blocking AST (req@00000000c9eebcb9 x1848989701835008) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb43 expref: 187 pid: 30972 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.923047:0:30972:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb43 expref: 187 pid: 30972 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.923063:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849ae1b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb43 expref: 187 pid: 30972 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.923071:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701835008:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334965.923112:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334965.923118:0:30972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.923128:0:30972:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.923136:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.923162:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.923171:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.923176:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334965.923195:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19a:0x0]: returning size 5 00000100:00100000:0.0:1763334965.923334:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53032:x1848989694459520:12345-192.168.201.60@tcp:35:rm.0 Request processed in 361us (589us total) trans 8589938889 rc 0/0 00000100:00100000:0.0:1763334965.923343:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1719 00010000:00010000:1.0:1763334965.924709:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849ae7d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb66 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.924743:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb66 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.924760:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334965.924763:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334965.924767:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:1.0:1763334965.924841:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53031:x1848989694459264:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 9845us (10048us total) trans 8589938890 rc 0/0 00000100:00100000:1.0:1763334965.924850:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4662 00000100:00100000:2.0:1763334965.928491:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.928613:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694459776 00000100:00100000:1.0:1763334965.928629:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694459776 00000100:00100000:1.0:1763334965.928716:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4663 00000100:00100000:1.0:1763334965.928730:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53032:x1848989694459776:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:1.0:1763334965.928811:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1763334965.928817:0:30972:0:(ldlm_lockd.c:1753:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie cedf0054f849ae5a) 00010000:00010000:1.0:1763334965.928819:0:30972:0:(ldlm_lockd.c:1753:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie cedf0054f849ae1b) 00010000:00010000:1.0:1763334965.928854:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849ae6f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb5f expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.928883:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849adea lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb35 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.928895:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334965.928901:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334965.928941:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ae92 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.928958:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ae92 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.928973:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ae92 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.928991:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849ae99 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.928998:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849ae99 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.929003:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849ae99 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.929202:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.929214:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb66 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.929224:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.929281:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb66 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.929299:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb66 expref: 185 pid: 30972 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.929320:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701835136:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334965.929449:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334965.929711:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.929746:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694459904 00000100:00100000:1.0:1763334965.929755:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694459904 00000100:00100000:1.0:1763334965.929811:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4664 00000100:00100000:1.0:1763334965.929821:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53031:x1848989694459904:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334965.929842:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.929855:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849aea7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb6d expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.929934:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.929944:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.929951:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 4/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.929963:0:32232:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.929975:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334965.939513:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701835136:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334965.939558:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334965.941184:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.941878:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694460032 00000100:00100000:1.0:1763334965.941893:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694460032 00010000:00010000:1.0:1763334965.941951:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb66 expref: 188 pid: 30972 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.942139:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2515 00000100:00100000:1.0:1763334965.942151:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:2360:x1848989694460032:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.942173:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334965.942181:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb66 expref: 188 pid: 30972 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.942196:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb66 expref: 188 pid: 30972 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.942224:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849ae84 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x19a:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb66 expref: 188 pid: 30972 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.942257:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334965.942263:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.942276:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.942284:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40290400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.942292:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.942298:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.942304:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.943003:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334965.943104:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.943195:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+187:2360:x1848989694460032:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1041us (2018us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.943210:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2515 00010000:00010000:0.0:1763334965.943272:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00000004:00080000:0.0:1763334965.943995:0:30972:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x19a:0x0] is inserted into orphan list, open count = 1 00010000:00010000:0.0:1763334965.944203:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.944213:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.944221:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.944227:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.944232:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.944252:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.944269:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:0.0:1763334965.944272:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763334965.944276:0:30972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x13/0x8 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.944285:0:30972:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.944291:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334965.944322:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.944334:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849aea0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.944356:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ae92 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.944363:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ae92 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.944370:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ae92 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.944375:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.944378:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ae92 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.944384:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ae92 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.944394:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.944397:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.944400:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ae92 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.944405:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ae92 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334965.944415:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e10fca5c reply state 000000004ba65d24 transno 8589938891 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849ae99 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334965.944425:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334965.944524:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53032:x1848989694459776:12345-192.168.201.60@tcp:36:rm.0 Request processed in 15795us (16048us total) trans 8589938891 rc 0/0 00000100:00100000:0.0:1763334965.944537:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4663 00010000:00010000:1.0:1763334965.945483:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.945497:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334965.945538:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19a:0x0]: returning size 5 00000004:00200000:1.0:1763334965.945543:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334965.945564:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.945639:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849aea7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb6d expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.945658:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb6d expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.945666:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334965.945668:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334965.945671:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334965.945728:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53031:x1848989694459904:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 15909us (16018us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.945737:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4664 00010000:00010000:3.0:1763334965.950129:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849ae99 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.950155:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849ae99 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.950165:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849ae99 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.950173:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334965.950178:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849ae99 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.950188:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849ae99 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.950211:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa200) 00010000:00010000:3.0:1763334965.950215:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334965.950222:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849ae99 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334965.950229:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849ae99 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334965.954491:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.954870:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694460288 00000100:00100000:1.0:1763334965.954887:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694460288 00000100:00100000:1.0:1763334965.954970:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4665 00000100:00100000:1.0:1763334965.954983:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53031:x1848989694460288:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334965.955026:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.955060:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aeb5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb74 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.955210:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849aebc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.955228:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849aebc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.955250:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849aebc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334965.955266:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19a:0x0]: returning size 5 00010000:00010000:1.0:1763334965.955423:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849aeb5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb74 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.955446:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849aebc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb74 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.955457:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334965.955460:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334965.955465:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334965.955550:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53031:x1848989694460288:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 569us (1076us total) trans 8589938892 rc 0/0 00000100:00100000:1.0:1763334965.955558:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4665 00000100:00100000:2.0:1763334965.964008:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.964136:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694460416 00000100:00100000:0.0:1763334965.964151:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694460416 00000100:00100000:0.0:1763334965.964274:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4761 00000100:00100000:0.0:1763334965.964289:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694460416:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:0.0:1763334965.964361:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.964386:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 29 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.964395:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334965.964398:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334965.964402:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 4/0,1 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.964451:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 29 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.964467:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 29 pid: 21625 timeout: 1130 lvb_type: 0 00000100:00100000:0.0:1763334965.964673:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701835264:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334965.965346:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c1e48900 going to sleep for 11 seconds 00000100:00100000:2.0:1763334965.969490:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.969682:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694460544 00000100:00100000:1.0:1763334965.969697:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694460544 00000100:00100000:0.0:1763334965.969762:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec58380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701835264:192.168.201.60@tcp:104: 00002000:00100000:1.0:1763334965.969774:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x236:0x0] (0->4) req@ffff9a5ae8d4ed80 x1848989694460544/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:11/0 lens 496/0 e 0 to 0 dl 1763334976 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334965.969788:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ae8d4ed80 with x1848989694460544 ext(0->4) 00010000:00010000:1.0:1763334965.969802:0:14183:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 30 pid: 21625 timeout: 1130 lvb_type: 0 00010000:00010000:0.0:1763334965.969802:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.969835:0:14183:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 30 pid: 21625 timeout: 1130 lvb_type: 0 00002000:00010000:1.0:1763334965.969844:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a5ae8d4ed80 00000100:00100000:1.0:1763334965.970562:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 69 00000100:00100000:1.0:1763334965.970609:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694460544:12345-192.168.201.60@tcp:4:bash.0 00000100:00100000:0.0:1763334965.973331:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2360:x1848989694460544:12345-192.168.201.60@tcp:4:bash.0 Request processed in 2741us (3840us total) trans 17179871072 rc 0/0 00000100:00100000:0.0:1763334965.973352:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 69 00002000:00100000:0.0:1763334965.973372:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x236:0x0] (0->4) req@ffff9a5ae8d4ed80 x1848989694460544/t17179871072(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:11/0 lens 496/448 e 0 to 0 dl 1763334976 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334965.973385:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ae8d4ed80 with x1848989694460544 ext(0->4) 00010000:00010000:0.0:1763334965.973398:0:14183:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 32 pid: 21625 timeout: 1130 lvb_type: 0 00010000:00010000:0.0:1763334965.973422:0:14183:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 32 pid: 21625 timeout: 1130 lvb_type: 0 00002000:00010000:0.0:1763334965.973432:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a5ae8d4ed80 00000100:00100000:3.0:1763334965.976900:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.977106:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694460672 00000100:00100000:0.0:1763334965.977120:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694460672 00000100:00100000:0.0:1763334965.977202:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4666 00000100:00100000:0.0:1763334965.977214:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53033:x1848989694460672:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334965.977603:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.977635:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849aed1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb7b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.977730:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849aed8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977749:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849aed8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977763:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849aed8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977781:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849aedf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977788:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849aedf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977794:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849aedf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977887:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849aed8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977895:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849aed8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977902:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849aed8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977908:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.977913:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849aed8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977921:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849aed8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977934:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.977937:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.977942:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849aed8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977949:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849aed8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977964:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849aedf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977970:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849aedf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977975:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849aedf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977981:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.977983:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849aedf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977988:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849aedf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.977995:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60d00) 00010000:00010000:0.0:1763334965.977998:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.978000:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849aedf lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.978005:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849aedf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.978043:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849aed1 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb7b expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.978054:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.978057:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.978060:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849aed1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb7b expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.978075:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334965.978167:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53033:x1848989694460672:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 954us (1280us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334965.978175:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4666 00000100:00100000:3.0:1763334965.978483:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.978951:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694460800 00000100:00100000:1.0:1763334965.978964:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694460800 00010000:00010000:1.0:1763334965.979001:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 32 pid: 21625 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334965.979033:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2516 00000100:00100000:1.0:1763334965.979042:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2362:x1848989694460800:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334965.979057:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763334965.979079:0:5734:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb size from disk: 0 -> 5 00010000:00010000:1.0:1763334965.979085:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 32 pid: 21625 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.979097:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 32 pid: 21625 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.979117:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac7d62800/0xcedf0054f849ae3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb4a expref: 32 pid: 21625 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334965.979138:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.979141:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334965.979146:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.979157:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.979191:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334965.979246:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2362:x1848989694460800:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 196us (755us total) trans 0 rc 0/0 00010000:00010000:0.0:1763334965.980461:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.980478:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.980522:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.980531:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.980541:0:7819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.980552:0:7819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334965.980556:0:7819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334965.980558:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2516 00010000:00010000:0.0:1763334965.980590:0:7819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.980616:0:7819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 2/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.980625:0:7819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849aeca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334965.980724:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694460416:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 16438us (16729us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334965.980732:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4761 00000100:00100000:2.0:1763334965.982755:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.982897:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694460928 00000100:00100000:0.0:1763334965.982911:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694460928 00000100:00100000:0.0:1763334965.982983:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4667 00000100:00100000:0.0:1763334965.982993:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53033:x1848989694460928:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334965.983018:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334965.983179:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849aee6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb82 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.983294:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aeed lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983312:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aeed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983326:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aeed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983343:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849aef4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983355:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849aef4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983361:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849aef4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983461:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aeed lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983469:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aeed lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983476:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aeed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983483:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.983487:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aeed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983495:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aeed lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983508:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.983512:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.983519:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aeed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983524:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849aeed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983541:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849aef4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983546:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849aef4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983551:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849aef4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983556:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334965.983559:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849aef4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983564:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849aef4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983655:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60a00) 00010000:00010000:0.0:1763334965.983658:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.983662:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849aef4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983668:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849aef4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.983711:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849aee6 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb82 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.983726:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334965.983728:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334965.983732:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849aee6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb82 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.983743:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334965.983833:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53033:x1848989694460928:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 840us (1091us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334965.983843:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4667 00000100:00100000:3.0:1763334965.984675:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334965.984800:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694461184 00000100:00100000:0.0:1763334965.984813:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694461184 00000100:00100000:0.0:1763334965.985031:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4668 00000100:00100000:0.0:1763334965.985043:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53031:x1848989694461184:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334965.985114:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334965.985143:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849aeae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb6d expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334965.985161:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:0.0:1763334965.985166:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334965.985205:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aefb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.985220:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aefb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334965.985229:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aefb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:0.0:1763334965.985796:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1095, 88 off94032 00000004:00080000:0.0:1763334965.985807:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1030619233811ns, next at 1031252761634ns, rc = 0 00000040:00080000:0.0:1763334965.985878:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1084, 88 off92944 00000004:00080000:0.0:1763334965.985883:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1030619311363ns, next at 1031252687124ns, rc = 0 00000040:00080000:0.0:1763334965.985913:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1085, 88 off93032 00000004:00080000:0.0:1763334965.985917:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1030619345291ns, next at 1031252687124ns, rc = 0 00000040:00080000:0.0:1763334965.985932:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1096, 88 off94120 00000004:00080000:0.0:1763334965.985937:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1030619364737ns, next at 1031252761634ns, rc = 0 00000100:00100000:2.0:1763334965.989278:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334965.990423:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694461312 00000100:00100000:1.0:1763334965.990442:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694461312 00000100:00100000:1.0:1763334965.990543:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4669 00000100:00100000:1.0:1763334965.990555:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53033:x1848989694461312:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334965.990597:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334965.995730:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849af02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb89 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.995849:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849af09 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.995865:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849af09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.995878:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849af09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334965.995970:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:1.0:1763334965.995974:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334965.995997:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849af09 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334965.996030:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849af02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb89 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.996059:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849af09 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb89 expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334965.996075:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334965.996078:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763334965.996083:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334965.996172:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53033:x1848989694461312:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5618us (6908us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334965.996183:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4669 00000100:00100000:3.0:1763334966.004669:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.004751:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694461440 00000100:00100000:0.0:1763334966.004765:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694461440 00000100:00080000:3.0:1763334966.004828:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1763334966.004866:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4670 00000100:00100000:0.0:1763334966.004881:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53033:x1848989694461440:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334966.004910:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.004939:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849af10 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb90 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.005025:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849af17 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006348:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849af17 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006366:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849af17 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006390:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849af1e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006398:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849af1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006404:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849af1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006603:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849af17 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006612:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849af17 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006620:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849af17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006627:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334966.006632:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849af17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006642:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849af17 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006655:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334966.006659:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.006664:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849af17 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006671:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849af17 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006682:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849af1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006688:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849af1e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006694:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849af1e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006699:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334966.006702:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849af1e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006708:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849af1e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006715:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60a00) 00010000:00010000:0.0:1763334966.006718:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.006720:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849af1e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006726:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849af1e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.006777:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849af10 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb90 expref: 191 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.006789:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334966.006791:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.006795:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849af10 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb90 expref: 191 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.006806:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334966.006906:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53033:x1848989694461440:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2026us (2249us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334966.006915:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4670 00000100:00100000:2.0:1763334966.014435:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.014548:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694461696 00000100:00100000:0.0:1763334966.014564:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694461696 00000100:00100000:0.0:1763334966.014841:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4671 00000100:00100000:0.0:1763334966.014854:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53033:x1848989694461696:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334966.014882:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.014886:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334966.014922:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849af09 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb89 expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.014947:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334966.014954:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334966.014972:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849af25 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb97 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.015231:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849af2c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.015260:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849af2c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.015271:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849af2c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.015287:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849af33 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.015293:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849af33 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.015299:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849af33 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.016113:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af3a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.016126:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.016135:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334966.016147:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19b:0x0]: returning size 0 00010000:00010000:0.0:1763334966.016180:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849af2c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.016188:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849af2c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.016196:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849af2c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.016206:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334966.016211:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849af2c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.016219:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849af2c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.016229:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334966.016232:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.016251:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849af2c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.016258:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849af2c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:0.0:1763334966.016271:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007fd6a2f7 reply state 00000000243b4838 transno 8589938894 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849af33 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334966.016281:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763334966.016318:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849af25 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb97 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.016334:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af3a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb97 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.016341:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ac7d60100) 00010000:00010000:0.0:1763334966.016344:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334966.016347:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:0.0:1763334966.016468:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53033:x1848989694461696:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1615us (2049us total) trans 8589938894 rc 0/0 00000100:00100000:0.0:1763334966.016482:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4671 00000100:00100000:1.0:1763334966.023824:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.023870:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694461952 00000100:00100000:1.0:1763334966.023883:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694461952 00000100:00100000:1.0:1763334966.023947:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4672 00000100:00100000:1.0:1763334966.023959:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53033:x1848989694461952:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334966.023986:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.024014:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849af48 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afb9e expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.024477:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849af33 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.024490:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849af33 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.024498:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849af33 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.024505:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334966.024510:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849af33 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.024519:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849af33 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.024539:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60d00) 00010000:00010000:0.0:1763334966.024542:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.024549:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849af33 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.024556:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849af33 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.024774:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.024791:0:29629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af3a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb97 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.024801:0:29629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 4/0,1 mode: --/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.024840:0:29629:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af3a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb97 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.024856:0:29629:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af3a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb97 expref: 192 pid: 32232 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334966.024871:0:29629:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701835392:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334966.024976:0:29629:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee300 going to sleep for 11 seconds 00000100:00100000:2.0:1763334966.031344:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.031945:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694462080 00000100:00100000:1.0:1763334966.031961:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694462080 00010000:00010000:1.0:1763334966.032011:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af3a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb97 expref: 193 pid: 32232 timeout: 1130 lvb_type: 0 00000100:00100000:1.0:1763334966.032064:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2517 00000100:00100000:1.0:1763334966.032076:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2359:x1848989694462080:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334966.032098:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334966.032106:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af3a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb97 expref: 193 pid: 32232 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334966.032121:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af3a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb97 expref: 193 pid: 32232 timeout: 1130 lvb_type: 0 00010000:00010000:1.0:1763334966.032155:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ac7d60100) 00010000:00010000:1.0:1763334966.032161:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.032172:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.032181:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.032207:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334966.032289:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2359:x1848989694462080:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 213us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.032296:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2517 00010000:00010000:0.0:1763334966.032562:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af3a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb97 expref: 192 pid: 32232 timeout: 1130 lvb_type: 0 00000100:00100000:0.0:1763334966.032601:0:29629:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701835392:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334966.032626:0:29629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.032640:0:29629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.032646:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:0.0:1763334966.032667:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19b:0x0]: returning size 0 00000004:00080000:0.0:1763334966.033024:0:29629:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x234:0x0], index 0: 0 00000004:00080000:0.0:1763334966.033033:0:29629:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x238:0x0], index 1: 0 00000004:00080000:0.0:1763334966.033038:0:29629:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x239:0x0], index 1: 0 00000004:00080000:0.0:1763334966.033044:0:29629:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x235:0x0], index 0: 0 00010000:00010000:0.0:1763334966.033230:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.033251:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.033259:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.033266:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334966.033271:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.033280:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.033293:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ac7d60100) 00010000:00010000:0.0:1763334966.033296:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334966.033300:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.033310:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849af4f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.033372:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849af48 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb9e expref: 192 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.033382:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334966.033384:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334966.033388:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849af48 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb9e expref: 192 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.033396:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:0.0:1763334966.033447:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53033:x1848989694461952:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 9491us (9640us total) trans 8589938895 rc 301/301 00000100:00100000:0.0:1763334966.033455:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4672 00000100:00100000:2.0:1763334966.037358:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.037431:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694462336 00000100:00100000:0.0:1763334966.037444:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694462336 00000100:00100000:0.0:1763334966.037504:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1720 00000100:00100000:0.0:1763334966.037515:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53033:x1848989694462336:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334966.037928:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53033:x1848989694462336:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 414us (584us total) trans 8589938896 rc 0/0 00000100:00100000:0.0:1763334966.037936:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1720 00000100:00100000:0.0:1763334966.044017:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.044901:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694462592 00000100:00100000:3.0:1763334966.044918:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694462592 00000100:00100000:3.0:1763334966.044999:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1721 00000100:00100000:3.0:1763334966.045012:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53033:x1848989694462592:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334966.045353:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53033:x1848989694462592:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 343us (1351us total) trans 8589938897 rc 0/0 00000100:00100000:3.0:1763334966.045362:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1721 00000100:00100000:0.0:1763334966.050853:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.050939:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694462848 00000100:00100000:2.0:1763334966.050955:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694462848 00000100:00100000:2.0:1763334966.051026:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4673 00000100:00100000:2.0:1763334966.051037:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52274:x1848989694462848:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334966.051062:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.051089:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849af5d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afba5 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.051317:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af64 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051336:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af64 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051350:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af64 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051365:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849af6b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051372:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849af6b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051379:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849af6b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051465:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849af72 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051474:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849af72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051481:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849af72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:2.0:1763334966.051493:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19b:0x0]: returning size 0 00010000:00010000:2.0:1763334966.051673:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af64 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051681:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af64 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051688:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af64 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051695:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.051699:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af64 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051708:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af64 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051723:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.051726:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.051731:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af64 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051738:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af64 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051757:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849af6b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051763:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849af6b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051768:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849af6b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051773:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.051776:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849af6b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051782:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849af6b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051790:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab900) 00010000:00010000:2.0:1763334966.051793:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.051795:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849af6b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051801:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849af6b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.051848:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849af5d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afba5 expref: 196 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.051863:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849af72 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afba5 expref: 195 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.051870:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ac6cab700) 00010000:00010000:2.0:1763334966.051873:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334966.051877:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067c00, rc 0) 00000100:00100000:2.0:1763334966.051953:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52274:x1848989694462848:12345-192.168.201.60@tcp:101:bash.0 Request processed in 917us (1117us total) trans 8589938898 rc 0/0 00000100:00100000:2.0:1763334966.051961:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4673 00000100:00100000:0.0:1763334966.056627:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.056674:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694463104 00000100:00100000:0.0:1763334966.056688:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694463104 00000100:00100000:0.0:1763334966.056755:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4674 00000100:00100000:0.0:1763334966.056768:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52274:x1848989694463104:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:0.0:1763334966.056838:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334966.056873:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849af72 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afba5 expref: 195 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.056895:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ac6cab700) 00010000:00010000:0.0:1763334966.056908:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334966.057224:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af80 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.057258:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af80 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.057270:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af80 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:0.0:1763334966.057335:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938899 00000004:00010000:0.0:1763334966.057361:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000040745290 reply state 0000000022734585 transno 8589938900 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af80 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334966.057371:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334966.057481:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:52274:x1848989694463104:12345-192.168.201.60@tcp:36:bash.0 Request processed in 715us (869us total) trans 8589938900 rc 0/0 00000100:00100000:0.0:1763334966.057490:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4674 00000020:00080000:0.0:1763334966.057496:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763334966.063003:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af80 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.063028:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af80 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.063038:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af80 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.063045:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.063051:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af80 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.063061:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af80 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.063093:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ac7d60100) 00010000:00010000:3.0:1763334966.063097:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.063104:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af80 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.063112:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849af80 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334966.063702:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.064134:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694463232 00000100:00100000:1.0:1763334966.064149:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694463232 00000100:00100000:1.0:1763334966.064231:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4675 00000001:00080000:0.0:1763334966.064790:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938893 is committed 00000004:00080000:0.0:1763334966.064799:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 723 committed 00000004:00080000:0.0:1763334966.064810:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 711 committed 00000004:00080000:0.0:1763334966.064818:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 710 committed 00000004:00080000:0.0:1763334966.064821:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 722 committed 00000100:00100000:1.0:1763334966.065079:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694463232:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334966.065106:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.065134:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849af87 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afbac expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.065213:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849af87 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbac expref: 188 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.065228:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849af87 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbac expref: 188 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.065268:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334966.065272:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334966.065276:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334966.065357:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694463232:12345-192.168.201.60@tcp:101:bash.0 Request processed in 292us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.066049:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4675 00000100:00100000:1.0:1763334966.066088:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701835520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334966.066164:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.066689:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701835776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.066738:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701835904:0@lo:2:osp-syn-0-0.0 00000004:00010000:0.0:1763334966.066797:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000da02e79d reply state 0000000028b8a60c transno 8589938893 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aefb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334966.066811:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1763334966.066903:0:30972:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763334966.066929:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53031:x1848989694461184:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 81887us (82260us total) trans 8589938893 rc 0/0 00000100:00100000:0.0:1763334966.066937:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4668 00000100:00100000:0.0:1763334966.067157:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701835648:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763334966.067285:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aefb lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.067296:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aefb lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.067304:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aefb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.067311:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.067317:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aefb lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.067326:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aefb lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.067345:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:3.0:1763334966.067349:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334966.067353:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aefb lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.067359:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849aefb lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334966.068160:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334966.068685:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334966.070244:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701835520 00000100:00100000:2.0:1763334966.070264:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701835520 00000100:00100000:2.0:1763334966.070356:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701835776 00000100:00100000:2.0:1763334966.070359:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701835776 00000100:00100000:2.0:1763334966.070395:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4762 00000100:00100000:2.0:1763334966.070407:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+38:3292:x1848989701835520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334966.070800:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+39:3292:x1848989701835520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 394us (4635us total) trans 17179871073 rc 0/0 00000100:00100000:2.0:1763334966.070809:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4762 00000100:00100000:2.0:1763334966.070830:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4763 00000100:00100000:2.0:1763334966.070838:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+22:3290:x1848989701835776:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334966.070958:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334966.070963:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb mtime from disk: 1763334966 -> 1763334966 00002000:00010000:2.0:1763334966.070966:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334966.070968:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb ctime from disk: 1763334966 -> 1763334966 00002000:00010000:2.0:1763334966.070971:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334966.071007:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3290:x1848989701835776:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (2853us total) trans 21474838354 rc 0/0 00000100:00100000:2.0:1763334966.071014:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4763 00000100:00080000:2.0:1763334966.071046:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1763334966.071052:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763334966.071690:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000004:00080000:0.0:1763334966.071802:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f3480/2, rc 0, transno 17179871073 00000100:00100000:0.0:1763334966.071811:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701835520:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334966.071852:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4e680/2, rc 0, transno 21474838354 00000100:00100000:0.0:1763334966.071857:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701835776:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.073596:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.073670:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701835904 00000100:00100000:0.0:1763334966.073684:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701835904 00000100:00100000:0.0:1763334966.073737:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701835648 00000100:00100000:0.0:1763334966.073740:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701835648 00000100:00100000:0.0:1763334966.073767:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4764 00000100:00100000:0.0:1763334966.073779:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3291:x1848989701835904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.074112:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3291:x1848989701835904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 334us (5427us total) trans 21474838355 rc 0/0 00000100:00100000:0.0:1763334966.074125:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4764 00000100:00100000:0.0:1763334966.074147:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4765 00000100:00100000:0.0:1763334966.074154:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+39:3289:x1848989701835648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.074296:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6452680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+40:3289:x1848989701835648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 142us (729us total) trans 17179871074 rc 0/0 00000100:00100000:0.0:1763334966.074303:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4765 00000004:00080000:0.0:1763334966.074355:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f0380/2, rc 0, transno 17179871074 00000100:00100000:0.0:1763334966.074363:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701835648:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334966.074385:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4f480/2, rc 0, transno 21474838355 00000100:00100000:0.0:1763334966.074389:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701835904:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334966.074536:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.074734:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694463360 00000100:00100000:2.0:1763334966.074742:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694463360 00000100:00100000:2.0:1763334966.074782:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694463616 00000100:00100000:2.0:1763334966.074784:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694463616 00000100:00100000:2.0:1763334966.074807:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4676 00000100:00100000:2.0:1763334966.074814:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53031:x1848989694463360:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334966.074834:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.074855:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849af8e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afbb3 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.074923:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849af8e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbb3 expref: 189 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.074941:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849af8e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbb3 expref: 189 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.074964:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:2.0:1763334966.074968:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334966.074974:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:2.0:1763334966.075030:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53031:x1848989694463360:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 216us (3345us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.075037:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4676 00000100:00100000:2.0:1763334966.075052:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4677 00000100:00100000:2.0:1763334966.075059:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694463616:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334966.075067:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.075070:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334966.075094:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849af87 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbac expref: 188 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.075112:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:2.0:1763334966.075121:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334966.075131:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849af95 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afbba expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.075171:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af9c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.075180:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af9c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.075189:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af9c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000040:00080000:2.0:1763334966.075682:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1086, 88 off93120 00000004:00080000:2.0:1763334966.075696:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1030709123418ns, next at 1031252687124ns, rc = 0 00000040:00080000:2.0:1763334966.075950:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1097, 88 off94208 00000004:00080000:2.0:1763334966.075958:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1030709386068ns, next at 1031252761634ns, rc = 0 00000040:00080000:2.0:1763334966.076010:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1098, 88 off94296 00000004:00080000:2.0:1763334966.076015:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1030709443633ns, next at 1031252761634ns, rc = 0 00000040:00080000:2.0:1763334966.076037:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1087, 88 off93208 00000004:00080000:2.0:1763334966.076041:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1030709468878ns, next at 1031252687124ns, rc = 0 00000100:00100000:0.0:1763334966.082847:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.083089:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694463744 00000100:00100000:2.0:1763334966.083104:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694463744 00000100:00100000:2.0:1763334966.083174:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4678 00000100:00100000:2.0:1763334966.083185:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53031:x1848989694463744:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334966.083213:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.083254:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849afa3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afbc1 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.083353:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849afaa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.083372:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849afaa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.083385:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849afaa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334966.083433:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19a:0x0]: returning size 5 00000004:00200000:2.0:1763334966.083438:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334966.083461:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849afaa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.083494:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849afa3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbc1 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.083515:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849afaa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbc1 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.083525:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:2.0:1763334966.083528:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763334966.083533:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:2.0:1763334966.083651:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6450e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53031:x1848989694463744:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 468us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.083659:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4678 00000100:00100000:0.0:1763334966.087254:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.087296:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694463872 00000100:00100000:3.0:1763334966.087309:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694463872 00000100:00100000:3.0:1763334966.087397:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4766 00000100:00100000:3.0:1763334966.087409:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694463872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.087433:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.087461:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849afb1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afbc8 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334966.087495:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x236:0x0] initial LVB size: 5, mtime: 0x691a5b36, atime: 0x0, ctime: 0x691a5b36, blocks: 0x1 00010000:00010000:3.0:1763334966.087521:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.087524:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.087537:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849afb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbc8 expref: 31 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334966.087557:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849afb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbc8 expref: 31 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334966.087602:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7c00, rc 0) 00000100:00100000:3.0:1763334966.087680:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6450a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2359:x1848989694463872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 273us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334966.087689:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4766 00000100:00080000:0.0:1763334966.087813:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1763334966.119418:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1763334966.125124:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938900 is committed 00000001:00080000:1.0:1763334966.125168:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938901 is committed 00000004:00080000:1.0:1763334966.125174:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 713 committed 00000004:00080000:1.0:1763334966.125183:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 725 committed 00000004:00080000:1.0:1763334966.125191:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 724 committed 00000004:00080000:1.0:1763334966.125193:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 712 committed 00010000:00010000:2.0:1763334966.125405:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af9c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbba expref: 183 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.125424:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:2.0:1763334966.125428:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334966.125452:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849af95 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbba expref: 183 pid: 29629 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763334966.125474:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af9c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19b:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbba expref: 182 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.125527:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:2.0:1763334966.125529:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334966.125532:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:2.0:1763334966.126131:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52274:x1848989694463616:12345-192.168.201.60@tcp:101:bash.0 Request processed in 51066us (51593us total) trans 8589938901 rc 0/0 00000100:00100000:2.0:1763334966.126142:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4677 00000100:00100000:0.0:1763334966.126531:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701836032:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.126631:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.126686:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763334966.126693:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701836416:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.126724:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.126760:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701836160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.126782:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.126801:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763334966.126806:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701836288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.126826:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.126908:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701836032 00000100:00100000:0.0:1763334966.126917:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701836032 00000100:00100000:0.0:1763334966.126965:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701836416 00000100:00100000:0.0:1763334966.126968:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701836416 00000100:00100000:0.0:1763334966.126986:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701836160 00000100:00100000:0.0:1763334966.126988:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701836160 00000100:00100000:0.0:1763334966.127003:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701836288 00000100:00100000:0.0:1763334966.127006:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701836288 00000100:00100000:0.0:1763334966.127025:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4767 00000100:00100000:0.0:1763334966.127034:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3292:x1848989701836032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.127349:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3292:x1848989701836032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 315us (717us total) trans 21474838356 rc 0/0 00000100:00100000:0.0:1763334966.127358:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4767 00000100:00100000:0.0:1763334966.127377:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4768 00000100:00100000:0.0:1763334966.127384:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3292:x1848989701836416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.127525:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6450700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3292:x1848989701836416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 141us (800us total) trans 17179871075 rc 0/0 00000100:00100000:0.0:1763334966.127531:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4768 00000100:00100000:0.0:1763334966.127545:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4769 00000100:00100000:0.0:1763334966.127552:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3289:x1848989701836160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.127686:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+26:3289:x1848989701836160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (901us total) trans 21474838357 rc 0/0 00000100:00100000:0.0:1763334966.127693:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4769 00000100:00100000:0.0:1763334966.127705:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4770 00000100:00100000:0.0:1763334966.127712:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+41:3289:x1848989701836288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.127815:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+42:3289:x1848989701836288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 103us (987us total) trans 17179871076 rc 0/0 00000100:00100000:0.0:1763334966.127821:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4770 00000004:00080000:0.0:1763334966.127899:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4d500/2, rc 0, transno 17179871075 00000100:00100000:0.0:1763334966.127907:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701836416:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334966.127921:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4ca80/2, rc 0, transno 21474838356 00000100:00100000:0.0:1763334966.127925:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701836032:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334966.127944:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4d180/2, rc 0, transno 17179871076 00000100:00100000:0.0:1763334966.127948:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701836288:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334966.127954:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4e300/2, rc 0, transno 21474838357 00000100:00100000:0.0:1763334966.127957:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701836160:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.130894:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.130984:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694464000 00000100:00100000:2.0:1763334966.130998:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694464000 00000100:00100000:2.0:1763334966.131087:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4771 00000100:00100000:2.0:1763334966.131098:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+14:52274:x1848989694464000:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334966.131121:0:7819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.131152:0:7819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849afb8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afbcf expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334966.131184:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x234:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334966.131210:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.131212:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.131224:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849afb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbcf expref: 15 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.131252:0:7819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849afb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbcf expref: 15 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.131269:0:7819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:2.0:1763334966.131485:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+15:52274:x1848989694464000:12345-192.168.201.60@tcp:101:bash.0 Request processed in 387us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.131492:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4771 00000100:00080000:0.0:1763334966.131972:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1763334966.137350:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.141729:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694464128 00000100:00100000:2.0:1763334966.141756:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694464128 00000100:00100000:3.0:1763334966.142076:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4772 00000100:00100000:3.0:1763334966.142092:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:52274:x1848989694464128:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334966.142118:0:7819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.142151:0:7819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7200/0xcedf0054f849afbf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afbd6 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334966.142184:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x238:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334966.142214:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.142217:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.142229:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7200/0xcedf0054f849afbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbd6 expref: 32 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.142268:0:7819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7200/0xcedf0054f849afbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbd6 expref: 32 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.142284:0:7819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7200, rc 0) 00000100:00100000:3.0:1763334966.142387:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+32:52274:x1848989694464128:12345-192.168.201.60@tcp:101:bash.0 Request processed in 298us (5053us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334966.142395:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4772 00000100:00100000:3.0:1763334966.147197:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.149430:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.149517:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694464384 00000100:00100000:0.0:1763334966.149533:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694464384 00002000:00010000:0.0:1763334966.149811:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/568 (0->18446744073709551615) 00002000:00100000:0.0:1763334966.149818:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1f2a00 with x1848989694464384 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334966.149833:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1f2a00. 00000100:00100000:2.0:1763334966.150503:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1734 00000100:00100000:2.0:1763334966.150524:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2360:x1848989694464384:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334966.150991:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x238:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334966.150995:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x238:0x0] updating lvb mtime from disk: 0 -> 1763334966 00002000:00010000:2.0:1763334966.150998:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x238:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334966.151001:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x238:0x0] updating lvb ctime from disk: 0 -> 1763334966 00002000:00010000:2.0:1763334966.151004:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x238:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334966.151119:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2360:x1848989694464384:12345-192.168.201.60@tcp:10:bash.0 Request processed in 601us (3937us total) trans 17179871077 rc 0/0 00000100:00100000:2.0:1763334966.151130:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1734 00002000:00010000:2.0:1763334966.151136:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/568 (0->18446744073709551615) 00002000:00100000:2.0:1763334966.151140:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1f2a00 with x1848989694464384 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334966.151147:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1f2a00. 00000100:00100000:2.0:1763334966.152836:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694464256 00000100:00100000:2.0:1763334966.152857:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694464256 00002000:00010000:2.0:1763334966.152916:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/564 (0->18446744073709551615) 00002000:00100000:2.0:1763334966.152921:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44d180 with x1848989694464256 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334966.152936:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa44d180. 00000100:00100000:0.0:1763334966.153124:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1735 00000100:00100000:0.0:1763334966.153143:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694464256:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:0.0:1763334966.153641:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x234:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334966.153647:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x234:0x0] updating lvb mtime from disk: 0 -> 1763334966 00002000:00010000:0.0:1763334966.153650:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x234:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334966.153652:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x234:0x0] updating lvb ctime from disk: 0 -> 1763334966 00002000:00010000:0.0:1763334966.153654:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x234:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334966.153742:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694464256:12345-192.168.201.60@tcp:10:bash.0 Request processed in 601us (4328us total) trans 21474838358 rc 0/0 00000100:00100000:0.0:1763334966.153751:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1735 00002000:00010000:0.0:1763334966.153756:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/564 (0->18446744073709551615) 00002000:00100000:0.0:1763334966.153759:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44d180 with x1848989694464256 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334966.153765:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa44d180. 00000100:00100000:3.0:1763334966.158864:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.159243:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694464640 00000100:00100000:0.0:1763334966.159258:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694464640 00000100:00100000:0.0:1763334966.159339:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1722 00000100:00100000:0.0:1763334966.159352:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+182:52274:x1848989694464640:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:0.0:1763334966.160053:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:52274:x1848989694464640:12345-192.168.201.60@tcp:35:bash.0 Request processed in 701us (1201us total) trans 8589938902 rc 0/0 00000100:00100000:0.0:1763334966.160073:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1722 00000100:00100000:1.0:1763334966.168375:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.168637:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694464768 00000100:00100000:2.0:1763334966.168656:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694464768 00000100:00100000:2.0:1763334966.168761:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1736 00000100:00100000:2.0:1763334966.168774:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2359:x1848989694464768:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334966.168836:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849afc6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.168858:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.168861:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.168870:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849afc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.168887:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849afc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.169074:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849afc6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.169083:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849afc6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.169092:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849afc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.169100:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334966.169104:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849afc6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.169114:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849afc6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.169139:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849afc6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.169149:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849afc6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334966.171407:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2359:x1848989694464768:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 2614us (3030us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763334966.171426:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1736 00000100:00100000:1.0:1763334966.183739:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.184078:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694464896 00000100:00100000:2.0:1763334966.184093:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694464896 00000100:00100000:2.0:1763334966.184185:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4679 00000100:00100000:2.0:1763334966.184197:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53031:x1848989694464896:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334966.184240:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.184271:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849afcd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afbdd expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.186678:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849afd4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.186709:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849afd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.186726:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849afd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.186924:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849afcd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbdd expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.186958:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c6e00/0xcedf0054f849afd4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbdd expref: 184 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.186971:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:3.0:1763334966.186975:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763334966.186982:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c6e00, rc 0) 00000100:00100000:3.0:1763334966.187125:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53031:x1848989694464896:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2928us (3404us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334966.187140:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4679 00000100:00100000:3.0:1763334966.189336:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.191784:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.191891:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694465024 00000100:00100000:2.0:1763334966.191905:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694465024 00000100:00100000:2.0:1763334966.191977:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4680 00000100:00100000:2.0:1763334966.191989:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53034:x1848989694465024:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:2.0:1763334966.192017:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.192046:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849afdb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afbe4 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.192158:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849afe2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192178:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849afe2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192192:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849afe2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192209:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849afe9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192215:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849afe9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192222:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849afe9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192380:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849aff0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192391:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849aff0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192398:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849aff0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:2.0:1763334966.192442:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19b:0x0]: returning size 5 00000004:00200000:2.0:1763334966.192447:0:29629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334966.192471:0:29629:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849aff0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192484:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849aff0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192493:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849afe2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192505:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849afe2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192512:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849afe2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192518:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.192523:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849afe2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192530:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849afe2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192544:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.192547:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.192553:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849afe2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192558:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849afe2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192597:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849afe9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192603:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849afe9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192608:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849afe9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192613:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.192615:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849afe9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192624:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849afe9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192631:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab500) 00010000:00010000:2.0:1763334966.192633:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.192635:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849afe9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192641:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849afe9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.192678:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849afdb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbe4 expref: 186 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.192692:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849aff0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbe4 expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.192699:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:2.0:1763334966.192701:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334966.192704:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:2.0:1763334966.192785:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53034:x1848989694465024:12345-192.168.201.60@tcp:101:rm.0 Request processed in 798us (3465us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.192794:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4680 00000100:00100000:1.0:1763334966.193694:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694465152 00000100:00100000:1.0:1763334966.193711:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694465152 00000100:00100000:1.0:1763334966.193803:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1737 00000100:00100000:1.0:1763334966.193813:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694465152:12345-192.168.201.60@tcp:4:lfs.0 00002000:00010000:1.0:1763334966.193878:0:14384:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x233:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334966.193888:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849aff7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.193905:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334966.193909:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334966.193917:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849aff7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.193932:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849aff7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334966.197238:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.197327:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694465408 00000100:00100000:2.0:1763334966.197341:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694465408 00000100:00100000:2.0:1763334966.197413:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4681 00000100:00100000:2.0:1763334966.197424:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53034:x1848989694465408:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:2.0:1763334966.197499:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1763334966.197542:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849aff0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbe4 expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.197566:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849af9c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19b:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbba expref: 184 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.197602:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:2.0:1763334966.197616:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334966.197647:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849affe lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.197663:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849affe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.197675:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849affe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.197692:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b005 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.197699:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b005 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.197706:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b005 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.197860:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b00c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.197869:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b00c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.197876:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b00c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:2.0:1763334966.198508:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1088, 64 off93272 00000040:00080000:2.0:1763334966.198566:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1099, 64 off94360 00000040:00080000:2.0:1763334966.198619:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1100, 64 off94424 00000040:00080000:2.0:1763334966.198637:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1089, 64 off93336 00010000:00010000:2.0:1763334966.198725:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b013 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198737:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b013 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198746:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b013 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198755:0:32232:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b013 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198762:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b013 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198769:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b013 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198794:0:32232:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334966.198820:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b00c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198826:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b00c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198832:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b00c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198838:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abe800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.198844:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b00c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198853:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b00c lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198865:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:2.0:1763334966.198868:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763334966.198873:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b00c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198880:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b00c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198951:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849affe lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198956:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849affe lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198961:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849affe lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198965:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.198968:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849affe lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198973:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849affe lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198980:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.198982:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.198985:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849affe lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.198995:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849affe lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:2.0:1763334966.199006:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000336b61a8 reply state 00000000089260b9 transno 8589938903 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b005 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334966.199017:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334966.199132:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6450000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53034:x1848989694465408:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1705us (1912us total) trans 8589938903 rc 0/0 00000100:00100000:2.0:1763334966.199141:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4681 00010000:00010000:2.0:1763334966.199190:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334966.199196:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b013 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.199202:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abf000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334966.199205:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b013 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.199210:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b013 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.199218:0:5737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19b:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:2.0:1763334966.199221:0:5737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763334966.199224:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b013 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.199229:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b013 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x19b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.199257:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.199259:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.199262:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334966.228145:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334966.228188:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b005 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.228204:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b005 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.228213:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b005 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.228221:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abf400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.228227:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b005 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.228247:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b005 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.228269:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab300) 00010000:00010000:3.0:1763334966.228274:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.228281:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b005 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.228287:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b005 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334966.228342:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694465536 00000100:00100000:3.0:1763334966.228355:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694465536 00000100:00100000:3.0:1763334966.228419:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4682 00000100:00100000:3.0:1763334966.228431:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53035:x1848989694465536:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.228462:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.228483:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849b01a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afbeb expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.228565:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b021 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228621:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b021 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228632:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b021 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228649:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b028 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228656:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b028 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228662:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b028 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228740:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b021 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228747:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b021 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228752:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b021 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228757:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.228761:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b021 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228767:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b021 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228775:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.228778:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.228783:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b021 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228788:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b021 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228798:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b028 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228803:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b028 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228808:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b028 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228813:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.228816:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b028 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228822:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b028 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228829:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4100) 00010000:00010000:3.0:1763334966.228831:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.228833:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b028 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228839:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b028 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.228874:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849b01a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbeb expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.228885:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.228888:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.228892:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5afb1c7600/0xcedf0054f849b01a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbeb expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.228902:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5afb1c7600, rc 0) 00000100:00100000:3.0:1763334966.228976:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53035:x1848989694465536:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 546us (848us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334966.228984:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4682 00000100:00100000:2.0:1763334966.239148:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.239763:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694465664 00000100:00100000:3.0:1763334966.239781:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694465664 00000100:00100000:1.0:1763334966.239920:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4683 00000100:00100000:1.0:1763334966.239936:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53035:x1848989694465664:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334966.239971:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.240001:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b02f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afbf2 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.240104:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b036 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240124:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b036 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240140:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b036 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240158:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b03d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240164:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b03d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240171:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b03d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240276:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b036 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240286:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b036 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240294:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b036 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240300:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.240305:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b036 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240314:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b036 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240329:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.240333:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.240340:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b036 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240347:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b036 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240362:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b03d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240368:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b03d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240374:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b03d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240379:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.240382:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b03d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240391:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b03d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240398:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa700) 00010000:00010000:1.0:1763334966.240401:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.240404:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b03d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240410:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b03d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.240464:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b02f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbf2 expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.240476:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.240479:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.240483:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b02f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbf2 expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.240494:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334966.240638:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53035:x1848989694465664:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 705us (1510us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334966.240648:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4683 00000100:00100000:0.0:1763334966.247994:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.249726:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694465792 00000100:00100000:3.0:1763334966.249749:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694465792 00000100:00100000:1.0:1763334966.250788:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4684 00000100:00100000:1.0:1763334966.250805:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53035:x1848989694465792:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334966.250835:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.250865:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b044 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afbf9 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.250980:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b04b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.251000:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b04b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.251016:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b04b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:1.0:1763334966.251100:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:1.0:1763334966.251105:0:29629:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334966.251131:0:29629:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b04b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.251164:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b044 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbf9 expref: 186 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.251186:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b04b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbf9 expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.251195:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.251199:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763334966.251203:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334966.254021:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53035:x1848989694465792:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3199us (6020us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.254039:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4684 00000100:00100000:2.0:1763334966.261155:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.261275:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694465920 00000100:00100000:0.0:1763334966.261292:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694465920 00000100:00100000:0.0:1763334966.261381:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4685 00000100:00100000:0.0:1763334966.261396:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53035:x1848989694465920:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334966.261429:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.261465:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b052 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc00 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.262107:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b059 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262131:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b059 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262144:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b059 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262166:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b060 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262172:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b060 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262179:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b060 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262275:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b059 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262283:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b059 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262291:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b059 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262298:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334966.262302:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b059 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262310:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b059 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262324:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334966.262327:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.262333:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b059 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262340:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b059 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262352:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b060 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262358:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b060 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262364:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b060 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262368:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334966.262370:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b060 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262375:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b060 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262379:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60d00) 00010000:00010000:0.0:1763334966.262381:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.262383:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b060 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262388:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b060 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.262426:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b052 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc00 expref: 186 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.262448:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334966.262450:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.262454:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b052 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc00 expref: 186 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.262462:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:0.0:1763334966.264017:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53035:x1848989694465920:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2605us (2859us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334966.264035:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4685 00000100:00100000:3.0:1763334966.279650:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.279750:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694466176 00000100:00100000:1.0:1763334966.279764:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694466176 00000100:00100000:1.0:1763334966.279844:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4686 00000100:00100000:1.0:1763334966.279856:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53035:x1848989694466176:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334966.279883:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.279886:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334966.279924:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b04b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbf9 expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.279951:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.279958:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334966.279975:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b067 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc07 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.280153:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b06e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.280171:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b06e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.280184:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b06e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.280203:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b075 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.280210:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b075 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.280215:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b075 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.280977:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b07c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.280991:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b07c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.281003:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b07c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:1.0:1763334966.281016:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19d:0x0]: returning size 0 00010000:00010000:1.0:1763334966.281050:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b06e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.281059:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b06e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.281066:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b06e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.281072:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.281077:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b06e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.281086:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b06e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.281098:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.281102:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.281107:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b06e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334966.281114:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b06e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000004:00010000:1.0:1763334966.281127:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fbd13f56 reply state 0000000072cd3d71 transno 8589938904 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b075 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:1.0:1763334966.281137:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763334966.281178:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b067 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc07 expref: 187 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.281194:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b07c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc07 expref: 186 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.281202:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ad28fa700) 00010000:00010000:1.0:1763334966.281205:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334966.281207:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478000, rc 0) 00000100:00100000:1.0:1763334966.281325:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53035:x1848989694466176:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1470us (1691us total) trans 8589938904 rc 0/0 00000100:00100000:1.0:1763334966.281334:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4686 00000100:00100000:2.0:1763334966.290859:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334966.290943:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b075 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.290958:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b075 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.290967:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b075 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.290975:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334966.290980:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b075 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.290989:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b075 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.291010:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa000) 00010000:00010000:0.0:1763334966.291013:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.291019:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b075 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.291025:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b075 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:0.0:1763334966.291070:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694466432 00000100:00100000:0.0:1763334966.291084:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694466432 00000100:00100000:0.0:1763334966.291150:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4687 00000100:00100000:0.0:1763334966.291161:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53035:x1848989694466432:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334966.291189:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.291210:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b08a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc0e expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.291344:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.291359:0:29629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b07c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc07 expref: 187 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.291368:0:29629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.291410:0:29629:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b07c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc07 expref: 187 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.291425:0:29629:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b07c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc07 expref: 187 pid: 29629 timeout: 1130 lvb_type: 0 00000100:00100000:0.0:1763334966.291441:0:29629:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac37cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701836544:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334966.291555:0:29629:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c1e48600 going to sleep for 11 seconds 00000100:00100000:2.0:1763334966.298798:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.298962:0:29629:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac37cd180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:29629:1848989701836544:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334966.299000:0:29629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:3.0:1763334966.299115:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694466560 00000100:00100000:3.0:1763334966.299125:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694466560 00010000:00010000:3.0:1763334966.299173:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b07c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc07 expref: 188 pid: 29629 timeout: 1130 lvb_type: 0 00000100:00100000:3.0:1763334966.299218:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2518 00000100:00100000:3.0:1763334966.299242:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:2359:x1848989694466560:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334966.299261:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334966.299268:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b07c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc07 expref: 188 pid: 29629 timeout: 1130 lvb_type: 0 00010000:00010000:3.0:1763334966.299286:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b07c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc07 expref: 188 pid: 29629 timeout: 1130 lvb_type: 0 00010000:00010000:3.0:1763334966.299313:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b07c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc07 expref: 188 pid: 29629 timeout: 1130 lvb_type: 0 00010000:00010000:3.0:1763334966.299331:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ad28fa700) 00010000:00010000:3.0:1763334966.299336:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.299346:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.299354:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.300353:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334966.300459:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:2359:x1848989694466560:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1224us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334966.300472:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2518 00010000:00010000:2.0:1763334966.301280:0:29629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.301295:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:2.0:1763334966.301323:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19d:0x0]: returning size 0 00000004:00080000:2.0:1763334966.301745:0:29629:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23a:0x0], index 1: 0 00000004:00080000:2.0:1763334966.301757:0:29629:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x236:0x0], index 0: 0 00000004:00080000:2.0:1763334966.301764:0:29629:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x237:0x0], index 0: 0 00000004:00080000:2.0:1763334966.301770:0:29629:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23b:0x0], index 1: 0 00010000:00010000:2.0:1763334966.301973:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.301983:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.301991:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.301998:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.302002:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.302011:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.302029:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ad28fa700) 00010000:00010000:2.0:1763334966.302033:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334966.302038:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.302045:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b091 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.302123:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b08a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc0e expref: 187 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.302134:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.302137:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334966.302141:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b08a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc0e expref: 187 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.302150:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:2.0:1763334966.302253:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53035:x1848989694466432:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 11092us (11407us total) trans 8589938905 rc 301/301 00000100:00100000:2.0:1763334966.302267:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4687 00000100:00100000:2.0:1763334966.306412:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.307177:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694466816 00000100:00100000:3.0:1763334966.307194:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694466816 00000100:00100000:3.0:1763334966.307419:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1723 00000100:00100000:3.0:1763334966.307432:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01d10050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53035:x1848989694466816:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334966.308098:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01d10050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53035:x1848989694466816:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 666us (1698us total) trans 8589938906 rc 0/0 00000100:00100000:3.0:1763334966.308109:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1723 00000001:00080000:1.0:1763334966.311447:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838358 is committed 00000001:00080000:1.0:1763334966.311475:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838357 is committed 00000001:00080000:1.0:1763334966.311509:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838359 is committed 00002000:00010000:1.0:1763334966.311644:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1763334966.311648:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb mtime from disk: 0 -> 1763334966 00002000:00010000:1.0:1763334966.311651:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb ctime from disk: 0 -> 1763334966 00002000:00010000:1.0:1763334966.311654:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1763334966.311670:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849aff7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.311683:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849aff7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.311692:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849aff7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.311701:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334966.311707:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849aff7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.311717:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849aff7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.311740:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849aff7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.311746:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849aff7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334966.311859:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+11:2360:x1848989694465152:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 118042us (120084us total) trans 21474838359 rc 0/0 00000100:00100000:1.0:1763334966.311871:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1737 00000100:00100000:2.0:1763334966.316412:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.316899:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694467072 00000100:00100000:3.0:1763334966.316915:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694467072 00000100:00100000:3.0:1763334966.316992:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1724 00000100:00100000:3.0:1763334966.317005:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53035:x1848989694467072:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334966.317409:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53035:x1848989694467072:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 406us (1010us total) trans 8589938907 rc 0/0 00000100:00100000:3.0:1763334966.317419:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1724 00000100:00100000:3.0:1763334966.322691:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.323340:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694467328 00000100:00100000:2.0:1763334966.323357:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694467328 00000100:00100000:2.0:1763334966.323444:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4688 00000100:00100000:2.0:1763334966.323457:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694467328:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334966.323490:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.323520:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b09f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc15 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.323775:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0a6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.323793:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.323807:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.323823:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b0ad lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.323830:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b0ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.323837:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b0ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.323923:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b0b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.323932:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.323939:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b0b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:2.0:1763334966.323950:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19d:0x0]: returning size 0 00010000:00010000:2.0:1763334966.324078:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324086:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0a6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324097:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324104:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abf000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.324108:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324117:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0a6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324130:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.324145:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.324151:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0a6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324158:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0a6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324175:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b0ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324181:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b0ad lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324188:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b0ad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324192:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abf400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.324195:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b0ad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324200:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b0ad lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324209:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab200) 00010000:00010000:2.0:1763334966.324211:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.324214:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b0ad lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324220:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b0ad lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.324280:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b09f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc15 expref: 191 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.324296:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b0b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc15 expref: 190 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.324304:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:2.0:1763334966.324306:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334966.324309:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abee00, rc 0) 00000100:00100000:2.0:1763334966.324403:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52274:x1848989694467328:12345-192.168.201.60@tcp:101:bash.0 Request processed in 950us (1729us total) trans 8589938908 rc 0/0 00000100:00100000:2.0:1763334966.324412:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4688 00000100:00100000:0.0:1763334966.339022:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.339078:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.339191:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694467584 00000100:00100000:1.0:1763334966.339206:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694467584 00000100:00100000:1.0:1763334966.339297:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694467840 00000100:00100000:1.0:1763334966.339301:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694467840 00000100:00100000:1.0:1763334966.339334:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4689 00000100:00100000:1.0:1763334966.339346:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52274:x1848989694467584:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1763334966.339430:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334966.339467:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b0b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc15 expref: 191 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.339491:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:1.0:1763334966.339506:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334966.339886:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b0c2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.339904:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b0c2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.339915:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b0c2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:1.0:1763334966.339980:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938909 00000004:00010000:1.0:1763334966.340006:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000202f85ee reply state 00000000e63e126d transno 8589938910 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b0c2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334966.340016:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334966.340144:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52274:x1848989694467584:12345-192.168.201.60@tcp:36:bash.0 Request processed in 798us (1139us total) trans 8589938910 rc 0/0 00000100:00100000:1.0:1763334966.340154:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4689 00000020:00080000:1.0:1763334966.340162:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763334966.340189:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4690 00000100:00100000:1.0:1763334966.340199:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53031:x1848989694467840:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334966.340241:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334966.340257:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849afaa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19a:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbc1 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.340270:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334966.340274:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334966.340305:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b0c9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.340315:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.340322:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00010000:1.0:1763334966.340421:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b387ab43 reply state 0000000046b371e7 transno 8589938911 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334966.340429:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334966.340464:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53031:x1848989694467840:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 267us (1385us total) trans 8589938911 rc 0/0 00000100:00100000:1.0:1763334966.340470:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4690 00010000:00010000:0.0:1763334966.344355:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b0c2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.344379:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b0c2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.344389:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b0c2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.344395:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334966.344401:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b0c2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.344410:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b0c2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.344432:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:0.0:1763334966.344436:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.344441:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b0c2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.344448:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b0c2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334966.347204:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334966.348094:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b0c9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.348112:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b0c9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.348123:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b0c9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.348130:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.348135:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b0c9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.348144:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b0c9 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.348164:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:3.0:1763334966.348167:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.348173:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b0c9 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.348180:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b0c9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334966.349072:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694467968 00000100:00100000:2.0:1763334966.349089:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694467968 00000100:00100000:2.0:1763334966.349179:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4691 00000100:00100000:2.0:1763334966.349191:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52274:x1848989694467968:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334966.349225:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.349267:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b0d0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc1c expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.349354:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc1c expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.349372:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc1c expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.349393:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:2.0:1763334966.349397:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334966.349400:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abe800, rc 0) 00000100:00100000:2.0:1763334966.349490:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52274:x1848989694467968:12345-192.168.201.60@tcp:101:bash.0 Request processed in 301us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.349498:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4691 00000100:00100000:2.0:1763334966.349599:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.352694:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694468096 00000100:00100000:1.0:1763334966.352723:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694468096 00000100:00100000:1.0:1763334966.352838:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4773 00000100:00100000:1.0:1763334966.352851:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+11:53031:x1848989694468096:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334966.352879:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.352914:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b0d7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc23 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334966.352948:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x233:0x0] initial LVB size: 4096, mtime: 0x691a5b36, atime: 0x0, ctime: 0x691a5b36, blocks: 0xb 00010000:00010000:1.0:1763334966.352987:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334966.352991:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334966.353002:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b0d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc23 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.353024:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b0d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc23 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.353040:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334966.353139:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+12:53031:x1848989694468096:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 291us (3540us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.353148:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4773 00000100:00100000:1.0:1763334966.359204:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.360107:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.360245:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694468352 00000100:00100000:3.0:1763334966.360261:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694468352 00000100:00100000:1.0:1763334966.360435:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4692 00000100:00100000:1.0:1763334966.360447:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52274:x1848989694468352:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334966.360480:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.360485:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334966.360526:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b0d0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc1c expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.360553:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:1.0:1763334966.360566:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334966.360749:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694468480 00000100:00100000:2.0:1763334966.360755:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694468480 00000100:00100000:2.0:1763334966.360789:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4774 00000100:00100000:2.0:1763334966.360797:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+33:53031:x1848989694468480:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334966.360806:0:7819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.360829:0:7819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0de lrc: 2/0,0 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc31 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334966.360864:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x237:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334966.360892:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.360894:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.360903:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc31 expref: 34 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.360925:0:7819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc31 expref: 34 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.360938:0:7819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abf000, rc 0) 00000100:00100000:2.0:1763334966.361012:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+34:53031:x1848989694468480:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 215us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.361020:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4774 00010000:00010000:1.0:1763334966.362530:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b0e5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc2a expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.362840:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b0ec lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.362860:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b0ec lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.362874:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b0ec lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000040:00080000:1.0:1763334966.363535:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1101, 88 off94512 00000004:00080000:1.0:1763334966.363549:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1030996976633ns, next at 1031252761634ns, rc = 0 00000040:00080000:1.0:1763334966.364035:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1090, 88 off93424 00000004:00080000:1.0:1763334966.364042:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1030997470557ns, next at 1031252687124ns, rc = 0 00000040:00080000:1.0:1763334966.364072:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1091, 88 off93512 00000004:00080000:1.0:1763334966.364077:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1030997504749ns, next at 1031252687124ns, rc = 0 00000040:00080000:1.0:1763334966.364091:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1102, 88 off94600 00000004:00080000:1.0:1763334966.364095:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1030997523116ns, next at 1031252761634ns, rc = 0 00000100:00100000:2.0:1763334966.369842:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.369892:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.369979:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694468608 00000100:00100000:0.0:1763334966.369993:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694468608 00002000:00010000:0.0:1763334966.370048:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/563 (5->18446744073709551615) 00002000:00100000:0.0:1763334966.370054:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab36300 with x1848989694468608 ext(5->18446744073709551615) 00002000:00010000:0.0:1763334966.370068:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afab36300. 00000100:00100000:0.0:1763334966.370096:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694468736 00000100:00100000:0.0:1763334966.370099:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694468736 00002000:00010000:0.0:1763334966.370112:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/567 (0->18446744073709551615) 00002000:00100000:0.0:1763334966.370116:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab34a80 with x1848989694468736 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334966.370123:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab34a80. 00000100:00100000:0.0:1763334966.370143:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1738 00000100:00100000:0.0:1763334966.370155:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694468608:12345-192.168.201.60@tcp:10:lfs.0 00000100:00100000:2.0:1763334966.370609:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1739 00000100:00100000:2.0:1763334966.370619:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+34:2360:x1848989694468736:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:2.0:1763334966.370871:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334966.370876:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb mtime from disk: 0 -> 1763334967 00002000:00010000:2.0:1763334966.370879:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334966.370881:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb ctime from disk: 0 -> 1763334967 00002000:00010000:2.0:1763334966.370884:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334966.370971:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+35:2360:x1848989694468736:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 353us (1076us total) trans 17179871078 rc 0/0 00000100:00100000:2.0:1763334966.370980:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1739 00002000:00010000:2.0:1763334966.370985:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/567 (0->18446744073709551615) 00002000:00100000:2.0:1763334966.370988:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab34a80 with x1848989694468736 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334966.370993:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab34a80. 00002000:00010000:0.0:1763334966.372168:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763334966.372177:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb mtime from disk: 1763334966 -> 1763334967 00002000:00010000:0.0:1763334966.372179:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334966.372182:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb ctime from disk: 1763334966 -> 1763334967 00002000:00010000:0.0:1763334966.372185:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1763334966.372253:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694468608:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 2097us (2422us total) trans 21474838360 rc 0/0 00000100:00100000:0.0:1763334966.372261:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1738 00002000:00010000:0.0:1763334966.372266:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/563 (5->18446744073709551615) 00002000:00100000:0.0:1763334966.372269:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab36300 with x1848989694468608 ext(5->18446744073709551615) 00002000:00010000:0.0:1763334966.372275:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afab36300. 00000100:00100000:0.0:1763334966.380063:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.380125:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694468992 00000100:00100000:3.0:1763334966.380139:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694468992 00000100:00100000:3.0:1763334966.380218:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4693 00000100:00100000:3.0:1763334966.380243:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53031:x1848989694468992:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:3.0:1763334966.380374:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b0f3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.380398:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.380416:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:3.0:1763334966.380765:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008aff5127 reply state 00000000cb5eb337 transno 8589938913 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334966.380776:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334966.380899:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53031:x1848989694468992:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 670us (846us total) trans 8589938913 rc 0/0 00000100:00100000:3.0:1763334966.380908:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4693 00010000:00010000:3.0:1763334966.385215:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b0f3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.385251:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b0f3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.385261:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b0f3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.385268:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.385274:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b0f3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.385284:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b0f3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.385306:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:3.0:1763334966.385310:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.385317:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b0f3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.385323:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b0f3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334966.386370:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.386432:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694469120 00000100:00100000:3.0:1763334966.386630:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694469120 00000100:00100000:3.0:1763334966.386696:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4775 00000100:00100000:3.0:1763334966.386706:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+35:53031:x1848989694469120:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.386730:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.386753:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b0fa lrc: 2/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc38 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.386787:0:6517:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849afb1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbc8 expref: 36 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334966.386795:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.386797:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.386802:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b0fa lrc: 4/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc38 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.386845:0:6517:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849afb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbc8 expref: 36 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334966.386866:0:6517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849afb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbc8 expref: 36 pid: 26216 timeout: 1131 lvb_type: 1 00000100:00100000:3.0:1763334966.386884:0:6517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af68cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6517:1848989701836672:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334966.387004:0:6517:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeebed840 going to sleep for 11 seconds 00000100:00100000:3.0:1763334966.396878:0:6517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af68cf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6517:1848989701836672:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334966.396883:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334966.396930:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b0fa lrc: 3/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc38 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.396958:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:3.0:1763334966.398407:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+36:53031:x1848989694469120:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 11689us (12037us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334966.398421:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4775 00000100:00100000:2.0:1763334966.407960:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694469248 00000100:00100000:2.0:1763334966.407985:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694469248 00010000:00010000:2.0:1763334966.408057:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849afb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbc8 expref: 36 pid: 26216 timeout: 1131 lvb_type: 1 00000100:00100000:2.0:1763334966.408129:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2519 00000100:00100000:2.0:1763334966.408141:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2360:x1848989694469248:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334966.408161:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334966.408200:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849afb1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbc8 expref: 36 pid: 26216 timeout: 1131 lvb_type: 1 00010000:00010000:2.0:1763334966.408218:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849afb1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbc8 expref: 36 pid: 26216 timeout: 1131 lvb_type: 1 00010000:00010000:2.0:1763334966.408265:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7c00/0xcedf0054f849afb1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbc8 expref: 36 pid: 26216 timeout: 1131 lvb_type: 1 00010000:00010000:2.0:1763334966.408298:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.408300:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.408312:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b0fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc38 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.408330:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b0fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc38 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.408391:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b0fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc38 expref: 35 pid: 6517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334966.408408:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab37480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701836800:192.168.201.60@tcp:105: 00000100:00100000:2.0:1763334966.408554:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa65e840 going to sleep for 11 seconds 00000100:00100000:0.0:1763334966.414374:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.414426:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694469376 00000100:00100000:2.0:1763334966.414440:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694469376 00000100:00100000:3.0:1763334966.414486:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab37480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701836800:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334966.414517:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334966.414518:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4776 00000100:00100000:2.0:1763334966.414531:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2360:x1848989694469376:12345-192.168.201.60@tcp:2:lfs.0 00000100:00100000:3.0:1763334966.414600:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2360:x1848989694469248:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 6460us (17721us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334966.414610:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2519 00002000:00010000:2.0:1763334966.414806:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:2.0:1763334966.414811:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb mtime from disk: 1763334966 -> 1763334966 00002000:00010000:2.0:1763334966.414813:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb atime from disk: 0 -> 1763334966 00002000:00010000:2.0:1763334966.414816:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb ctime from disk: 1763334966 -> 1763334967 00002000:00010000:2.0:1763334966.414818:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334966.414847:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2360:x1848989694469376:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 318us (488us total) trans 17179871079 rc 0/0 00000100:00100000:2.0:1763334966.414853:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4776 00000100:00100000:2.0:1763334966.427929:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.428057:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694469632 00000100:00100000:3.0:1763334966.428072:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694469632 00000100:00100000:3.0:1763334966.428160:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1725 00000100:00100000:3.0:1763334966.428176:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53031:x1848989694469632:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:3.0:1763334966.428271:0:29630:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x19a:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849aebc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb74 expref: 195 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.428344:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334966.428361:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849af8e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbb3 expref: 195 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.428371:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334966.428419:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849af8e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbb3 expref: 195 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.428435:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849af8e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbb3 expref: 195 pid: 29629 timeout: 1131 lvb_type: 0 00000100:00100000:3.0:1763334966.428453:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af68cf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701836928:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334966.428565:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad830c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334966.431485:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af68cf100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701836928:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334966.431485:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334966.431527:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:1.0:1763334966.431535:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694469760 00000100:00100000:1.0:1763334966.431545:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694469760 00010000:00010000:1.0:1763334966.431619:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849af8e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbb3 expref: 196 pid: 29629 timeout: 1131 lvb_type: 0 00000100:00100000:1.0:1763334966.431654:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2520 00000100:00100000:1.0:1763334966.431664:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2360:x1848989694469760:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334966.431685:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334966.431693:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849af8e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbb3 expref: 196 pid: 29629 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334966.431706:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849af8e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbb3 expref: 196 pid: 29629 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334966.431737:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849af8e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbb3 expref: 196 pid: 29629 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334966.431755:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334966.431760:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.431770:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.431780:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.431805:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334966.431868:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2360:x1848989694469760:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 206us (403us total) trans 0 rc 0/0 00010000:00010000:0.0:1763334966.433776:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334966.433800:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000040:00080000:0.0:1763334966.434348:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1103, 88 off94688 00000004:00080000:0.0:1763334966.434360:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1031067787090ns, next at 1031252761634ns, rc = 0 00000040:00080000:0.0:1763334966.434423:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1092, 88 off93600 00000004:00080000:0.0:1763334966.434429:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1031067857116ns, next at 1031252687124ns, rc = 0 00000040:00080000:0.0:1763334966.434480:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1093, 88 off93688 00000004:00080000:0.0:1763334966.434486:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1031067913813ns, next at 1031252687124ns, rc = 0 00000040:00080000:0.0:1763334966.434504:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1104, 88 off94776 00000004:00080000:0.0:1763334966.434509:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1031067936508ns, next at 1031252761634ns, rc = 0 00000100:00100000:1.0:1763334966.436569:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2520 00010000:00010000:1.0:1763334966.446316:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b0ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc2a expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.446342:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ad28fa100) 00010000:00010000:1.0:1763334966.446345:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334966.446373:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b0e5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc2a expref: 196 pid: 29627 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763334966.446398:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b0ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19d:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc2a expref: 195 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.446450:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ad28fa100) 00010000:00010000:1.0:1763334966.446453:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334966.446455:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334966.446554:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52274:x1848989694468352:12345-192.168.201.60@tcp:101:bash.0 Request processed in 86108us (87370us total) trans 8589938912 rc 0/0 00000100:00100000:1.0:1763334966.446565:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4692 00000001:00080000:1.0:1763334966.446667:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938902 is committed 00000001:00080000:1.0:1763334966.446684:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938912 is committed 00000004:00080000:1.0:1763334966.446690:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 727 committed 00000004:00080000:1.0:1763334966.446710:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 715 committed 00000004:00080000:1.0:1763334966.446718:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 714 committed 00000004:00080000:1.0:1763334966.446721:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 726 committed 00000100:00100000:1.0:1763334966.448936:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af68cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701837056:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334966.449046:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.449224:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af68cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701837440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.449287:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af68cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701837184:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.449321:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af68cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701837312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334966.449818:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701837056 00000100:00100000:2.0:1763334966.449832:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701837056 00000100:00100000:2.0:1763334966.449920:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4777 00000100:00100000:2.0:1763334966.449933:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1848989701837056:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.451718:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334966.451755:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.451774:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701837824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.451828:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.451883:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.451909:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af59faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701837696:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.451936:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.451968:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.451994:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701837952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.452015:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.452054:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701837312 00000100:00100000:0.0:1763334966.452063:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701837312 00000100:00100000:0.0:1763334966.452112:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694469888 00000100:00100000:0.0:1763334966.452116:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694469888 00000100:00100000:0.0:1763334966.452131:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701837824 00000100:00100000:0.0:1763334966.452133:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701837824 00000100:00100000:0.0:1763334966.452143:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701837184 00000100:00100000:0.0:1763334966.452146:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701837184 00000100:00100000:0.0:1763334966.452154:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701837696 00000100:00100000:0.0:1763334966.452156:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701837696 00000100:00100000:0.0:1763334966.452165:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701837440 00000100:00100000:0.0:1763334966.452167:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701837440 00000100:00100000:0.0:1763334966.452175:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701837952 00000100:00100000:0.0:1763334966.452177:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701837952 00000100:00100000:0.0:1763334966.452190:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4778 00000100:00100000:0.0:1763334966.452199:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3290:x1848989701837312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.452543:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3290:x1848989701837312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 343us (833us total) trans 21474838361 rc 0/0 00000100:00100000:0.0:1763334966.452551:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4778 00000100:00100000:0.0:1763334966.452608:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4779 00000100:00100000:0.0:1763334966.452618:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+36:52274:x1848989694469888:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334966.452631:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.452657:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b108 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc3f expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334966.452686:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334966.452707:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.452711:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.452723:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b108 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc3f expref: 37 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.452741:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b108 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc3f expref: 37 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.452757:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334966.452809:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+37:52274:x1848989694469888:12345-192.168.201.60@tcp:101:bash.0 Request processed in 192us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334966.452815:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4779 00000100:00100000:0.0:1763334966.452830:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4780 00000100:00100000:0.0:1763334966.452838:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3290:x1848989701837824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334966.452872:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4781 00000100:00100000:3.0:1763334966.452883:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701837184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1763334966.452901:0:6518:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:565 count 1 00002000:00010000:3.0:1763334966.452925:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x235:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334966.452932:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b10f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.452943:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.452944:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.452948:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b10f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.452962:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b10f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334966.452964:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334966.452967:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763334966.452970:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334966.452971:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb ctime from disk: 0 -> 0 00010000:00010000:3.0:1763334966.452973:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b10f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334966.452974:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:3.0:1763334966.452982:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b10f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334966.453001:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3290:x1848989701837824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 164us (1173us total) trans 17179871080 rc 0/0 00010000:00010000:3.0:1763334966.453004:0:6518:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334966.453010:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4780 00000100:00100000:0.0:1763334966.453023:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4782 00000100:00100000:0.0:1763334966.453028:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+44:3289:x1848989701837696:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334966.453038:0:32239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:569 count 1 00002000:00010000:0.0:1763334966.453054:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x239:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334966.453059:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b116 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.453066:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.453068:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.453070:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b116 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.453078:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b116 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.453085:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b116 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.453091:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b116 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.453105:0:32239:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763334966.453256:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701837184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 376us (1372us total) trans 21474838362 rc 0/0 00000100:00100000:3.0:1763334966.453264:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4781 00000100:00100000:3.0:1763334966.453280:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4783 00000100:00100000:3.0:1763334966.453286:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701837440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334966.453402:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701837440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (1433us total) trans 21474838363 rc 0/0 00000100:00100000:3.0:1763334966.453408:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4783 00000100:00100000:3.0:1763334966.453422:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4784 00000100:00100000:3.0:1763334966.453428:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3291:x1848989701837952:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334966.453930:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+46:3291:x1848989701837952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 500us (1912us total) trans 17179871082 rc 0/0 00000100:00100000:3.0:1763334966.453940:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4784 00002000:00080000:2.0:1763334966.453972:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:564 count 1 00010000:00010000:2.0:1763334966.453993:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.454013:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849afb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbcf expref: 12 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.454021:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334966.454022:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334966.454026:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.454069:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849afb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbcf expref: 12 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.454086:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849afb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbcf expref: 12 pid: 7819 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.454103:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701838080:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334966.454179:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad82cc6c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763334966.454475:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763334966.454486:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b10f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.454495:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334966.454501:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b10f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.454512:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b10f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.454534:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b10f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.454542:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b10f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.454563:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334966.454568:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b116 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.454591:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334966.454594:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b116 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.454606:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.454617:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b116 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.454624:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b116 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.454638:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334966.454640:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334966.454642:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334966.454735:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+45:3289:x1848989701837696:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1705us (2796us total) trans 17179871081 rc 0/0 00000100:00100000:0.0:1763334966.454744:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4782 00000100:00100000:0.0:1763334966.454836:0:3290:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838357 gen 2 00000004:00080000:0.0:1763334966.454845:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5b01f2d180, transno 21474838334 00000004:00080000:0.0:1763334966.454865:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fed80, transno 21474838335 00000004:00080000:0.0:1763334966.454868:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fd880, transno 21474838336 00000004:00080000:0.0:1763334966.454871:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fea00, transno 21474838337 00000004:00080000:0.0:1763334966.454874:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f0000, transno 21474838338 00000004:00080000:0.0:1763334966.454877:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f1f80, transno 21474838339 00000004:00080000:0.0:1763334966.454881:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa766d80, transno 21474838341 00000004:00080000:0.0:1763334966.454884:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa767100, transno 21474838342 00000004:00080000:0.0:1763334966.454887:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa767480, transno 21474838343 00000004:00080000:0.0:1763334966.454889:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa766300, transno 21474838344 00000004:00080000:0.0:1763334966.454892:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa765c00, transno 21474838345 00000004:00080000:0.0:1763334966.454895:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa766680, transno 21474838346 00000004:00080000:0.0:1763334966.454909:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8c0a80, transno 21474838349 00000004:00080000:0.0:1763334966.454913:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8c0700, transno 21474838350 00000004:00080000:0.0:1763334966.454915:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8e8000, transno 21474838351 00000004:00080000:0.0:1763334966.454918:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8eb100, transno 21474838352 00000004:00080000:0.0:1763334966.454920:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4e680, transno 21474838354 00000004:00080000:0.0:1763334966.454922:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4f480, transno 21474838355 00000004:00080000:0.0:1763334966.454925:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4ca80, transno 21474838356 00000004:00080000:0.0:1763334966.454928:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4e300, transno 21474838357 00000100:00100000:0.0:1763334966.454935:0:3290:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5af68cdf80 x1848989701837312/t21474838361(21474838361) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334982 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763334966.454948:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af68cdf80/2, rc 0, transno 21474838361 00000100:00100000:0.0:1763334966.454953:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af68cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701837312:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334966.454975:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeec58380/2, rc 0, transno 17179871080 00000100:00100000:0.0:1763334966.454998:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701837824:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1763334966.455019:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334966.455040:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af68cea00/2, rc 0, transno 21474838362 00000100:00100000:0.0:1763334966.455045:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af68cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701837184:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1763334966.455054:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af59faa00/2, rc 0, transno 17179871081 00000100:00100000:0.0:1763334966.455057:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af59faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701837696:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763334966.455077:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af68cfb80/2, rc 0, transno 21474838363 00000100:00100000:0.0:1763334966.455081:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af68cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701837440:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334966.455089:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f1880/2, rc 0, transno 17179871082 00000100:00100000:0.0:1763334966.455093:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701837952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.455121:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af59f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701837568:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.455167:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.455203:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701837568 00000100:00100000:0.0:1763334966.455212:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701837568 00000100:00100000:0.0:1763334966.455263:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4785 00000100:00100000:0.0:1763334966.455271:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+45:3292:x1848989701837568:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334966.455301:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:568 count 1 00010000:00010000:0.0:1763334966.455326:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.455345:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7200/0xcedf0054f849afbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbd6 expref: 36 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.455352:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334966.455354:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334966.455358:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.455389:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7200/0xcedf0054f849afbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbd6 expref: 36 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.455400:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7200/0xcedf0054f849afbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbd6 expref: 36 pid: 7819 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334966.455413:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701838208:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334966.455468:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c1e48840 going to sleep for 11 seconds 00000004:00080000:3.0:1763334966.460254:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 4 in progress, 1 in flight, 20 done 00000100:00100000:1.0:1763334966.462636:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.462665:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.462719:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.462753:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694470144 00000100:00100000:1.0:1763334966.462764:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694470144 00010000:00010000:1.0:1763334966.462817:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849afb8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbcf expref: 13 pid: 7819 timeout: 1131 lvb_type: 0 00000100:00100000:1.0:1763334966.462854:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694470272 00000100:00100000:1.0:1763334966.462858:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694470272 00010000:00010000:1.0:1763334966.462872:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7200/0xcedf0054f849afbf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbd6 expref: 37 pid: 7819 timeout: 1131 lvb_type: 0 00000100:00100000:1.0:1763334966.462895:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2521 00000100:00100000:1.0:1763334966.462905:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694470144:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334966.462924:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334966.462929:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849afb8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbcf expref: 13 pid: 7819 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334966.462943:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849afb8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbcf expref: 13 pid: 7819 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334966.462976:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334966.462979:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334966.462985:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.462996:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.463023:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334966.463088:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694470144:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 183us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.463096:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2521 00000100:00100000:1.0:1763334966.463118:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2522 00000100:00100000:1.0:1763334966.463124:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2359:x1848989694470272:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334966.463134:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334966.463138:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7200/0xcedf0054f849afbf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbd6 expref: 37 pid: 7819 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334966.463148:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7200/0xcedf0054f849afbf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbd6 expref: 37 pid: 7819 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334966.463169:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334966.463172:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334966.463175:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.463183:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.463195:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334966.463214:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2359:x1848989694470272:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 90us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.463221:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2522 00010000:00010000:2.0:1763334966.463419:0:7819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849afb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x234:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbcf expref: 12 pid: 7819 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.463438:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bec700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701838080:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334966.463464:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.463475:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.463483:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.463494:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.463508:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.463537:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334966.463944:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701837056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14012us (14897us total) trans 21474838364 rc 0/0 00000100:00100000:2.0:1763334966.463954:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4777 00000100:00100000:2.0:1763334966.463975:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694470016 00000100:00100000:2.0:1763334966.463979:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694470016 00000100:00100000:2.0:1763334966.464009:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4786 00000100:00100000:2.0:1763334966.464017:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+12:52274:x1848989694470016:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334966.464035:0:7819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.464058:0:7819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b12b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc46 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334966.464082:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x236:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334966.464098:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.464100:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.464107:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b12b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc46 expref: 13 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.464121:0:7819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b12b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc46 expref: 13 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.464132:0:7819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abe800, rc 0) 00000100:00100000:2.0:1763334966.464156:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+13:52274:x1848989694470016:12345-192.168.201.60@tcp:101:bash.0 Request processed in 141us (1534us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.464163:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4786 00000004:00080000:2.0:1763334966.464208:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af68cf100/2, rc 0, transno 21474838364 00000100:00100000:2.0:1763334966.464222:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af68cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701837056:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763334966.464411:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5afb1c7200/0xcedf0054f849afbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afbd6 expref: 36 pid: 7819 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334966.464426:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701838208:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334966.464445:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.464453:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.464459:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.464468:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.464475:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.464492:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763334966.464733:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3292:x1848989701837568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9462us (9565us total) trans 17179871083 rc 0/0 00000100:00100000:0.0:1763334966.464741:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4785 00010000:00010000:1.0:1763334966.465901:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763334966.465916:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.465929:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abf400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334966.465935:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.465946:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.465970:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.465978:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b11d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.466006:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334966.466010:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.466017:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334966.466020:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.466028:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.466037:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.466044:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b124 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.466058:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334966.466060:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334966.466061:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.468456:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334966.468609:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af59f9880/2, rc 0, transno 17179871083 00000100:00100000:2.0:1763334966.468637:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af59f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701837568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334966.471379:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.471428:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.471508:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694470400 00000100:00100000:3.0:1763334966.471523:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694470400 00002000:00010000:3.0:1763334966.471634:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/570 (0->18446744073709551615) 00002000:00100000:3.0:1763334966.471641:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bec700 with x1848989694470400 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334966.471657:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6bec700. 00000100:00100000:3.0:1763334966.472062:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694470528 00000100:00100000:3.0:1763334966.472067:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694470528 00000100:00100000:2.0:1763334966.472093:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1740 00000100:00100000:2.0:1763334966.472107:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2362:x1848989694470400:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334966.472378:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/566 (0->18446744073709551615) 00002000:00100000:3.0:1763334966.472382:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bedc00 with x1848989694470528 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334966.472392:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6bedc00. 00000100:00100000:3.0:1763334966.472408:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1741 00000100:00100000:3.0:1763334966.472415:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2362:x1848989694470528:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334966.472775:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334966.472780:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb mtime from disk: 0 -> 1763334967 00002000:00010000:2.0:1763334966.472783:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334966.472786:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb ctime from disk: 0 -> 1763334967 00002000:00010000:2.0:1763334966.472789:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334966.472887:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2362:x1848989694470400:12345-192.168.201.60@tcp:10:bash.0 Request processed in 781us (1529us total) trans 17179871084 rc 0/0 00000100:00100000:2.0:1763334966.472895:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1740 00002000:00010000:2.0:1763334966.472900:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/570 (0->18446744073709551615) 00002000:00100000:2.0:1763334966.472902:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bec700 with x1848989694470400 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334966.472907:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6bec700. 00002000:00010000:3.0:1763334966.473053:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x236:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334966.473056:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x236:0x0] updating lvb mtime from disk: 0 -> 1763334967 00002000:00010000:3.0:1763334966.473059:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x236:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334966.473061:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x236:0x0] updating lvb ctime from disk: 0 -> 1763334967 00002000:00010000:3.0:1763334966.473063:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x236:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334966.473088:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2362:x1848989694470528:12345-192.168.201.60@tcp:10:bash.0 Request processed in 673us (1659us total) trans 21474838365 rc 0/0 00000100:00100000:3.0:1763334966.473096:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1741 00002000:00010000:3.0:1763334966.473099:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/566 (0->18446744073709551615) 00002000:00100000:3.0:1763334966.473102:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bedc00 with x1848989694470528 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334966.473106:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6bedc00. 00000100:00100000:0.0:1763334966.480120:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.480182:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694470784 00000100:00100000:0.0:1763334966.480199:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694470784 00000100:00100000:0.0:1763334966.480292:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1726 00000100:00100000:0.0:1763334966.480306:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52274:x1848989694470784:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:0.0:1763334966.480918:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694470784:12345-192.168.201.60@tcp:35:bash.0 Request processed in 611us (811us total) trans 8589938915 rc 0/0 00000100:00100000:0.0:1763334966.480929:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1726 00000100:00100000:0.0:1763334966.491541:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.492045:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694470912 00000100:00100000:1.0:1763334966.492062:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694470912 00000100:00100000:1.0:1763334966.492136:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4694 00000100:00100000:1.0:1763334966.492148:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53036:x1848989694470912:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:1.0:1763334966.492174:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.492202:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b132 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc4d expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.492307:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b139 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492326:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b139 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492339:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b139 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492355:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b140 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492361:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b140 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492367:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b140 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492523:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b147 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492531:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b147 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492537:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b147 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334966.492616:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19d:0x0]: returning size 5 00000004:00200000:1.0:1763334966.492622:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334966.492644:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b147 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492657:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b147 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492667:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b139 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492674:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b139 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492682:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b139 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492688:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.492692:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b139 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492700:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b139 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492712:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.492716:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.492721:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b139 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492726:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b139 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492739:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b140 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492745:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b140 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492752:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b140 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492756:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.492759:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b140 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492765:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b140 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492771:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa400) 00010000:00010000:1.0:1763334966.492773:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.492775:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b140 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492780:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b140 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.492810:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b132 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc4d expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.492823:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b147 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc4d expref: 186 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.492830:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ad28fa100) 00010000:00010000:1.0:1763334966.492832:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334966.492834:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334966.492904:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53036:x1848989694470912:12345-192.168.201.60@tcp:101:rm.0 Request processed in 758us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.492912:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4694 00000004:00010000:1.0:1763334966.497151:0:29630:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000115f102f reply state 00000000b9e4f332 transno 8589938914 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:1.0:1763334966.497177:0:29630:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763334966.497192:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334966.497197:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334966.497215:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849aebc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb74 expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334966.497444:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53031:x1848989694469632:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 69269us (69528us total) trans 8589938914 rc 0/0 00000100:00100000:1.0:1763334966.497456:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1725 00000001:00080000:1.0:1763334966.497521:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938914 is committed 00000004:00080000:1.0:1763334966.497530:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 729 committed 00000004:00080000:1.0:1763334966.497552:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 717 committed 00000004:00080000:1.0:1763334966.497560:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 716 committed 00000004:00080000:1.0:1763334966.497562:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 728 committed 00010000:00010000:1.0:1763334966.497629:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.497639:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.497647:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.497654:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.497659:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.497667:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.497685:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:1.0:1763334966.497688:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334966.497692:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.497703:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b101 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00000100:00100000:0.0:1763334966.497839:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763334966.497861:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac721aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701838336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334966.497916:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763334966.497926:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701838720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.497946:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334966.497986:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.498006:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac721ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701838464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334966.498026:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701838336 00000100:00100000:0.0:1763334966.498030:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334966.498037:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701838336 00000100:00100000:0.0:1763334966.498049:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763334966.498054:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701838592:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.498072:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334966.498638:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701838464 00000100:00100000:2.0:1763334966.498638:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701838720 00000100:00100000:3.0:1763334966.498644:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701838464 00000100:00100000:2.0:1763334966.498644:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701838720 00000100:00100000:1.0:1763334966.498683:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701838592 00000100:00100000:1.0:1763334966.498689:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701838592 00000100:00100000:2.0:1763334966.499103:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4787 00000100:00100000:2.0:1763334966.499118:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+47:3291:x1848989701838336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.499124:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4788 00000100:00100000:0.0:1763334966.499133:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+47:3289:x1848989701838464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763334966.499426:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb size from disk: 5 -> 5 00000100:00100000:3.0:1763334966.499427:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4789 00002000:00010000:2.0:1763334966.499430:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb mtime from disk: 1763334966 -> 1763334966 00002000:00010000:2.0:1763334966.499433:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb atime from disk: 1763334966 -> 1763334966 00002000:00010000:2.0:1763334966.499435:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb ctime from disk: 1763334967 -> 1763334967 00000100:00100000:3.0:1763334966.499436:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701838720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334966.499439:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x236:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334966.499506:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+48:3291:x1848989701838336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 390us (1560us total) trans 17179871085 rc 0/0 00000100:00100000:2.0:1763334966.499513:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4787 00000100:00100000:2.0:1763334966.499531:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4790 00000100:00100000:2.0:1763334966.499537:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701838592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334966.499565:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763334966.499568:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb mtime from disk: 1763334967 -> 1763334967 00002000:00010000:3.0:1763334966.499597:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334966.499600:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb ctime from disk: 1763334967 -> 1763334967 00002000:00010000:3.0:1763334966.499602:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x233:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1763334966.499642:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701838720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 207us (1655us total) trans 21474838366 rc 0/0 00000100:00100000:3.0:1763334966.499648:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4789 00002000:00010000:2.0:1763334966.499675:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334966.499678:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb mtime from disk: 1763334966 -> 1763334966 00002000:00010000:2.0:1763334966.499681:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334966.499683:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb ctime from disk: 1763334966 -> 1763334966 00002000:00010000:2.0:1763334966.499685:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x232:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:2.0:1763334966.499723:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701838592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 186us (1649us total) trans 21474838367 rc 0/0 00000100:00100000:2.0:1763334966.499730:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4790 00002000:00010000:0.0:1763334966.499777:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334966.499780:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb mtime from disk: 1763334967 -> 1763334967 00002000:00010000:0.0:1763334966.499781:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334966.499783:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb ctime from disk: 1763334967 -> 1763334967 00002000:00010000:0.0:1763334966.499785:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x237:0x0] updating lvb blocks from disk: 1 -> 1 00000004:00080000:2.0:1763334966.499805:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6bec380/2, rc 0, transno 21474838366 00000100:00100000:0.0:1763334966.499810:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+48:3289:x1848989701838464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 680us (1779us total) trans 17179871086 rc 0/0 00000100:00100000:2.0:1763334966.499813:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701838720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.499816:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4788 00000004:00080000:2.0:1763334966.499843:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac721aa00/2, rc 0, transno 17179871085 00000100:00100000:2.0:1763334966.499849:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac721aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701838336:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334966.500896:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6bed500/2, rc 0, transno 21474838367 00000100:00100000:3.0:1763334966.500907:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701838592:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334966.500917:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac721ad80/2, rc 0, transno 17179871086 00000100:00100000:3.0:1763334966.500921:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac721ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701838464:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334966.500925:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.501014:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694471168 00000100:00100000:2.0:1763334966.501028:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694471168 00000100:00100000:2.0:1763334966.501080:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4695 00000100:00100000:2.0:1763334966.501089:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53036:x1848989694471168:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:2.0:1763334966.501153:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1763334966.501188:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b147 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc4d expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.501213:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b0ec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19d:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc2a expref: 181 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.501237:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ad28fa100) 00010000:00010000:2.0:1763334966.501296:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334966.501330:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b14e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.501346:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b14e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.501357:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b14e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.501375:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b155 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.501382:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b155 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.501389:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b155 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.501547:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b15c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.501556:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b15c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.501564:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b15c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334966.503787:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.504235:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694471296 00000100:00100000:3.0:1763334966.504338:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694471296 00000100:00100000:3.0:1763334966.504415:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4696 00000100:00100000:3.0:1763334966.504427:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+181:53031:x1848989694471296:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.504458:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.504485:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849b163 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc54 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.504560:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849b163 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc54 expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.504611:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066c00/0xcedf0054f849b163 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc54 expref: 182 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.504635:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:3.0:1763334966.504639:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334966.504643:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066c00, rc 0) 00000100:00100000:3.0:1763334966.504721:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+182:53031:x1848989694471296:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 296us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334966.504728:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4696 00000040:00080000:2.0:1763334966.508192:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1105, 64 off94840 00000040:00080000:2.0:1763334966.508273:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1094, 64 off93752 00000040:00080000:2.0:1763334966.508296:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1095, 64 off93816 00000040:00080000:2.0:1763334966.508313:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1106, 64 off94904 00010000:00010000:2.0:1763334966.508447:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b16a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.508470:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b16a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.508484:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b16a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.508494:0:30972:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b16a lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.508500:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b16a lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.508507:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b16a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.508540:0:30972:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334966.508595:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b15c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.508602:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b15c lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.508608:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b15c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.508609:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334966.508614:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.508618:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b16a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.508620:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b15c lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.508625:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334966.508629:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b16a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.508630:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b15c lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.508636:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b16a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.508654:0:8205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:1.0:1763334966.508657:0:8205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763334966.508662:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b16a lrc: 1/0,0 mode: --/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.508669:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b16a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x19d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.508684:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334966.508686:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334966.508689:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334966.509001:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.509223:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694471552 00000100:00100000:0.0:1763334966.509260:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694471552 00000100:00100000:0.0:1763334966.509333:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1727 00000100:00100000:0.0:1763334966.509344:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53031:x1848989694471552:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:1.0:1763334966.509842:0:29630:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x19a:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1763334966.509912:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1107, 64 off94968 00000040:00080000:1.0:1763334966.509931:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1096, 64 off93880 00000040:00080000:1.0:1763334966.509943:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1097, 64 off93944 00000040:00080000:1.0:1763334966.509955:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1108, 64 off95032 00010000:00010000:1.0:1763334966.510025:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b171 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.510040:0:29630:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b171 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.510051:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b171 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.510059:0:29630:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b171 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.510066:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b171 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.510071:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b171 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334966.510095:0:29630:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763334966.510138:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334966.510143:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b171 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334966.510150:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334966.510152:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b171 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334966.510158:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b171 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334966.510169:0:8206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19a:0x0].0x0 (ffff9a5ac71b4a00) 00010000:00010000:0.0:1763334966.510171:0:8206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763334966.510175:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b171 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334966.510180:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b171 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x19a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334966.510190:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334966.510192:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334966.510194:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.510234:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19d:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334966.510237:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763334966.510243:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b15c lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.510249:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b15c lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334966.510278:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53031:x1848989694471552:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 934us (1281us total) trans 8589938917 rc 0/0 00000100:00100000:1.0:1763334966.510289:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1727 00010000:00010000:2.0:1763334966.510970:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b14e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.510979:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b14e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.510985:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b14e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.510990:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abee00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.511669:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b14e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.511686:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b14e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.511703:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.511706:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.511711:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b14e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.511718:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b14e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:2.0:1763334966.511736:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000037bd8732 reply state 00000000df12781b transno 8589938916 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b155 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334966.511745:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334966.511853:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53036:x1848989694471168:12345-192.168.201.60@tcp:36:rm.0 Request processed in 10761us (10927us total) trans 8589938916 rc 0/0 00000100:00100000:2.0:1763334966.511863:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4695 00000100:00100000:0.0:1763334966.517221:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.517303:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694471808 00000100:00100000:2.0:1763334966.517319:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694471808 00010000:00010000:3.0:1763334966.517368:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b155 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.517383:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b155 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.517392:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b155 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334966.517398:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4697 00010000:00010000:3.0:1763334966.517399:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abf400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.517405:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b155 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334966.517410:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53031:x1848989694471808:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.517414:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b155 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.517433:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:3.0:1763334966.517436:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.517441:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b155 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517443:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.517452:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b155 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517467:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b178 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc5b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.517592:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b17f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517609:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b17f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517622:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b17f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517637:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b186 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517644:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b186 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517650:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b186 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517735:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b17f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517741:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b17f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517747:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b17f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517751:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.517754:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b17f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517760:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b17f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517768:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.517770:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.517773:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b17f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517778:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b17f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517788:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b186 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517794:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b186 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517799:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b186 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517804:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.517807:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b186 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517812:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b186 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517818:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334966.517820:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.517822:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b186 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517828:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b186 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.517864:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b178 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc5b expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.517875:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.517877:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334966.517881:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b178 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc5b expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.517894:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8800, rc 0) 00000100:00100000:2.0:1763334966.517964:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53031:x1848989694471808:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 556us (760us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334966.517973:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4697 00000100:00100000:1.0:1763334966.534521:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.534624:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694472064 00000100:00100000:0.0:1763334966.534640:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694472064 00000100:00100000:0.0:1763334966.535042:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4698 00000100:00100000:0.0:1763334966.535056:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53038:x1848989694472064:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334966.535085:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.535116:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b18d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc62 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.535242:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b194 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.536115:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b194 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334966.536140:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b194 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536413:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b19b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536424:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b19b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536432:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b19b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536534:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b194 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536542:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b194 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536550:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b194 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536557:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.536562:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b194 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536591:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b194 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536607:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.536610:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.536617:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b194 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536623:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b194 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536640:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b19b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536646:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b19b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536651:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b19b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536656:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.536659:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b19b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536664:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b19b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536670:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334966.536673:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.536676:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b19b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536681:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b19b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334966.536742:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b18d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc62 expref: 184 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.536754:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.536757:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334966.536761:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b18d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc62 expref: 184 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.536770:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:2.0:1763334966.536878:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53038:x1848989694472064:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1823us (2374us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334966.536889:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4698 00000100:00100000:3.0:1763334966.539432:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.539501:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694472192 00000100:00100000:2.0:1763334966.539517:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694472192 00000100:00100000:3.0:1763334966.539617:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4699 00000100:00100000:3.0:1763334966.539633:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53038:x1848989694472192:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.539664:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.539694:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b1a2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc69 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.539795:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b1a9 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.539813:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b1a9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.539826:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b1a9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.539842:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.539849:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.539855:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.539941:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b1a9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.539949:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b1a9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.539957:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b1a9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.539964:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.539969:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b1a9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.539978:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b1a9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.539991:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.539994:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.539999:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b1a9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.540005:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b1a9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.540020:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.540026:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1b0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.540032:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.540037:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.540040:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.540046:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.540053:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4100) 00010000:00010000:3.0:1763334966.540055:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.540058:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1b0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.540063:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1b0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.540100:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b1a2 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc69 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.540110:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.540113:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.540116:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b1a2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc69 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.540125:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067c00, rc 0) 00000100:00100000:3.0:1763334966.540208:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53038:x1848989694472192:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 580us (794us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334966.540216:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4699 00000100:00100000:1.0:1763334966.547111:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.547200:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694472320 00000100:00100000:3.0:1763334966.547215:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694472320 00000100:00100000:3.0:1763334966.547315:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4700 00000100:00100000:3.0:1763334966.547330:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53037:x1848989694472320:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.547357:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.547389:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b1b7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc70 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.547488:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b1be lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547508:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b1be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547520:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b1be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547538:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1c5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547545:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547551:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547813:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b1be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547822:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b1be lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547830:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b1be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547837:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.547842:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b1be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547850:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b1be lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547870:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.547874:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.547880:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b1be lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547886:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b1be lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547901:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547906:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1c5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547912:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547917:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.547919:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547925:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547932:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4800) 00010000:00010000:3.0:1763334966.547935:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.547937:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1c5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547942:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.547986:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b1b7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc70 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.547998:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.548001:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.548005:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b1b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc70 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.548015:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:3.0:1763334966.549998:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53037:x1848989694472320:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2653us (2884us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334966.550013:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4700 00000100:00100000:1.0:1763334966.555244:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.557747:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694472448 00000100:00100000:2.0:1763334966.557771:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694472448 00000100:00100000:2.0:1763334966.557853:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4701 00000100:00100000:2.0:1763334966.557863:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53037:x1848989694472448:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334966.557889:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.557916:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b1cc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc77 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.558003:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b1d3 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558020:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558032:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558047:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b1da lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558053:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b1da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558060:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b1da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558140:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b1d3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558147:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b1d3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558154:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b1d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558160:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.558165:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b1d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558173:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b1d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558187:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.558191:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.558196:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b1d3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558201:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b1d3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558215:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b1da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558220:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b1da lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558239:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b1da lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558244:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.558247:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b1da lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558261:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b1da lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558268:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334966.558270:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.558273:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b1da lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558278:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b1da lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334966.558317:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b1cc lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc77 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.558328:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.558330:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.558334:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b1cc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc77 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.558342:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8800, rc 0) 00000100:00100000:2.0:1763334966.558427:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53037:x1848989694472448:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 565us (3214us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334966.558436:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4701 00000100:00100000:0.0:1763334966.563830:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.563883:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.563989:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694472832 00000100:00100000:3.0:1763334966.564004:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694472832 00000100:00100000:3.0:1763334966.564088:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694472704 00000100:00100000:3.0:1763334966.564092:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694472704 00000100:00100000:3.0:1763334966.564125:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4702 00000100:00100000:3.0:1763334966.564138:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53037:x1848989694472832:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.564168:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.564198:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b1e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc85 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.564333:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1e8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.564354:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.564369:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334966.564477:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334966.564483:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334966.564515:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1e8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.564555:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b1e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc85 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.564611:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1e8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc85 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.564621:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.564626:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334966.564632:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:3.0:1763334966.564731:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53037:x1848989694472832:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 595us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334966.564740:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4702 00000100:00100000:3.0:1763334966.564770:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4703 00000100:00100000:3.0:1763334966.564778:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53039:x1848989694472704:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.564788:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.564796:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b1ef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc7e expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.564854:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b1f6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.564863:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b1f6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.564871:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b1f6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.564890:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1fd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.564896:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.564903:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.564958:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b1f6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.564966:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b1f6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.564973:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b1f6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.564980:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.564985:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b1f6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.564993:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b1f6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.565002:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.565008:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.565012:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b1f6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.565018:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b1f6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.565029:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.565035:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1fd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.565040:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.565045:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.565048:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.565053:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1fd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.565059:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4800) 00010000:00010000:3.0:1763334966.565061:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.565064:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1fd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.565069:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b1fd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.565097:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b1ef lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc7e expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.565108:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.565110:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763334966.565113:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b1ef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc7e expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.565122:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:3.0:1763334966.565148:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53039:x1848989694472704:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 372us (1265us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334966.565156:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4703 00000100:00100000:0.0:1763334966.574482:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.577692:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694473088 00000100:00100000:1.0:1763334966.577720:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694473088 00000100:00100000:1.0:1763334966.577852:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4704 00000100:00100000:1.0:1763334966.577867:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53037:x1848989694473088:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334966.577898:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.577904:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334966.577945:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b1e8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc85 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.577968:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.577975:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334966.577993:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b204 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc8c expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.578185:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b20b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.578203:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b20b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.578216:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b20b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.578244:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b212 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.578252:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b212 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.578259:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b212 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.578939:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b219 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.578951:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b219 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.578959:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b219 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334966.578971:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19f:0x0]: returning size 0 00010000:00010000:1.0:1763334966.579005:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b20b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.579013:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b20b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.579020:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b20b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.579026:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.579031:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b20b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.579039:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b20b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.579048:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.579052:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.579057:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b20b lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.579064:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b20b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:1.0:1763334966.579076:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007f673d43 reply state 00000000eed091de transno 8589938918 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b212 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334966.579086:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763334966.579120:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b204 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc8c expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.579136:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b219 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc8c expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.579143:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ad28fa300) 00010000:00010000:1.0:1763334966.579146:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334966.579148:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334966.579274:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53037:x1848989694473088:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1411us (4810us total) trans 8589938918 rc 0/0 00000100:00100000:1.0:1763334966.579283:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4704 00010000:00010000:3.0:1763334966.582414:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b212 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.584805:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b212 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.584818:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b212 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.584826:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.584888:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b212 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.584901:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b212 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.584926:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa400) 00010000:00010000:3.0:1763334966.584929:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.584935:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b212 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.584943:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b212 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334966.585105:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.586121:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694473344 00000100:00100000:3.0:1763334966.586139:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694473344 00000100:00100000:3.0:1763334966.586360:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4705 00000100:00100000:3.0:1763334966.586378:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53037:x1848989694473344:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.586419:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.586451:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b227 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc93 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.588893:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.588940:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b219 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc8c expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.588952:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 4/0,1 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.589017:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b219 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc8c expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.589040:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b219 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc8c expref: 186 pid: 32232 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.589061:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701838848:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334966.589234:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad82cc840 going to sleep for 11 seconds 00000100:00100000:1.0:1763334966.591788:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.592703:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694473600 00000100:00100000:0.0:1763334966.592720:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694473600 00000100:00100000:0.0:1763334966.592789:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4706 00000100:00100000:0.0:1763334966.592799:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53040:x1848989694473600:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334966.592824:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.593242:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b235 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afc9a expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334966.593964:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.593982:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701838848:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334966.594018:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334966.594097:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694473728 00000100:00100000:1.0:1763334966.594104:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694473728 00010000:00010000:1.0:1763334966.594136:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b219 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc8c expref: 189 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:0.0:1763334966.594207:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b23c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.594232:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b23c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334966.594241:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2523 00010000:00010000:0.0:1763334966.594245:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b23c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334966.594257:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19f:0x0]: returning size 0 00000100:00100000:1.0:1763334966.594366:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6beea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2359:x1848989694473728:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334966.594381:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334966.594388:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b219 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc8c expref: 190 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:0.0:1763334966.594391:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b23c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.594399:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b23c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.594445:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b23c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.594449:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b219 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc8c expref: 190 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:0.0:1763334966.594457:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.594469:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b219 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc8c expref: 190 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:0.0:1763334966.594469:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b23c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.594478:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b23c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.594487:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ad28fa300) 00010000:00010000:1.0:1763334966.594492:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.594500:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.594506:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.594513:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ad28fa300) 00010000:00010000:0.0:1763334966.594515:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763334966.594519:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b23c lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.594525:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b23c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.594535:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334966.594601:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b235 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc9a expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.594612:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334966.594615:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334966.594619:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b235 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc9a expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.594628:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:1.0:1763334966.594679:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6beea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:2359:x1848989694473728:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 428us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334966.594679:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53040:x1848989694473600:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1880us (2903us total) trans 8589938919 rc 301/301 00000100:00100000:1.0:1763334966.594689:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2523 00000100:00100000:0.0:1763334966.594689:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4706 00010000:00010000:3.0:1763334966.595496:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.595510:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334966.595527:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19f:0x0]: returning size 0 00000004:00080000:3.0:1763334966.595955:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x238:0x0], index 0: 0 00000004:00080000:3.0:1763334966.595966:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23c:0x0], index 1: 0 00000004:00080000:3.0:1763334966.595972:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23d:0x0], index 1: 0 00000004:00080000:3.0:1763334966.595977:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x239:0x0], index 0: 0 00010000:00010000:3.0:1763334966.596145:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.596155:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.596162:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.596168:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.596172:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.596179:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.596199:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ad28fa300) 00010000:00010000:3.0:1763334966.596202:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334966.596207:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.596212:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b22e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.596288:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b227 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc93 expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.596300:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.596303:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763334966.596307:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b227 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc93 expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.596318:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:3.0:1763334966.596390:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53037:x1848989694473344:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 10014us (11290us total) trans 8589938920 rc 301/301 00000100:00100000:3.0:1763334966.596400:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4705 00000100:00100000:2.0:1763334966.598988:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.599108:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694473984 00000100:00100000:1.0:1763334966.599123:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694473984 00000100:00100000:1.0:1763334966.599201:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1728 00000100:00100000:1.0:1763334966.599214:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01d10450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53040:x1848989694473984:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334966.600372:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01d10450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53040:x1848989694473984:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1152us (1391us total) trans 8589938921 rc 0/0 00000100:00100000:1.0:1763334966.600388:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1728 00000100:00100000:3.0:1763334966.600453:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.600475:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694474240 00000100:00100000:1.0:1763334966.600482:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694474240 00000100:00100000:1.0:1763334966.601135:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1729 00000100:00100000:1.0:1763334966.601149:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53037:x1848989694474240:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334966.601413:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53037:x1848989694474240:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 266us (958us total) trans 8589938922 rc 0/0 00000100:00100000:1.0:1763334966.601420:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1729 00000100:00100000:3.0:1763334966.602741:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.602925:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694474496 00000100:00100000:2.0:1763334966.602950:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694474496 00000100:00100000:2.0:1763334966.603016:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4707 00000100:00100000:2.0:1763334966.603027:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53040:x1848989694474496:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334966.603053:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.603081:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b251 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afca1 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334966.603095:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.603183:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694474752 00010000:00010000:2.0:1763334966.603184:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b258 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334966.603188:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694474752 00010000:00010000:2.0:1763334966.603202:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b258 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.603216:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b258 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.603244:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b25f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.603255:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b25f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.603262:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b25f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334966.603441:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1730 00000100:00100000:1.0:1763334966.603451:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53037:x1848989694474752:12345-192.168.201.60@tcp:35:lfs.0 00010000:00010000:2.0:1763334966.603455:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b266 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.603463:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b266 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.603470:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b266 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334966.603482:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19f:0x0]: returning size 0 00010000:00010000:2.0:1763334966.603618:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b258 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.603625:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b258 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.603632:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b258 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334966.603682:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53037:x1848989694474752:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 231us (585us total) trans 8589938923 rc 0/0 00000100:00100000:1.0:1763334966.603691:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1730 00010000:00010000:2.0:1763334966.604097:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.604104:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b258 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.604114:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b258 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.604129:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.604132:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.604139:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b258 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.604145:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b258 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.604157:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b25f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.604163:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b25f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.604169:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b25f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.604174:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.604176:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b25f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.604182:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b25f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.604189:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334966.604192:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.604194:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b25f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.604200:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b25f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.604266:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b251 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca1 expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.604281:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b266 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca1 expref: 191 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.604289:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334966.604291:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334966.604294:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8200, rc 0) 00000100:00100000:2.0:1763334966.604333:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53040:x1848989694474496:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1308us (1601us total) trans 8589938924 rc 0/0 00000100:00100000:2.0:1763334966.604340:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4707 00000100:00100000:3.0:1763334966.610105:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.612466:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694475136 00000100:00100000:2.0:1763334966.612488:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694475136 00000100:00100000:3.0:1763334966.612543:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.612590:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4708 00000100:00100000:2.0:1763334966.612603:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52274:x1848989694475136:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334966.612634:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.612665:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b274 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afcaf expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.612811:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.612829:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b266 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca1 expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.612839:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 4/0,1 mode: --/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.612881:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b266 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca1 expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.612897:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b266 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca1 expref: 192 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.612913:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6beca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701838976:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334966.613033:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad82cc840 going to sleep for 11 seconds 00000100:00100000:0.0:1763334966.613236:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694474880 00000100:00100000:0.0:1763334966.613242:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694474880 00000100:00100000:0.0:1763334966.613301:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4791 00000100:00100000:0.0:1763334966.613310:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694474880:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334966.613321:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.613340:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b282 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afca8 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334966.613364:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x238:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334966.613382:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.613385:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.613396:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b282 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca8 expref: 15 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334966.613412:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b282 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca8 expref: 15 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334966.613428:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334966.613465:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694474880:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 156us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334966.613472:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4791 00000100:00100000:0.0:1763334966.615905:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6beca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701838976:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334966.615943:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334966.616163:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.616664:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694475392 00000100:00100000:1.0:1763334966.616675:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694475392 00000100:00100000:1.0:1763334966.616746:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4709 00000100:00100000:1.0:1763334966.616756:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53040:x1848989694475392:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334966.616780:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.616804:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b289 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afcb6 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.616882:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b289 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcb6 expref: 194 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.616900:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b289 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcb6 expref: 194 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.616923:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:1.0:1763334966.616926:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334966.616930:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334966.617002:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53040:x1848989694475392:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 246us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.617010:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4709 00000100:00100000:2.0:1763334966.617644:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.617875:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694475264 00000100:00100000:1.0:1763334966.617883:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694475264 00010000:00010000:1.0:1763334966.617922:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b266 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca1 expref: 194 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:1.0:1763334966.617975:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2524 00000100:00100000:1.0:1763334966.617985:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2359:x1848989694475264:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334966.618002:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334966.618009:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b266 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca1 expref: 194 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334966.618024:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b266 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca1 expref: 194 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334966.618050:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b266 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca1 expref: 194 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334966.618068:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:1.0:1763334966.618073:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.618083:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.618090:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.618125:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334966.618167:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2359:x1848989694475264:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 182us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.618175:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2524 00010000:00010000:0.0:1763334966.618277:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.618286:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:0.0:1763334966.618313:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19f:0x0]: returning size 0 00010000:00010000:0.0:1763334966.618554:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b274 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcaf expref: 194 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.618630:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcaf expref: 193 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.618639:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:0.0:1763334966.618642:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763334966.618645:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8000, rc 0) 00000100:00100000:0.0:1763334966.618684:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52274:x1848989694475136:12345-192.168.201.60@tcp:101:bash.0 Request processed in 6084us (8596us total) trans 8589938925 rc 0/0 00000100:00100000:0.0:1763334966.618696:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4708 00000100:00100000:0.0:1763334966.627897:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.627995:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694475648 00000100:00100000:1.0:1763334966.628012:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694475648 00000100:00100000:1.0:1763334966.628106:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1731 00000100:00100000:1.0:1763334966.628119:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53040:x1848989694475648:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334966.628672:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53040:x1848989694475648:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 550us (785us total) trans 8589938926 rc 0/0 00000100:00100000:1.0:1763334966.628681:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1731 00000100:00100000:3.0:1763334966.629686:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.629837:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694475904 00000100:00100000:2.0:1763334966.629846:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694475904 00000100:00100000:2.0:1763334966.629898:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4710 00000100:00100000:2.0:1763334966.629907:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:52274:x1848989694475904:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:2.0:1763334966.630208:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b297 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.630245:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b297 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.630260:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b297 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:2.0:1763334966.630329:0:29627:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938927 00000004:00010000:2.0:1763334966.630360:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fc9db202 reply state 0000000002ba4128 transno 8589938928 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b297 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334966.630369:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334966.630478:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+197:52274:x1848989694475904:12345-192.168.201.60@tcp:36:bash.0 Request processed in 569us (795us total) trans 8589938928 rc 0/0 00000100:00100000:2.0:1763334966.630491:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4710 00000020:00080000:2.0:1763334966.630497:0:29627:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763334966.633862:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.634078:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694476160 00000100:00100000:1.0:1763334966.634094:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694476160 00000100:00100000:1.0:1763334966.634164:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4711 00000100:00100000:1.0:1763334966.634176:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53040:x1848989694476160:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334966.634210:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.634261:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b29e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afcbd expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.634378:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b2a5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634398:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b2a5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634411:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b2a5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634428:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b2ac lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634434:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b2ac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634439:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b2ac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634672:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b2b3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634684:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634692:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b2b3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334966.634706:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19f:0x0]: returning size 0 00010000:00010000:1.0:1763334966.634854:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b2a5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634863:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b2a5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634871:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b2a5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634878:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.634883:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b2a5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634893:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b2a5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634907:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.634911:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.634916:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b2a5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634923:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b2a5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634946:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b2ac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634950:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b2ac lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634956:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b2ac lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634960:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.634963:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b2ac lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634968:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b2ac lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634974:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fab00) 00010000:00010000:1.0:1763334966.634977:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.634979:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b2ac lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.634984:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b2ac lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.635035:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b29e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcbd expref: 200 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.635050:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b2b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcbd expref: 199 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.635058:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:1.0:1763334966.635062:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 18 00010000:00010000:1.0:1763334966.635065:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334966.635153:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53040:x1848989694476160:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 978us (1306us total) trans 8589938929 rc 0/0 00000100:00100000:1.0:1763334966.635163:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4711 00000100:00100000:3.0:1763334966.635544:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.635700:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694476416 00000100:00100000:2.0:1763334966.635711:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694476416 00000100:00100000:2.0:1763334966.635763:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4712 00000100:00100000:2.0:1763334966.635774:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:52274:x1848989694476416:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334966.635800:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.635803:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334966.635825:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b289 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcb6 expref: 199 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.635839:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334966.635843:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334966.635853:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b2c1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afcc4 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.635896:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.635906:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b297 lrc: 2/0,1 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.635914:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b2b3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcbd expref: 199 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.635921:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.635961:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b2b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcbd expref: 199 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.635977:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b2b3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcbd expref: 199 pid: 32232 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.635995:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6beca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701839104:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334966.636077:0:29627:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b297 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334966.636086:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2ffca80 going to sleep for 11 seconds 00010000:00010000:0.0:1763334966.637174:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b297 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.637190:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b297 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.637198:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b297 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.637205:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334966.637208:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b297 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.637215:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b297 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.637239:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:0.0:1763334966.637243:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.637246:0:3275:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.637255:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b297 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.637261:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b297 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334966.640473:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.640637:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6beca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701839104:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334966.640674:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334966.641822:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694476672 00000100:00100000:0.0:1763334966.641841:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694476672 00000100:00100000:2.0:1763334966.642135:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1732 00000100:00100000:2.0:1763334966.642149:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53040:x1848989694476672:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334966.643260:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53040:x1848989694476672:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1103us (2794us total) trans 8589938930 rc 0/0 00000100:00100000:2.0:1763334966.643274:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1732 00000100:00100000:2.0:1763334966.648948:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.649132:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.649249:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694476800 00000100:00100000:1.0:1763334966.649273:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694476800 00000100:00100000:1.0:1763334966.649360:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1733 00000100:00100000:1.0:1763334966.649373:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53040:x1848989694476800:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:1.0:1763334966.649634:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53040:x1848989694476800:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 262us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.649643:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1733 00000100:00100000:3.0:1763334966.650283:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694476928 00000100:00100000:3.0:1763334966.650291:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694476928 00010000:00010000:3.0:1763334966.650329:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b2b3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x18/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcbd expref: 200 pid: 32232 timeout: 1131 lvb_type: 0 00000100:00100000:3.0:1763334966.650376:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2525 00000100:00100000:3.0:1763334966.650387:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:2360:x1848989694476928:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334966.650402:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334966.650410:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b2b3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcbd expref: 200 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334966.650425:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b2b3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcbd expref: 200 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334966.650455:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b2b3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x18/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcbd expref: 200 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334966.650475:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:3.0:1763334966.650482:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.650495:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.650504:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.650553:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334966.650626:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:2360:x1848989694476928:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 240us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334966.650634:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2525 00010000:00010000:0.0:1763334966.651065:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.651076:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000040:00080000:0.0:1763334966.651728:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1098, 88 off94032 00000004:00080000:0.0:1763334966.651739:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1031285166459ns, next at 1031252687124ns, rc = 0 00000040:00080000:0.0:1763334966.651785:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1109, 88 off95120 00000004:00080000:0.0:1763334966.651790:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1031285218666ns, next at 1031252761634ns, rc = 0 00000040:00080000:0.0:1763334966.651818:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1110, 88 off95208 00000004:00080000:0.0:1763334966.651823:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1031285250936ns, next at 1031252761634ns, rc = 0 00000040:00080000:0.0:1763334966.651840:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1099, 88 off94120 00000004:00080000:0.0:1763334966.651844:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1031285271956ns, next at 1031252687124ns, rc = 0 00000100:00100000:2.0:1763334966.675259:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.675627:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694477184 00000100:00100000:0.0:1763334966.675643:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694477184 00000100:00100000:3.0:1763334966.678393:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4713 00000100:00100000:3.0:1763334966.678699:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53041:x1848989694477184:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.678733:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.678764:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b2cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afccb expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.678869:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b2d6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.678889:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b2d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.678904:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b2d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.678920:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b2dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.678926:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b2dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.678932:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b2dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679112:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b2e4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679122:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679130:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000004:00200000:3.0:1763334966.679142:0:29629:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19f:0x0]: returning size 2 00010000:00010000:3.0:1763334966.679319:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b2e4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679328:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b2e4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679334:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679340:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.679344:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b2e4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679352:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b2e4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679365:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:3.0:1763334966.679368:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1763334966.679374:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b2e4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679380:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b2e4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679396:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b2d6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679402:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b2d6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679406:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b2d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679415:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.679418:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b2d6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679425:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b2d6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679432:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.679434:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.679437:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b2d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679442:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b2d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679449:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b2dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679454:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b2dd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679459:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b2dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679463:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.679465:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b2dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679470:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b2dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679476:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4400) 00010000:00010000:3.0:1763334966.679479:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.679482:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b2dd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679487:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b2dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:3.0:1763334966.679538:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b2cf lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afccb expref: 202 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.679549:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.679552:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763334966.679555:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b2cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afccb expref: 202 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.679565:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:3.0:1763334966.679691:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53041:x1848989694477184:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1280us (4476us total) trans 8589938932 rc 301/301 00000100:00100000:3.0:1763334966.679701:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4713 00000100:00100000:0.0:1763334966.688734:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.689369:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694477312 00000100:00100000:1.0:1763334966.689387:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694477312 00000100:00100000:0.0:1763334966.689528:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4714 00000100:00100000:0.0:1763334966.689542:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53041:x1848989694477312:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334966.690555:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.690609:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b2f2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afcd2 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.690747:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.690768:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcaf expref: 202 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.690776:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.690797:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.690825:0:32232:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.691166:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcaf expref: 202 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.691185:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcaf expref: 202 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334966.691204:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701839232:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334966.691797:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeebed600 going to sleep for 11 seconds 00000100:00100000:0.0:1763334966.705813:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.705999:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694477440 00000100:00100000:2.0:1763334966.706013:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694477440 00010000:00010000:2.0:1763334966.706068:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcaf expref: 203 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.706113:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2526 00000100:00100000:2.0:1763334966.706126:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:2359:x1848989694477440:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334966.706148:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334966.706155:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcaf expref: 203 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.706171:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcaf expref: 203 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.706206:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334966.706212:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.706231:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.706239:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.706246:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334966.706769:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b27b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x19f:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcaf expref: 203 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:3.0:1763334966.706790:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701839232:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334966.706821:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334966.708100:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+202:2359:x1848989694477440:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1964us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.708115:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2526 00010000:00010000:1.0:1763334966.721625:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcc4 expref: 202 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.721649:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:1.0:1763334966.721652:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334966.721657:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.721669:0:29627:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.721675:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.721732:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b2c1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcc4 expref: 202 pid: 29627 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763334966.721760:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcc4 expref: 201 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.721813:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8a00, rc 0) 00010000:00010000:3.0:1763334966.721995:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.722005:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334966.722057:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19f:0x0]: returning size 2 00000004:00200000:3.0:1763334966.722064:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334966.722095:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.722130:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b2f2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19f:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcd2 expref: 202 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.722146:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcd2 expref: 201 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.722154:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:3.0:1763334966.722156:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334966.722159:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000001:00080000:0.0:1763334966.722275:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938931 is committed 00000004:00080000:0.0:1763334966.722283:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 719 committed 00000004:00080000:0.0:1763334966.722298:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 731 committed 00000004:00080000:0.0:1763334966.722307:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 730 committed 00000004:00080000:0.0:1763334966.722310:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 718 committed 00000100:00100000:1.0:1763334966.723501:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52274:x1848989694476416:12345-192.168.201.60@tcp:101:bash.0 Request processed in 87714us (87944us total) trans 8589938931 rc 0/0 00000100:00100000:1.0:1763334966.723516:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4712 00000100:00100000:1.0:1763334966.723771:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701839360:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334966.723858:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334966.723897:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701839872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334966.723924:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334966.723950:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763334966.723957:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701839744:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334966.723980:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334966.724015:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701839616:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334966.724036:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334966.724056:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1763334966.724061:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701839488:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334966.724080:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334966.724094:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701840000:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334966.724113:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334966.724141:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701839360 00000100:00100000:1.0:1763334966.724149:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701839360 00000100:00100000:1.0:1763334966.724195:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701839872 00000100:00100000:1.0:1763334966.724199:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701839872 00000100:00100000:1.0:1763334966.724214:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701839744 00000100:00100000:1.0:1763334966.724217:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701839744 00000100:00100000:1.0:1763334966.724246:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701839616 00000100:00100000:1.0:1763334966.724249:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701839616 00000100:00100000:1.0:1763334966.724264:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701839488 00000100:00100000:1.0:1763334966.724267:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701839488 00000100:00100000:1.0:1763334966.724277:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701840000 00000100:00100000:1.0:1763334966.724279:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701840000 00000100:00100000:1.0:1763334966.724293:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4792 00000100:00100000:1.0:1763334966.724302:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+53:3292:x1848989701839360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763334966.724334:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:570 count 1 00010000:00010000:1.0:1763334966.724368:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.724392:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b108 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc3f expref: 36 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.724401:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334966.724403:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334966.724407:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.724441:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b108 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc3f expref: 36 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.724456:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b108 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc3f expref: 36 pid: 32239 timeout: 1131 lvb_type: 0 00000100:00100000:1.0:1763334966.724470:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701840128:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334966.724671:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53041:x1848989694477312:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 35129us (35951us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334966.724680:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4714 00000100:00100000:3.0:1763334966.724721:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4793 00000100:00100000:3.0:1763334966.724729:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3292:x1848989701839872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334966.725030:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3292:x1848989701839872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 302us (1104us total) trans 17179871087 rc 0/0 00000100:00100000:3.0:1763334966.725036:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4793 00000100:00100000:3.0:1763334966.725049:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4794 00000100:00100000:3.0:1763334966.725055:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+53:3292:x1848989701839744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334966.725065:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:567 count 1 00010000:00010000:3.0:1763334966.725078:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.725091:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc31 expref: 36 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.725098:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334966.725099:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334966.725102:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.725119:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc31 expref: 36 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.725127:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc31 expref: 36 pid: 7819 timeout: 1131 lvb_type: 0 00000100:00100000:3.0:1763334966.725136:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701840256:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334966.725171:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeccf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334966.725189:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4795 00000100:00100000:3.0:1763334966.725196:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3290:x1848989701839616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334966.725206:0:6518:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:566 count 1 00010000:00010000:3.0:1763334966.725217:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.725240:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b0fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc38 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.725246:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334966.725248:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334966.725250:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.725267:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b0fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc38 expref: 36 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.725275:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b0fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc38 expref: 36 pid: 6517 timeout: 1131 lvb_type: 0 00000100:00100000:3.0:1763334966.725285:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701840384:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334966.725310:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeccf840 going to sleep for 11 seconds 00000100:00100000:0.0:1763334966.726496:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701840512:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.726549:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.726564:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701841024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.726611:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.726628:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763334966.726633:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701840896:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.726649:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334966.726740:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701840768:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334966.726769:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763334966.726812:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa5ad880/2, rc 0, transno 17179871087 00000100:00100000:2.0:1763334966.726820:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701839872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334966.726829:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1763334966.726834:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701840640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334966.726859:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334966.726869:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701841152:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334966.726885:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334966.726945:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701840512 00000100:00100000:0.0:1763334966.726953:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701840512 00000100:00100000:0.0:1763334966.726989:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701841024 00000100:00100000:0.0:1763334966.726992:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701841024 00000100:00100000:0.0:1763334966.727001:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701840896 00000100:00100000:0.0:1763334966.727004:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701840896 00000100:00100000:0.0:1763334966.727013:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701840768 00000100:00100000:0.0:1763334966.727015:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701840768 00000100:00100000:0.0:1763334966.727025:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701840640 00000100:00100000:0.0:1763334966.727028:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701840640 00000100:00100000:0.0:1763334966.727037:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701841152 00000100:00100000:0.0:1763334966.727039:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701841152 00000100:00100000:0.0:1763334966.727052:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4796 00000100:00100000:0.0:1763334966.727061:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3290:x1848989701839488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334966.727093:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:571 count 1 00002000:00010000:0.0:1763334966.727137:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334966.727147:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b315 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.727162:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.727165:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.727171:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.727187:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.727198:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b315 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.727206:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b315 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.727246:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334966.727592:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3290:x1848989701839488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 511us (3490us total) trans 17179871088 rc 0/0 00000100:00100000:0.0:1763334966.727602:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4796 00000100:00100000:0.0:1763334966.727622:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4797 00000100:00100000:0.0:1763334966.727629:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+53:3290:x1848989701840000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.727772:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+54:3290:x1848989701840000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 143us (3656us total) trans 17179871089 rc 0/0 00000100:00100000:0.0:1763334966.727778:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4797 00000100:00100000:0.0:1763334966.727790:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4798 00000100:00100000:0.0:1763334966.727795:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701840512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334966.727806:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:566 count 1 00010000:00010000:0.0:1763334966.727822:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.727838:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b12b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc46 expref: 14 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.727846:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334966.727847:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334966.727851:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.727879:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b12b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc46 expref: 14 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.727895:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b12b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc46 expref: 14 pid: 7819 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334966.727909:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701841280:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334966.727984:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa806cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334966.728010:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4799 00000100:00100000:0.0:1763334966.728018:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701841024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334966.728146:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x238:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334966.728150:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x238:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763334966.728152:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x238:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334966.728154:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x238:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763334966.728157:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x238:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334966.728181:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701841024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (1570us total) trans 21474838368 rc 0/0 00000100:00100000:0.0:1763334966.728186:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4799 00000100:00100000:0.0:1763334966.728199:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4800 00000100:00100000:0.0:1763334966.728204:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701840896:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334966.728213:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:563 count 1 00010000:00010000:0.0:1763334966.728235:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.728249:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b0d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc23 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.728255:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334966.728257:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334966.728260:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.728278:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b0d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc23 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.728287:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b0d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc23 expref: 14 pid: 6517 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334966.728297:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701841408:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334966.728321:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa8066c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334966.728343:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4801 00000100:00100000:0.0:1763334966.728350:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3292:x1848989701840768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334966.728362:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:562 count 1 00010000:00010000:0.0:1763334966.728374:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.728385:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ae61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb58 expref: 14 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.728392:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334966.728394:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334966.728396:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.728415:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ae61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb58 expref: 14 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.728428:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ae61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb58 expref: 14 pid: 21625 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334966.728437:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701841536:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334966.728463:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afa806b40 going to sleep for 11 seconds 00000004:00080000:0.0:1763334966.728561:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e14000/2, rc 0, transno 21474838368 00000100:00100000:0.0:1763334966.728593:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701841024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334966.728611:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7218e00/2, rc 0, transno 17179871088 00000100:00100000:0.0:1763334966.728616:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7218e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701839488:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763334966.728625:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab35c00/2, rc 0, transno 17179871089 00000100:00100000:0.0:1763334966.728629:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701840000:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.728653:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4802 00000100:00100000:0.0:1763334966.728660:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3292:x1848989701840640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334966.728674:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:567 count 1 00002000:00010000:0.0:1763334966.728695:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x237:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334966.728701:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b331 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.728709:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.728711:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.728715:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.728726:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.728736:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b331 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.728743:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.728762:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763334966.728999:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3292:x1848989701840640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 337us (2136us total) trans 21474838369 rc 0/0 00000100:00100000:0.0:1763334966.729006:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4802 00000100:00100000:0.0:1763334966.729024:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4803 00000100:00100000:0.0:1763334966.729031:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+16:3292:x1848989701841152:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.729164:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3292:x1848989701841152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 134us (2277us total) trans 21474838370 rc 0/0 00000100:00100000:0.0:1763334966.729172:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4803 00010000:00010000:2.0:1763334966.729615:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763334966.729627:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b315 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.729639:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334966.729644:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b315 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.729656:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b315 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.729678:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b315 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.729685:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792600/0xcedf0054f849b315 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.729709:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334966.729713:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.729719:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334966.729722:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b331 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.729733:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b331 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.729742:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b331 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.729748:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b331 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.729762:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.729764:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.729766:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334966.729807:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6bed880/2, rc 0, transno 21474838369 00000100:00100000:2.0:1763334966.729813:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701840640:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763334966.729824:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca871880/2, rc 0, transno 21474838370 00000100:00100000:2.0:1763334966.729828:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701841152:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1763334966.729843:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334966.729967:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c1e48cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334966.731263:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.731356:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694477568 00000100:00100000:1.0:1763334966.731368:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694477568 00000100:00100000:1.0:1763334966.731451:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4715 00000100:00100000:1.0:1763334966.731464:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53041:x1848989694477568:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334966.731493:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.731525:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b338 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afcd9 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.731750:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b338 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcd9 expref: 184 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.731770:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b338 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcd9 expref: 184 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.731794:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:1.0:1763334966.731797:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334966.731802:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334966.732270:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53041:x1848989694477568:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 806us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.732281:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4715 00000100:00100000:2.0:1763334966.741276:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.741372:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701841536:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334966.741414:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334966.741465:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.741500:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694477824 00000100:00100000:2.0:1763334966.741510:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694477824 00010000:00010000:2.0:1763334966.741568:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b0fa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc38 expref: 37 pid: 6517 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.741650:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2527 00000100:00100000:2.0:1763334966.741663:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2360:x1848989694477824:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334966.741689:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334966.741696:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b0fa lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc38 expref: 37 pid: 6517 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.741710:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b0fa lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc38 expref: 37 pid: 6517 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.741753:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.741756:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.741765:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.741778:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.741807:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334966.741885:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2360:x1848989694477824:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 224us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.741896:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2527 00000100:00100000:2.0:1763334966.741948:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.742109:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.742129:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.742172:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.742198:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.742220:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.742268:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.742291:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694478720 00000100:00100000:2.0:1763334966.742296:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694478720 00000100:00100000:2.0:1763334966.742329:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1734 00000100:00100000:2.0:1763334966.742336:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01d13850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53041:x1848989694478720:12345-192.168.201.60@tcp:35:lfs.0 00010000:00010000:0.0:1763334966.742366:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b0fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc38 expref: 36 pid: 6517 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334966.742387:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701840384:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334966.742409:0:6518:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334966.742698:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01d13850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53041:x1848989694478720:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 360us (523us total) trans 8589938933 rc 0/0 00000100:00100000:2.0:1763334966.742705:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1734 00000100:00100000:2.0:1763334966.742772:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694477952 00000100:00100000:2.0:1763334966.742776:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694477952 00010000:00010000:2.0:1763334966.742799:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b12b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc46 expref: 15 pid: 7819 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.742815:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694478080 00000100:00100000:2.0:1763334966.742817:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694478080 00010000:00010000:2.0:1763334966.742829:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b0d7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc23 expref: 16 pid: 6517 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.742839:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694478208 00000100:00100000:2.0:1763334966.742841:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694478208 00010000:00010000:2.0:1763334966.742853:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ae61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb58 expref: 17 pid: 21625 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.742862:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694478464 00000100:00100000:2.0:1763334966.742865:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694478464 00000100:00100000:2.0:1763334966.742878:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694478336 00000100:00100000:2.0:1763334966.742880:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694478336 00010000:00010000:2.0:1763334966.742892:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0de lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc31 expref: 36 pid: 7819 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.742902:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694478848 00000100:00100000:2.0:1763334966.742905:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694478848 00010000:00010000:2.0:1763334966.742915:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b108 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc3f expref: 37 pid: 32239 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.742927:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2528 00000100:00100000:2.0:1763334966.742933:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2361:x1848989694477952:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334966.742943:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334966.742947:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b12b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc46 expref: 17 pid: 7819 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.742957:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b12b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc46 expref: 17 pid: 7819 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.742977:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.742979:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.742984:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.742993:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743010:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334966.743031:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2361:x1848989694477952:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 98us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.743042:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2528 00000100:00100000:2.0:1763334966.743055:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2529 00000100:00100000:2.0:1763334966.743061:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694478080:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334966.743069:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334966.743075:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b0d7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc23 expref: 16 pid: 6517 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.743084:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b0d7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc23 expref: 16 pid: 6517 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.743098:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.743101:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.743104:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743111:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743122:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334966.743145:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694478080:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 83us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.743153:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2529 00000100:00100000:2.0:1763334966.743165:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2530 00000100:00100000:2.0:1763334966.743172:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2361:x1848989694478208:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334966.743179:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334966.743185:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ae61 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb58 expref: 15 pid: 21625 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.743195:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ae61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb58 expref: 15 pid: 21625 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.743207:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ae61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x232:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afb58 expref: 15 pid: 21625 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.743231:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.743233:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.743237:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743245:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743269:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334966.743289:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694478208:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 116us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.743295:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2530 00000100:00100000:2.0:1763334966.743308:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2531 00000100:00100000:2.0:1763334966.743314:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2360:x1848989694478336:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334966.743323:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334966.743326:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0de lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc31 expref: 37 pid: 7819 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.743335:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0de lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc31 expref: 37 pid: 7819 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.743351:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.743352:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.743356:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743363:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743374:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334966.743393:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2360:x1848989694478336:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 79us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.743399:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2531 00000100:00100000:2.0:1763334966.743411:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2532 00000100:00100000:2.0:1763334966.743417:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2360:x1848989694478848:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334966.743425:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334966.743430:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b108 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc3f expref: 36 pid: 32239 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.743441:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b108 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc3f expref: 36 pid: 32239 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.743453:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.743454:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.743458:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743470:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743481:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334966.743504:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2360:x1848989694478848:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 88us (1236us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.743510:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2532 00000100:00100000:2.0:1763334966.743525:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 390 00000100:00100000:2.0:1763334966.743531:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:2362:x1848989694478464:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334966.743542:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334966.743560:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b338 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19f:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcd9 expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743610:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334966.743616:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334966.743636:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2362:x1848989694478464:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 104us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.743641:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 390 00010000:00010000:2.0:1763334966.743691:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743702:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743714:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743723:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.743747:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334966.744174:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3292:x1848989701840768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15822us (17401us total) trans 21474838371 rc 0/0 00000100:00100000:2.0:1763334966.744183:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4801 00000100:00100000:2.0:1763334966.744202:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694477696 00000100:00100000:2.0:1763334966.744209:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694477696 00010000:00010000:3.0:1763334966.744344:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59c3abf000/0xcedf0054f849b0de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc31 expref: 35 pid: 7819 timeout: 1131 lvb_type: 0 00000100:00100000:3.0:1763334966.744360:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701840256:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334966.744382:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.744391:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.744398:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.744407:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.744415:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.744436:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1763334966.744683:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+54:3292:x1848989701839744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19626us (20700us total) trans 17179871090 rc 0/0 00000100:00100000:3.0:1763334966.744690:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4794 00010000:00010000:1.0:1763334966.745036:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763334966.745048:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745057:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334966.745062:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745078:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745096:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745103:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b32a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745125:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334966.745129:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745135:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334966.745138:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745145:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745157:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745165:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066800/0xcedf0054f849b307 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745184:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334966.745186:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334966.745189:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334966.745200:0:6518:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745209:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745217:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745237:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.745254:0:6518:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334966.745494:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+55:3290:x1848989701839616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20297us (21455us total) trans 17179871091 rc 0/0 00000100:00100000:1.0:1763334966.745504:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4795 00010000:00010000:0.0:1763334966.746369:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b12b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x236:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc46 expref: 14 pid: 7819 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334966.746401:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701841280:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334966.746429:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.746441:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.746449:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.746460:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.746468:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.746496:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763334966.746982:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701840512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19181us (20429us total) trans 21474838372 rc 0/0 00000100:00100000:0.0:1763334966.746996:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4798 00000100:00100000:2.0:1763334966.747256:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4804 00000100:00100000:2.0:1763334966.747418:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+13:52274:x1848989694477696:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334966.747444:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.747470:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b33f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afce0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.747604:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763334966.747617:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.747627:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334966.747633:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.747638:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b282 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca8 expref: 14 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334966.747651:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.747654:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.747659:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.747667:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b33f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce0 expref: 14 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.747686:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.747697:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b30e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.747718:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b282 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca8 expref: 14 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334966.747724:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334966.747734:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.747741:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b282 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca8 expref: 14 pid: 21625 timeout: 1131 lvb_type: 1 00010000:00010000:3.0:1763334966.747745:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334966.747752:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.747764:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334966.747766:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701841664:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334966.747785:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.747794:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b31c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.747812:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334966.747815:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334966.747817:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334966.747864:0:7819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b0d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x233:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc23 expref: 14 pid: 6517 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.747873:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5531240 going to sleep for 11 seconds 00000100:00100000:3.0:1763334966.747878:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:7819:1848989701841408:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334966.747904:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.747915:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.747927:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.747939:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.747947:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.747973:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334966.748011:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334966.748018:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.748027:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334966.748031:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.748039:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.748052:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.748059:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b323 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.748079:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.748081:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.748083:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334966.748131:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e14e00/2, rc 0, transno 21474838371 00000100:00100000:2.0:1763334966.748143:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701840768:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763334966.748168:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7219180/2, rc 0, transno 17179871090 00000100:00100000:2.0:1763334966.748175:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7219180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701839744:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763334966.749199:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334966.751515:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701840896:12345-0@lo:6:osp-syn-0-0.0 Request processed in 23295us (24849us total) trans 21474838373 rc 0/0 00000100:00100000:3.0:1763334966.751534:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4800 00010000:00010000:3.0:1763334966.751881:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763334966.752741:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6beea00/2, rc 0, transno 21474838372 00000100:00100000:1.0:1763334966.752756:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701840512:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1763334966.752781:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7218000/2, rc 0, transno 17179871091 00000100:00100000:1.0:1763334966.752785:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7218000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701839616:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1763334966.752803:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e15180/2, rc 0, transno 21474838373 00000100:00100000:1.0:1763334966.752807:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701840896:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1763334966.752870:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b108 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afc3f expref: 34 pid: 32239 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334966.752894:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701840128:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334966.752929:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.752943:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.752951:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.753338:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.753350:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.753688:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763334966.753963:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334966.753973:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.753982:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334966.753987:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.753998:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.754021:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.754030:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849b300 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.754056:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334966.754058:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334966.754060:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334966.754555:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb347850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+54:3292:x1848989701839360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30249us (30691us total) trans 17179871092 rc 0/0 00000004:00080000:2.0:1763334966.754562:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7219c00/2, rc 0, transno 17179871092 00000100:00100000:0.0:1763334966.754594:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4792 00000100:00100000:2.0:1763334966.754632:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7219c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701839360:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.755109:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.755156:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.755197:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694478976 00000100:00100000:1.0:1763334966.755207:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694478976 00000100:00100000:2.0:1763334966.755270:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701841664:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334966.755278:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4716 00000100:00100000:1.0:1763334966.755290:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53041:x1848989694478976:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334966.755309:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b33f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce0 expref: 13 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.755316:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763334966.755329:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694479104 00010000:00010000:2.0:1763334966.755333:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8000, rc 0) 00000100:00100000:3.0:1763334966.755335:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694479104 00010000:00010000:1.0:1763334966.755355:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b346 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afce7 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.755370:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b282 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca8 expref: 14 pid: 21625 timeout: 1131 lvb_type: 1 00000100:00100000:2.0:1763334966.755397:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+14:52274:x1848989694477696:12345-192.168.201.60@tcp:101:bash.0 Request processed in 8129us (14149us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334966.755407:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2533 00000100:00100000:2.0:1763334966.755409:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4804 00000100:00100000:3.0:1763334966.755421:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694479104:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334966.755436:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334966.755443:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b282 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x238:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca8 expref: 13 pid: 21625 timeout: 1131 lvb_type: 1 00010000:00010000:1.0:1763334966.755445:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b34d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.755470:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b282 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x238:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca8 expref: 13 pid: 21625 timeout: 1131 lvb_type: 1 00010000:00010000:1.0:1763334966.755472:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b34d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.755507:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b282 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x238:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afca8 expref: 13 pid: 21625 timeout: 1131 lvb_type: 1 00010000:00010000:3.0:1763334966.755524:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.755526:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.755535:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b33f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce0 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.755548:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b33f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce0 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.755618:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b33f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce0 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334966.755637:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701841792:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334966.755676:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b34d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.755698:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b354 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.755706:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b354 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.755713:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b354 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334966.755724:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeccf9c0 going to sleep for 11 seconds 00010000:00010000:1.0:1763334966.755854:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b35b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.755862:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b35b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.755869:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b35b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334966.755914:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x19f:0x0]: returning size 2 00000004:00200000:1.0:1763334966.755919:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334966.755938:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b35b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.755950:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b35b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.755959:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b34d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.755966:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b34d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.755973:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b34d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.755979:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.755985:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b34d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.755993:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b34d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.756004:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.756008:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.756013:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b34d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.756020:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b34d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.756031:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b354 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.756039:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b354 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.756044:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b354 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.756049:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.756052:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b354 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.756058:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b354 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.756065:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fab00) 00010000:00010000:1.0:1763334966.756068:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.756071:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b354 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.756076:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b354 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.756112:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b346 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce7 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.756126:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b35b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce7 expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.756133:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:1.0:1763334966.756136:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334966.756139:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334966.756182:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53041:x1848989694478976:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 895us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.756190:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4716 00000100:00100000:2.0:1763334966.763524:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.763548:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701841792:192.168.201.60@tcp:105: 00000100:00100000:0.0:1763334966.763611:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694479232 00010000:00010000:3.0:1763334966.763617:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334966.763624:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694479232 00000100:00100000:0.0:1763334966.764857:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4805 00000100:00100000:0.0:1763334966.764879:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+34:52274:x1848989694479232:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334966.764907:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.764941:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b362 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afcee expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334966.764981:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334966.765019:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.765022:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.765035:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcee expref: 35 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.765054:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcee expref: 35 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.765070:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334966.765149:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+35:52274:x1848989694479232:12345-192.168.201.60@tcp:101:bash.0 Request processed in 278us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.765154:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694479104:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 9733us (9993us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334966.765163:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4805 00000100:00100000:2.0:1763334966.765170:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2533 00000100:00100000:0.0:1763334966.769113:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.769168:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.771083:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694479488 00000100:00100000:2.0:1763334966.771083:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694479360 00000100:00100000:3.0:1763334966.771108:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694479488 00000100:00100000:2.0:1763334966.771108:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694479360 00002000:00010000:3.0:1763334966.771184:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/572 (0->18446744073709551615) 00002000:00010000:2.0:1763334966.771184:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/568 (0->18446744073709551615) 00002000:00100000:2.0:1763334966.771194:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a0380 with x1848989694479360 ext(0->18446744073709551615) 00002000:00100000:3.0:1763334966.771195:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a2300 with x1848989694479488 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334966.771215:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aef0a2300. 00002000:00010000:2.0:1763334966.771215:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aef0a0380. 00000100:00100000:3.0:1763334966.771284:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1742 00000100:00100000:3.0:1763334966.771297:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+35:2360:x1848989694479488:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:2.0:1763334966.771338:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1743 00000100:00100000:2.0:1763334966.771348:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694479360:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334966.771878:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334966.771878:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x238:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334966.771886:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23c:0x0] updating lvb mtime from disk: 0 -> 1763334967 00002000:00010000:2.0:1763334966.771887:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x238:0x0] updating lvb mtime from disk: 0 -> 1763334967 00002000:00010000:3.0:1763334966.771894:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334966.771895:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x238:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334966.771901:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23c:0x0] updating lvb ctime from disk: 0 -> 1763334967 00002000:00010000:2.0:1763334966.771902:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x238:0x0] updating lvb ctime from disk: 0 -> 1763334967 00002000:00010000:3.0:1763334966.771909:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23c:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:2.0:1763334966.771909:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x238:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334966.772007:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2360:x1848989694479488:12345-192.168.201.60@tcp:10:bash.0 Request processed in 711us (2909us total) trans 17179871093 rc 0/0 00000100:00100000:3.0:1763334966.772021:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1742 00002000:00010000:3.0:1763334966.772027:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/572 (0->18446744073709551615) 00002000:00100000:3.0:1763334966.772031:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a2300 with x1848989694479488 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334966.772036:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aef0a2300. 00000100:00100000:2.0:1763334966.772144:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694479360:12345-192.168.201.60@tcp:10:bash.0 Request processed in 797us (2976us total) trans 21474838374 rc 0/0 00000100:00100000:2.0:1763334966.772152:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1743 00002000:00010000:2.0:1763334966.772155:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/568 (0->18446744073709551615) 00002000:00100000:2.0:1763334966.772158:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a0380 with x1848989694479360 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334966.772163:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aef0a0380. 00000100:00100000:0.0:1763334966.776620:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.776781:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694479744 00000100:00100000:1.0:1763334966.776797:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694479744 00000100:00100000:1.0:1763334966.776875:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1735 00000100:00100000:1.0:1763334966.776889:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694479744:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:1.0:1763334966.777409:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694479744:12345-192.168.201.60@tcp:35:bash.0 Request processed in 520us (851us total) trans 8589938934 rc 0/0 00000100:00100000:1.0:1763334966.777420:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1735 00000100:00100000:2.0:1763334966.793189:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.793325:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694480000 00000100:00100000:1.0:1763334966.793340:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694480000 00000100:00100000:1.0:1763334966.793423:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4717 00000100:00100000:1.0:1763334966.793436:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53043:x1848989694480000:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:1.0:1763334966.793516:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1763334966.793555:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b2c8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x19f:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcc4 expref: 186 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.793632:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b35b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce7 expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.793645:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b2f9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x19f:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcd2 expref: 184 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.793656:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:1.0:1763334966.793670:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334966.793704:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b369 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.793724:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b369 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.793733:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b369 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.793749:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b370 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.793755:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b370 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.793761:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b370 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.793923:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b377 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.793931:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b377 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.793938:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b377 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:1.0:1763334966.794495:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1100, 64 off94184 00000004:00080000:1.0:1763334966.794504:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1031427931960ns, next at 1032427929403ns, rc = 0 00000040:00080000:1.0:1763334966.794549:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1111, 64 off95272 00000004:00080000:1.0:1763334966.794553:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1031427981453ns, next at 1032427980316ns, rc = 0 00000040:00080000:1.0:1763334966.794569:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1112, 64 off95336 00000040:00080000:1.0:1763334966.794643:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1101, 64 off94248 00010000:00010000:1.0:1763334966.794727:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b37e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794741:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b37e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794750:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b37e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794757:0:32232:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b37e lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794763:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b37e lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794769:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b37e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794784:0:32232:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334966.794807:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b377 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794813:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b377 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794819:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b377 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794825:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.794829:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b377 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794837:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b377 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794845:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ad28fa300) 00010000:00010000:1.0:1763334966.794849:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763334966.794853:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b377 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794859:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b377 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x19f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794925:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b369 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794932:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b369 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794937:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b369 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794942:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.794945:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b369 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794951:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b369 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794958:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.794961:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.794964:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b369 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.794970:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b369 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:1.0:1763334966.794980:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000008517916 reply state 00000000bedab9af transno 8589938935 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b370 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334966.794989:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334966.795109:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53043:x1848989694480000:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1671us (1931us total) trans 8589938935 rc 0/0 00000100:00100000:1.0:1763334966.795119:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4717 00010000:00010000:2.0:1763334966.796007:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334966.796022:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b37e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.796032:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334966.796036:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b37e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.796042:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b37e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.796058:0:5736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x19f:0x0].0x0 (ffff9a5ad28fa300) 00010000:00010000:2.0:1763334966.796061:0:5736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763334966.796065:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b37e lrc: 1/0,0 mode: --/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.796071:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b37e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x19f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.796094:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.796097:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.796099:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334966.802068:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.802162:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694480256 00000100:00100000:1.0:1763334966.802177:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694480256 00000100:00100000:1.0:1763334966.802266:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4718 00000100:00100000:1.0:1763334966.802278:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53042:x1848989694480256:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334966.802311:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.802342:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b385 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afcf5 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.802461:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b38c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.802480:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b38c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.802494:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b38c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.802506:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.802514:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b370 lrc: 2/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.802523:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.802545:0:29627:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b370 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.802556:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.803023:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b370 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.803037:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b370 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000020 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.803046:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b370 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.803052:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.803056:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b370 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.803065:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b370 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000020 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.803082:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fab00) 00010000:00010000:3.0:1763334966.803087:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.803091:0:3276:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.803100:0:3276:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.803107:0:3276:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.803151:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b370 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.803161:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b370 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000020 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.803174:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803183:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803286:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b38c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803293:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b38c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803299:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b38c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803304:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.803307:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b38c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803313:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b38c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803321:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.803324:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.803327:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b38c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803332:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b38c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803343:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803352:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803357:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803361:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.803364:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803369:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803375:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fab00) 00010000:00010000:1.0:1763334966.803378:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.803380:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803385:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b393 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.803438:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b385 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcf5 expref: 185 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.803450:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.803452:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334966.803456:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b385 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcf5 expref: 185 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.803464:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334966.804290:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53042:x1848989694480256:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2004us (2229us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334966.804305:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4718 00000100:00100000:0.0:1763334966.809561:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.809759:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694480384 00000100:00100000:1.0:1763334966.809774:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694480384 00000100:00100000:1.0:1763334966.809849:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4719 00000100:00100000:1.0:1763334966.809860:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53044:x1848989694480384:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334966.809887:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.809912:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b39a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afcfc expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.810023:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3a1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810043:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810056:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810071:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3a8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810078:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810088:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810178:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3a1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810185:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3a1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810193:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3a1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810198:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.810202:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3a1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810210:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3a1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810235:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.810240:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.810246:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3a1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810251:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3a1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810266:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810271:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3a8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810276:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3a8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810280:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.810283:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3a8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810288:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3a8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810296:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa400) 00010000:00010000:1.0:1763334966.810298:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.810301:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3a8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810306:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3a8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.810345:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b39a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcfc expref: 185 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.810355:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.810357:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.810360:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b39a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcfc expref: 185 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.810369:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334966.811133:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53044:x1848989694480384:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1265us (1583us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334966.811147:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4719 00000100:00100000:1.0:1763334966.814724:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.814832:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694480512 00000100:00100000:0.0:1763334966.814846:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694480512 00000100:00100000:0.0:1763334966.814921:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4720 00000100:00100000:0.0:1763334966.814935:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53042:x1848989694480512:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334966.814961:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.814991:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b3af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd03 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.815092:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b3b6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815110:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b3b6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815124:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b3b6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815139:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3bd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815146:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815152:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815246:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b3b6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815255:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b3b6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815262:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b3b6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815268:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334966.815273:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b3b6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815282:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b3b6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815301:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334966.815305:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.815310:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b3b6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815316:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b3b6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815333:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815339:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3bd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815345:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815350:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334966.815353:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815360:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815367:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60e00) 00010000:00010000:0.0:1763334966.815369:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.815372:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3bd lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815378:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3bd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.815417:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b3af lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd03 expref: 185 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.815429:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334966.815431:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.815435:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b3af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd03 expref: 185 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.815444:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334966.815536:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53042:x1848989694480512:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 602us (829us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334966.815544:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4720 00000100:00100000:2.0:1763334966.820825:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.822042:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694480640 00000100:00100000:0.0:1763334966.822060:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694480640 00000100:00100000:1.0:1763334966.823777:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4721 00000100:00100000:1.0:1763334966.823804:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53044:x1848989694480640:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334966.823834:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.823865:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b3c4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd0a expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.823969:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3cb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.823990:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824004:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824021:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3d2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824029:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824036:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824131:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3cb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824138:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3cb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824145:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824152:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.824157:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3cb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824166:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3cb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824180:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.824184:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.824191:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3cb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824198:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b3cb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824213:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3d2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824232:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3d2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824238:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824243:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.824246:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3d2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824252:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3d2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824260:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa400) 00010000:00010000:1.0:1763334966.824263:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.824265:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3d2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824271:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b3d2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.824309:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b3c4 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd0a expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.824321:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.825662:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.825682:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b3c4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd0a expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.825704:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:2.0:1763334966.827384:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53044:x1848989694480640:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3577us (6559us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334966.827401:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4721 00000100:00100000:2.0:1763334966.830482:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.830941:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.830981:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694480768 00000100:00100000:0.0:1763334966.830996:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694480768 00000100:00100000:0.0:1763334966.831058:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694481024 00000100:00100000:0.0:1763334966.831061:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694481024 00000100:00100000:0.0:1763334966.831095:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4722 00000100:00100000:0.0:1763334966.831108:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53044:x1848989694480768:12345-192.168.201.60@tcp:101:lfs.0 00000100:00100000:1.0:1763334966.831119:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4723 00000100:00100000:1.0:1763334966.831134:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53045:x1848989694481024:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334966.831138:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.831144:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.831174:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b3e0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd18 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.831174:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b3d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd11 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.831287:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b3e7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334966.831288:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3ee lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.831314:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b3e7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.831329:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b3e7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.831346:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b3f5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.831353:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.831360:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334966.832566:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334966.832602:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.832608:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b3e7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.832623:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b3e7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.832630:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b3e7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.832637:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.832642:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b3e7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.832651:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b3e7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.832666:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.832670:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.832677:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b3e7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334966.832677:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:0.0:1763334966.832685:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00010000:00010000:1.0:1763334966.832689:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b3e7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.832711:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334966.832717:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.832719:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b3f5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.832736:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.832741:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334966.832745:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.832755:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b3f5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.832764:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fab00) 00010000:00010000:0.0:1763334966.832767:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b3d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd11 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.832769:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334966.832774:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b3f5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334966.832783:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b3f5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334966.832790:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3ee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd11 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.832800:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334966.832803:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763334966.832807:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00010000:00010000:1.0:1763334966.832830:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b3e0 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd18 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.832842:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334966.832845:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334966.832849:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b3e0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd18 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.832859:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:0.0:1763334966.832931:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53044:x1848989694480768:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1823us (2462us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334966.832942:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4722 00000100:00100000:1.0:1763334966.834912:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53045:x1848989694481024:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3767us (3956us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334966.834926:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4723 00000100:00100000:0.0:1763334966.844729:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.845000:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694481280 00000100:00100000:3.0:1763334966.845015:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694481280 00000100:00100000:3.0:1763334966.845146:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4724 00000100:00100000:3.0:1763334966.845159:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53044:x1848989694481280:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.845186:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.845190:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334966.845235:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b3ee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd11 expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.845256:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.845261:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334966.845277:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b3fc lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd1f expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.845446:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b403 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.845460:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b403 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.845469:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b403 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.845479:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b40a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.845484:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b40a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.845488:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b40a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.846142:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b411 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.846153:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b411 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.846163:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b411 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334966.846174:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 0 00010000:00010000:3.0:1763334966.846208:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b403 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.846216:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b403 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.846236:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b403 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.846242:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.846247:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b403 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.846257:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b403 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.846266:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.846268:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.846272:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b403 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.846282:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b403 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:3.0:1763334966.846292:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000007fb29fa reply state 000000003ded2037 transno 8589938936 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b40a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334966.846302:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763334966.846339:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b3fc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd1f expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.846353:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b411 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd1f expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.846360:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4800) 00010000:00010000:3.0:1763334966.846362:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334966.846364:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:3.0:1763334966.847129:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6452680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53044:x1848989694481280:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1968us (2409us total) trans 8589938936 rc 0/0 00000100:00100000:3.0:1763334966.847141:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4724 00010000:00010000:0.0:1763334966.848510:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b40a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334966.848528:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b40a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334966.848537:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b40a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334966.848544:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334966.848549:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b40a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334966.848558:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b40a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334966.848605:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334966.848609:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334966.848613:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b40a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334966.848621:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b40a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334966.854513:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.854892:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694481536 00000100:00100000:3.0:1763334966.854907:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694481536 00000100:00100000:3.0:1763334966.854993:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4725 00000100:00100000:3.0:1763334966.855005:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53044:x1848989694481536:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.855039:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.855069:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b41f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd26 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.855211:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.855242:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b411 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd1f expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.855252:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.855850:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b411 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd1f expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.855876:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b411 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd1f expref: 187 pid: 30972 timeout: 1131 lvb_type: 0 00000100:00100000:3.0:1763334966.855895:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701841920:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334966.856026:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeccf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334966.856408:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.856493:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694481792 00000100:00100000:2.0:1763334966.856503:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694481792 00000100:00100000:2.0:1763334966.856722:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4726 00000100:00100000:2.0:1763334966.856735:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53046:x1848989694481792:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334966.856755:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.856778:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b42d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd2d expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.856889:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b434 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.856904:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b434 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.856919:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b434 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334966.856933:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 0 00010000:00010000:2.0:1763334966.857088:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b434 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.857097:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b434 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.857104:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b434 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.857115:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.857120:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b434 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.857129:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b434 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.857145:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4800) 00010000:00010000:2.0:1763334966.857149:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334966.857154:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b434 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.857160:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b434 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.857210:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b42d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd2d expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.857232:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.857234:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334966.857239:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b42d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd2d expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.857248:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8800, rc 0) 00000100:00100000:2.0:1763334966.857318:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53046:x1848989694481792:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 586us (911us total) trans 8589938937 rc 301/301 00000100:00100000:2.0:1763334966.857326:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4726 00000100:00100000:2.0:1763334966.860436:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.860477:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.860506:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694481920 00000100:00100000:0.0:1763334966.860519:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694481920 00010000:00010000:0.0:1763334966.860616:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b411 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd1f expref: 189 pid: 30972 timeout: 1131 lvb_type: 0 00000100:00100000:3.0:1763334966.860619:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701841920:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334966.860656:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334966.860670:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2534 00000100:00100000:0.0:1763334966.860683:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2359:x1848989694481920:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334966.860702:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334966.860710:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b411 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd1f expref: 189 pid: 30972 timeout: 1131 lvb_type: 0 00010000:00010000:0.0:1763334966.860775:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b411 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd1f expref: 189 pid: 30972 timeout: 1131 lvb_type: 0 00010000:00010000:0.0:1763334966.860806:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b411 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd1f expref: 189 pid: 30972 timeout: 1131 lvb_type: 0 00010000:00010000:0.0:1763334966.860828:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4800) 00010000:00010000:0.0:1763334966.860833:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334966.860844:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334966.860853:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334966.860882:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334966.860945:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:2359:x1848989694481920:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 264us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334966.860953:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2534 00000100:00100000:1.0:1763334966.861216:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694482176 00000100:00100000:1.0:1763334966.861234:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694482176 00000100:00100000:2.0:1763334966.861319:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1736 00000100:00100000:2.0:1763334966.861331:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53046:x1848989694482176:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334966.861652:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53046:x1848989694482176:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 323us (1172us total) trans 8589938938 rc 0/0 00000100:00100000:2.0:1763334966.861659:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1736 00010000:00010000:3.0:1763334966.861916:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.861926:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334966.861945:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 0 00000004:00080000:3.0:1763334966.862338:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23e:0x0], index 1: 0 00000004:00080000:3.0:1763334966.862350:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23a:0x0], index 0: 0 00000004:00080000:3.0:1763334966.862356:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23b:0x0], index 0: 0 00000004:00080000:3.0:1763334966.862362:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23f:0x0], index 1: 0 00010000:00010000:3.0:1763334966.862549:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.862558:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.862566:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.862622:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.862628:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.862636:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.862652:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4800) 00010000:00010000:3.0:1763334966.862656:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334966.862661:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.862667:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b426 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.862733:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b41f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd26 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.862746:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.862749:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763334966.862753:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b41f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd26 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.862762:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:3.0:1763334966.862818:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6450a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53044:x1848989694481536:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7815us (8322us total) trans 8589938939 rc 301/301 00000100:00100000:3.0:1763334966.862827:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4725 00000100:00100000:0.0:1763334966.869393:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.869518:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694482688 00000100:00100000:3.0:1763334966.869532:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694482688 00000100:00100000:3.0:1763334966.869652:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4727 00000100:00100000:3.0:1763334966.869666:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53046:x1848989694482688:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.869709:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.869750:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b449 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd34 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.869873:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b450 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.869891:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b450 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.869907:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b450 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.869927:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b457 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.869933:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b457 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.869940:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b457 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870124:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b45e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870136:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b45e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870143:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b45e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870293:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b450 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870301:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b450 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870308:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b450 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870314:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.870318:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b450 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870326:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b450 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870338:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.870342:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.870348:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b450 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870355:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b450 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870369:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b457 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870374:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b457 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870380:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b457 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870385:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.870388:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b457 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870393:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b457 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870399:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4100) 00010000:00010000:3.0:1763334966.870402:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.870404:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b457 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870409:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b457 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334966.870458:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b449 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd34 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.870472:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b45e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd34 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.870479:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:3.0:1763334966.870482:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334966.870484:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:3.0:1763334966.870619:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6450700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53046:x1848989694482688:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 955us (1240us total) trans 8589938940 rc 0/0 00000100:00100000:3.0:1763334966.870628:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4727 00000100:00100000:2.0:1763334966.871866:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.871935:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694482432 00000100:00100000:1.0:1763334966.871948:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694482432 00000100:00100000:1.0:1763334966.872013:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1737 00000100:00100000:1.0:1763334966.872024:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53044:x1848989694482432:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334966.874260:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53044:x1848989694482432:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 2221us (2395us total) trans 8589938941 rc 0/0 00000100:00100000:1.0:1763334966.874277:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1737 00000100:00100000:0.0:1763334966.878255:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.878362:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694482816 00000100:00100000:1.0:1763334966.878376:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694482816 00000100:00100000:1.0:1763334966.878515:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4806 00000100:00100000:1.0:1763334966.878528:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2359:x1848989694482816:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334966.878553:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.878614:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b46c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd3b expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334966.878647:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334966.878672:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334966.878674:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334966.878687:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b46c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd3b expref: 37 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334966.878709:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b46c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd3b expref: 37 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334966.878867:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334966.878943:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2359:x1848989694482816:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 417us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.878951:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4806 00000100:00100000:1.0:1763334966.881689:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.881937:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694483072 00000100:00100000:2.0:1763334966.881952:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694483072 00000100:00100000:2.0:1763334966.882437:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1738 00000100:00100000:2.0:1763334966.882451:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53044:x1848989694483072:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334966.882819:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53044:x1848989694483072:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 370us (1143us total) trans 8589938942 rc 0/0 00000100:00100000:2.0:1763334966.882828:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1738 00000100:00100000:0.0:1763334966.883415:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.884562:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694483328 00000100:00100000:1.0:1763334966.884589:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694483328 00000100:00100000:1.0:1763334966.884640:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1739 00000100:00100000:1.0:1763334966.884650:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53046:x1848989694483328:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334966.885039:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53046:x1848989694483328:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 389us (1626us total) trans 8589938943 rc 0/0 00000100:00100000:1.0:1763334966.885047:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1739 00000100:00100000:0.0:1763334966.887500:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.887700:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694483712 00000100:00100000:2.0:1763334966.887714:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694483712 00000100:00100000:2.0:1763334966.887808:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4728 00000100:00100000:2.0:1763334966.887819:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52274:x1848989694483712:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334966.887851:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763334966.887869:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334966.887880:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b473 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd42 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334966.887971:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694483840 00000100:00100000:1.0:1763334966.887976:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694483840 00000100:00100000:1.0:1763334966.888016:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4729 00000100:00100000:1.0:1763334966.888023:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53046:x1848989694483840:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334966.888028:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.888031:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.888040:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b481 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd49 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.888045:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b45e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd34 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.888063:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.888079:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b488 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.888086:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b488 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.888093:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b488 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.888105:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b45e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd34 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.888120:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b45e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd34 expref: 196 pid: 30972 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.888136:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a22300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701842048:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334966.888254:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac55310c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334966.891385:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.891441:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a22300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701842048:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334966.891478:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334966.891665:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694483968 00000100:00100000:3.0:1763334966.891675:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694483968 00010000:00010000:2.0:1763334966.891899:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b45e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd34 expref: 197 pid: 30972 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.891945:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2535 00000100:00100000:2.0:1763334966.891954:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694483968:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334966.891975:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334966.891981:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b45e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd34 expref: 197 pid: 30972 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.891997:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b45e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd34 expref: 197 pid: 30972 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.892026:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b45e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd34 expref: 197 pid: 30972 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.892044:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:2.0:1763334966.892049:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.892059:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.892066:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.892073:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b488 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.892079:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b488 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.892084:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b488 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334966.892121:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334966.892185:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694483968:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 230us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.892193:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2535 00010000:00010000:3.0:1763334966.892247:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.892256:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334966.892281:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 0 00010000:00010000:3.0:1763334966.892502:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b473 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd42 expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.892516:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b488 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.892524:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd42 expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.892528:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b488 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.892543:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:3.0:1763334966.892548:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763334966.892551:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9800, rc 0) 00000004:00200000:1.0:1763334966.892551:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 0 00000100:00100000:3.0:1763334966.892644:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:52274:x1848989694483712:12345-192.168.201.60@tcp:101:bash.0 Request processed in 4827us (5157us total) trans 8589938944 rc 0/0 00000100:00100000:3.0:1763334966.892653:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4728 00010000:00010000:1.0:1763334966.892661:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b481 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd49 expref: 198 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.892677:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b488 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd49 expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.892684:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334966.892686:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334966.892689:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:1.0:1763334966.892710:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53046:x1848989694483840:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4688us (4842us total) trans 8589938945 rc 0/0 00000100:00100000:1.0:1763334966.892716:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4729 00000100:00100000:3.0:1763334966.897051:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.897104:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.897117:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694484224 00000100:00100000:2.0:1763334966.897131:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694484224 00000100:00100000:3.0:1763334966.897151:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.897190:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694484608 00000100:00100000:3.0:1763334966.897195:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694484608 00000100:00100000:2.0:1763334966.897213:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 391 00000100:00100000:2.0:1763334966.897236:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2360:x1848989694484224:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1763334966.897246:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1740 00000100:00100000:3.0:1763334966.897256:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeb2a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53046:x1848989694484608:12345-192.168.201.60@tcp:35:lfs.0 00010000:00010000:2.0:1763334966.897271:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334966.897305:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b488 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd49 expref: 197 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.897326:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:2.0:1763334966.897331:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334966.897391:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2360:x1848989694484224:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 169us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.897398:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 391 00000100:00100000:3.0:1763334966.897523:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeb2a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53046:x1848989694484608:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 265us (368us total) trans 8589938946 rc 0/0 00000100:00100000:3.0:1763334966.897532:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1740 00000100:00100000:1.0:1763334966.897534:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694484480 00000100:00100000:1.0:1763334966.897540:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694484480 00000100:00100000:1.0:1763334966.897599:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4730 00000100:00100000:1.0:1763334966.897607:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:52274:x1848989694484480:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1763334966.897841:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b49d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.897857:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b49d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.897867:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b49d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:1.0:1763334966.897915:0:29627:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938947 00000004:00010000:1.0:1763334966.897934:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007308967b reply state 00000000e82639a3 transno 8589938948 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b49d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334966.897943:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334966.897988:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:52274:x1848989694484480:12345-192.168.201.60@tcp:36:bash.0 Request processed in 382us (884us total) trans 8589938948 rc 0/0 00000100:00100000:1.0:1763334966.897994:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4730 00000020:00080000:1.0:1763334966.897998:0:29627:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763334966.901275:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.901654:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694484736 00000100:00100000:0.0:1763334966.901669:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694484736 00000100:00100000:0.0:1763334966.901797:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1741 00000100:00100000:0.0:1763334966.901812:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53046:x1848989694484736:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:0.0:1763334966.902011:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53046:x1848989694484736:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 203us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334966.902020:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1741 00010000:00010000:3.0:1763334966.902957:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b49d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.902973:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b49d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.902984:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b49d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334966.902994:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334966.902997:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.903004:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b49d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.903012:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b49d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334966.903197:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694484864 00000100:00100000:0.0:1763334966.903206:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694484864 00010000:00010000:3.0:1763334966.903261:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:3.0:1763334966.903266:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.903275:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b49d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334966.903279:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4731 00010000:00010000:3.0:1763334966.903289:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b49d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334966.903294:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:52274:x1848989694484864:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334966.903327:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.903351:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b4a4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd50 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.903409:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd50 expref: 199 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.903424:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b4a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd50 expref: 199 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.903444:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334966.903447:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334966.903450:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334966.903507:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:52274:x1848989694484864:12345-192.168.201.60@tcp:101:bash.0 Request processed in 217us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334966.903515:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4731 00000100:00100000:0.0:1763334966.911411:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.911515:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694485120 00000100:00100000:1.0:1763334966.911531:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694485120 00000100:00100000:1.0:1763334966.911633:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4732 00000100:00100000:1.0:1763334966.911644:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+199:52274:x1848989694485120:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334966.911670:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334966.911674:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334966.911706:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b4a4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd50 expref: 199 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.911727:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334966.911733:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334966.911749:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b4ab lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd57 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.911809:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b4b2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.911822:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b4b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334966.911832:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b4b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:1.0:1763334966.915118:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1113, 88 off95424 00000004:00080000:1.0:1763334966.915161:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1031548588344ns, next at 1032427980316ns, rc = 0 00000040:00080000:1.0:1763334966.915300:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1102, 88 off94336 00000004:00080000:1.0:1763334966.915307:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1031548734804ns, next at 1032427929403ns, rc = 0 00000040:00080000:1.0:1763334966.915331:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1103, 88 off94424 00000004:00080000:1.0:1763334966.915335:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1031548763003ns, next at 1032427929403ns, rc = 0 00000040:00080000:1.0:1763334966.915361:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1114, 88 off95512 00000004:00080000:1.0:1763334966.915365:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1031548792884ns, next at 1032427980316ns, rc = 0 00000100:00100000:3.0:1763334966.921476:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.921542:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694485376 00000100:00100000:3.0:1763334966.921557:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694485376 00000100:00100000:3.0:1763334966.921648:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4733 00000100:00100000:3.0:1763334966.921660:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53047:x1848989694485376:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.921694:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.921725:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b4b9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd5e expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.921824:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4c0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.921843:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.921858:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.921876:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.921883:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.921889:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.922107:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4ce lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.922116:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.922123:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334966.922136:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 2 00010000:00010000:3.0:1763334966.924754:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4ce lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.924785:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4ce lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.924794:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.924802:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.924809:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4ce lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.924818:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4ce lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.924843:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:3.0:1763334966.925133:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:3.0:1763334966.925143:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4ce lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925151:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4ce lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925175:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4c0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925181:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4c0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925187:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4c0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925193:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.925196:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4c0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925206:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4c0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925227:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.925231:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.925236:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4c0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925242:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4c0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925254:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925260:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4c7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925266:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925271:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334966.925274:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925280:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925288:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4100) 00010000:00010000:3.0:1763334966.925291:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334966.925294:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4c7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925300:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4c7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.925376:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b4b9 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd5e expref: 203 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.925391:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334966.925394:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763334966.925398:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b4b9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd5e expref: 203 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.925408:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067c00, rc 0) 00000100:00100000:3.0:1763334966.925632:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53047:x1848989694485376:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3972us (4175us total) trans 8589938950 rc 301/301 00000100:00100000:3.0:1763334966.925644:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4733 00000100:00100000:0.0:1763334966.934985:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.935021:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694485504 00000100:00100000:3.0:1763334966.935036:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694485504 00000100:00100000:3.0:1763334966.935106:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4734 00000100:00100000:3.0:1763334966.935117:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53047:x1848989694485504:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334966.935188:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334966.935489:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b4dc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd65 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.935651:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.935669:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd42 expref: 203 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.935677:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b4b2 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.935685:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334966.935707:0:29627:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b4b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334966.935740:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd42 expref: 203 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.935759:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd42 expref: 203 pid: 32232 timeout: 1131 lvb_type: 0 00000100:00100000:3.0:1763334966.935776:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701842176:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334966.935897:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeccf840 going to sleep for 11 seconds 00000100:00100000:0.0:1763334966.938435:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701842176:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334966.938476:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334966.939648:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.940444:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694485632 00000100:00100000:1.0:1763334966.940464:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694485632 00010000:00010000:1.0:1763334966.940526:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd42 expref: 204 pid: 32232 timeout: 1131 lvb_type: 0 00000100:00100000:1.0:1763334966.940607:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2536 00000100:00100000:1.0:1763334966.940619:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2359:x1848989694485632:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334966.940638:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334966.940646:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd42 expref: 204 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334966.940660:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd42 expref: 204 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334966.940689:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b47a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd42 expref: 204 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334966.940710:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334966.940716:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.940726:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.940736:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.940743:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334966.940809:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:2359:x1848989694485632:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 192us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.940816:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2536 00000001:00080000:0.0:1763334966.961145:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938949 is committed 00000004:00080000:0.0:1763334966.961165:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 734 committed 00000004:00080000:0.0:1763334966.961183:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 722 committed 00000004:00080000:0.0:1763334966.961196:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 721 committed 00000004:00080000:0.0:1763334966.961199:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 733 committed 00000004:00080000:0.0:1763334966.961228:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 732 committed 00000004:00080000:0.0:1763334966.961231:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 720 committed 00010000:00010000:1.0:1763334966.961393:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b4b2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd57 expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.961412:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334966.961416:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334966.961420:0:32232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.961431:0:32232:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.961437:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334966.961492:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b4ab lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd57 expref: 185 pid: 32232 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763334966.961515:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b4b2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd57 expref: 184 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.961564:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334966.961713:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:52274:x1848989694485120:12345-192.168.201.60@tcp:101:bash.0 Request processed in 50068us (50313us total) trans 8589938949 rc 0/0 00000100:00100000:1.0:1763334966.961728:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4732 00010000:00010000:0.0:1763334966.961968:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.961978:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:0.0:1763334966.962019:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 2 00000004:00200000:0.0:1763334966.962024:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334966.962048:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334966.962083:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b4dc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd65 expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.962099:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd65 expref: 183 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.962107:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334966.962109:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1763334966.962112:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:0.0:1763334966.962158:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53047:x1848989694485504:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 27042us (27184us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334966.962166:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4734 00000100:00100000:3.0:1763334966.962239:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701842688:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334966.962301:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701842304:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.962851:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701842432:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334966.962923:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334966.962961:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701842816:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334966.962982:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334966.963005:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334966.963009:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334966.963015:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701843200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334966.963046:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334966.963063:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701842560:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334966.963088:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701842304 00000100:00100000:3.0:1763334966.963097:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334966.963097:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701842304 00000100:00100000:3.0:1763334966.963123:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701843072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334966.963146:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701842816 00000100:00100000:3.0:1763334966.963151:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334966.963151:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701842816 00000100:00100000:2.0:1763334966.963180:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701842688 00000100:00100000:2.0:1763334966.963183:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701842688 00000100:00100000:3.0:1763334966.963192:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701843200 00000100:00100000:3.0:1763334966.963198:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701843200 00000100:00100000:2.0:1763334966.963205:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701842560 00000100:00100000:2.0:1763334966.963210:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701842560 00000100:00100000:3.0:1763334966.963245:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701843072 00000100:00100000:3.0:1763334966.963249:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701843072 00000100:00100000:0.0:1763334966.963463:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334966.963535:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701842432 00000100:00100000:3.0:1763334966.963541:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701842432 00000100:00100000:0.0:1763334966.963558:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701842944:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334966.963568:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4807 00000100:00100000:3.0:1763334966.963603:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+20:3292:x1848989701842304:12345-0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334966.963613:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1763334966.963637:0:25383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:568 count 1 00010000:00010000:3.0:1763334966.963669:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334966.963678:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701842944 00000100:00100000:2.0:1763334966.963683:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701842944 00010000:00010000:3.0:1763334966.963693:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b33f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce0 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.963703:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:2.0:1763334966.963706:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4808 00000100:00100000:2.0:1763334966.963713:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3292:x1848989701842816:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763334966.963729:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:572 count 1 00010000:00010000:2.0:1763334966.963748:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.963763:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcee expref: 36 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.963770:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334966.963772:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334966.963776:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.963809:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcee expref: 36 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.963823:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcee expref: 36 pid: 21625 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.963835:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701843328:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334966.963903:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5531e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334966.963923:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4809 00000100:00100000:2.0:1763334966.963930:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3291:x1848989701842688:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334966.964242:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3291:x1848989701842688:12345-0@lo:2:osp-syn-0-0.0 Request processed in 311us (1235us total) trans 21474838375 rc 0/0 00000100:00100000:2.0:1763334966.964249:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4809 00000100:00100000:2.0:1763334966.964271:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4810 00000100:00100000:2.0:1763334966.964278:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3292:x1848989701843200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334966.964420:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3292:x1848989701843200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 142us (1373us total) trans 17179871094 rc 0/0 00000100:00100000:2.0:1763334966.964427:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4810 00000100:00100000:2.0:1763334966.964442:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4811 00000100:00100000:2.0:1763334966.964448:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3290:x1848989701842560:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334966.964562:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3290:x1848989701842560:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (1465us total) trans 21474838376 rc 0/0 00000100:00100000:2.0:1763334966.964595:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4811 00010000:00010000:3.0:1763334966.964596:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334966.964603:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 4/0,1 mode: --/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334966.964614:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4812 00000100:00100000:2.0:1763334966.964623:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3290:x1848989701843072:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763334966.964638:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b33f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce0 expref: 12 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.964650:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b33f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce0 expref: 12 pid: 32241 timeout: 1131 lvb_type: 0 00000100:00100000:3.0:1763334966.964664:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701843456:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334966.964699:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeccf840 going to sleep for 11 seconds 00000100:00100000:3.0:1763334966.964723:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4813 00000100:00100000:3.0:1763334966.964732:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3289:x1848989701842432:12345-0@lo:6:osp-syn-0-0.0 00002000:00010000:2.0:1763334966.964735:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334966.964740:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1763334966.964743:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00080000:3.0:1763334966.964746:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:569 count 1 00002000:00010000:2.0:1763334966.964747:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1763334966.964753:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:3.0:1763334966.964776:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x239:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334966.964784:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4f8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334966.964785:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3290:x1848989701843072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 162us (1634us total) trans 17179871095 rc 0/0 00000100:00100000:2.0:1763334966.964801:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4812 00010000:00010000:3.0:1763334966.964812:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.964814:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.964819:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334966.964824:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4814 00000100:00100000:2.0:1763334966.964836:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3289:x1848989701842944:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1763334966.964839:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00080000:2.0:1763334966.964851:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:573 count 1 00010000:00010000:3.0:1763334966.964863:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4f8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334966.964869:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334966.964877:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.964878:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b4ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.964901:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.964904:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.964907:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b4ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.964916:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334966.964918:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b4ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.964928:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b4ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.964936:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b4ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.964953:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763334966.965211:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3289:x1848989701842944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 376us (1597us total) trans 17179871096 rc 0/0 00000100:00100000:2.0:1763334966.965230:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4814 00000100:00100000:3.0:1763334966.965246:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3289:x1848989701842432:12345-0@lo:6:osp-syn-0-0.0 Request processed in 515us (1782us total) trans 21474838377 rc 0/0 00000100:00100000:3.0:1763334966.965256:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4813 00010000:00010000:2.0:1763334966.965287:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763334966.965294:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.965303:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334966.965308:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4f8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.965317:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4f8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.965338:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4f8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.965346:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b4f8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.965365:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334966.965369:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b4ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.965375:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334966.965378:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b4ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.965385:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b4ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.965395:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b4ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.965403:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b4ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.965410:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.965418:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.965422:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.965424:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334966.965469:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aef0a2a00/2, rc 0, transno 21474838376 00000100:00100000:2.0:1763334966.965477:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701842560:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334966.965492:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a23b80/2, rc 0, transno 17179871095 00000100:00100000:2.0:1763334966.965497:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701843072:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763334966.965522:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4e680/2, rc 0, transno 21474838377 00000100:00100000:2.0:1763334966.965527:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701842432:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763334966.965536:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a22d80/2, rc 0, transno 17179871096 00000100:00100000:2.0:1763334966.965539:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701842944:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1763334966.965560:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6451880/2, rc 0, transno 21474838375 00000100:00100000:2.0:1763334966.965564:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6451880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701842688:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334966.965607:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a21180/2, rc 0, transno 17179871094 00000100:00100000:2.0:1763334966.965612:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701843200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334966.970846:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.970962:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701843456:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334966.971002:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334966.971051:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701843328:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334966.971069:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334966.971377:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.971416:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334966.971508:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694485888 00000100:00100000:2.0:1763334966.971518:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694485888 00010000:00010000:2.0:1763334966.971565:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcee expref: 37 pid: 21625 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.971630:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694486016 00000100:00100000:2.0:1763334966.971633:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694486016 00010000:00010000:2.0:1763334966.971649:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b33f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce0 expref: 13 pid: 32241 timeout: 1131 lvb_type: 0 00000100:00100000:2.0:1763334966.971679:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2537 00000100:00100000:2.0:1763334966.971690:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2360:x1848989694485888:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334966.971716:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334966.971724:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcee expref: 37 pid: 21625 timeout: 1131 lvb_type: 0 00000100:00100000:3.0:1763334966.971729:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2538 00000100:00100000:3.0:1763334966.971745:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2359:x1848989694486016:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334966.971747:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcee expref: 37 pid: 21625 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334966.971761:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334966.971771:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b33f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce0 expref: 13 pid: 32241 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.971785:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b362 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afcee expref: 37 pid: 21625 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334966.971787:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b33f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce0 expref: 13 pid: 32241 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.971817:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.971820:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b33f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x238:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afce0 expref: 13 pid: 32241 timeout: 1131 lvb_type: 0 00010000:00010000:2.0:1763334966.971821:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.971828:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.971836:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.971840:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334966.971842:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.971844:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.971872:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334966.971933:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2360:x1848989694485888:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 244us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.971941:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2537 00010000:00010000:2.0:1763334966.972141:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.972151:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.972168:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.972191:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.972194:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.972232:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334966.972233:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334966.972275:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2359:x1848989694486016:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 534us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334966.972283:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2538 00010000:00010000:3.0:1763334966.972332:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.972340:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.972349:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.972357:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.972476:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763334966.972607:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+58:3292:x1848989701842816:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8892us (9622us total) trans 17179871097 rc 0/0 00000100:00100000:2.0:1763334966.972617:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4808 00010000:00010000:2.0:1763334966.972642:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1763334966.972654:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.972663:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334966.972668:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.972678:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.972690:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.972697:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b4f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.972728:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334966.972731:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.972737:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334966.972740:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.972747:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.972756:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.972762:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b4ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334966.972770:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3292:x1848989701842304:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9169us (9846us total) trans 21474838378 rc 0/0 00010000:00010000:2.0:1763334966.972774:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.972777:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334966.972780:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334966.972783:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4807 00010000:00010000:2.0:1763334966.972786:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334966.972822:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4ca80/2, rc 0, transno 21474838378 00000100:00100000:2.0:1763334966.972829:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701842304:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763334966.972841:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a22300/2, rc 0, transno 17179871097 00000100:00100000:2.0:1763334966.972845:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701842816:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334966.973173:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694485760 00000100:00100000:0.0:1763334966.973181:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694485760 00000100:00100000:0.0:1763334966.973243:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4735 00000100:00100000:0.0:1763334966.973251:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53047:x1848989694485760:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334966.973275:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.973296:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b506 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd6c expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.973367:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b506 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd6c expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.973381:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b506 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd6c expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.973400:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334966.973403:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334966.973408:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:0.0:1763334966.973445:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53047:x1848989694485760:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 196us (2618us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334966.973452:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4735 00000100:00100000:3.0:1763334966.974658:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.974874:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694486144 00000100:00100000:0.0:1763334966.974883:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694486144 00000100:00100000:0.0:1763334966.974942:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4815 00000100:00100000:0.0:1763334966.974953:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+36:52274:x1848989694486144:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334966.974972:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.974996:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd73 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.975032:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b46c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd3b expref: 37 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334966.975041:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.975335:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.975344:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 37 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.975387:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b46c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd3b expref: 37 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334966.975402:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b46c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd3b expref: 37 pid: 32241 timeout: 1131 lvb_type: 1 00000100:00100000:0.0:1763334966.975416:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac37cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701843584:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334966.976354:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1000 going to sleep for 11 seconds 00000100:00100000:3.0:1763334966.981837:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.981889:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.981985:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694486528 00000100:00100000:1.0:1763334966.982000:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694486528 00000100:00100000:3.0:1763334966.982031:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.982066:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694486656 00000100:00100000:3.0:1763334966.982071:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694486656 00000100:00100000:1.0:1763334966.982088:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 392 00010000:00010000:3.0:1763334966.982100:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b46c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd3b expref: 38 pid: 32241 timeout: 1131 lvb_type: 1 00000100:00100000:1.0:1763334966.982102:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2359:x1848989694486528:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334966.982128:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1763334966.982140:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2539 00000100:00100000:3.0:1763334966.982149:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+38:2360:x1848989694486656:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334966.982160:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334966.982167:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b506 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd6c expref: 184 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.982168:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b46c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd3b expref: 38 pid: 32241 timeout: 1131 lvb_type: 1 00010000:00010000:3.0:1763334966.982196:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b46c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd3b expref: 38 pid: 32241 timeout: 1131 lvb_type: 1 00010000:00010000:3.0:1763334966.982231:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.982235:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334966.982245:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 38 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334966.982517:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334966.982526:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334966.982634:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+183:2359:x1848989694486528:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 535us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.982643:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 392 00010000:00010000:0.0:1763334966.982664:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b46c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd3b expref: 38 pid: 32241 timeout: 1131 lvb_type: 1 00000100:00100000:0.0:1763334966.982680:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac37cf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701843584:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334966.982793:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694486400 00000100:00100000:2.0:1763334966.982799:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694486400 00000100:00100000:2.0:1763334966.982844:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1742 00000100:00100000:2.0:1763334966.982853:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53047:x1848989694486400:12345-192.168.201.60@tcp:35:lfs.0 00010000:00010000:3.0:1763334966.983348:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 37 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334966.983483:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53047:x1848989694486400:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 630us (1665us total) trans 8589938951 rc 0/0 00000100:00100000:2.0:1763334966.983493:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1742 00010000:00010000:0.0:1763334966.984267:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 37 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334966.984477:0:5734:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 37 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334966.984501:0:5734:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad88bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701843712:192.168.201.60@tcp:105: 00010000:00010000:0.0:1763334966.984596:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334966.984679:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+37:52274:x1848989694486144:12345-192.168.201.60@tcp:101:bash.0 Request processed in 9727us (10026us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334966.984689:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4815 00000100:00100000:1.0:1763334966.984702:0:5734:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeebed600 going to sleep for 11 seconds 00000100:00100000:3.0:1763334966.992778:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334966.992884:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.993046:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694486784 00000100:00100000:0.0:1763334966.993060:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694486784 00000100:00100000:0.0:1763334966.993135:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4816 00000100:00100000:0.0:1763334966.993149:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+12:52274:x1848989694486784:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334966.993177:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334966.993210:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b514 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd7a expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334966.993253:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x23a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334966.993285:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.993288:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334966.993300:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b514 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd7a expref: 13 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.993324:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b514 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd7a expref: 13 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334966.993339:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:2.0:1763334966.993378:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694486912 00000100:00100000:2.0:1763334966.993385:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694486912 00000100:00100000:0.0:1763334966.993418:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+13:52274:x1848989694486784:12345-192.168.201.60@tcp:101:bash.0 Request processed in 272us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334966.993427:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4816 00000100:00100000:2.0:1763334966.993434:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4736 00000100:00100000:2.0:1763334966.993444:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53047:x1848989694486912:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334966.993464:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334966.993483:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b51b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd81 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.993615:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b522 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.993633:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b522 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.993645:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b522 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.993661:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b529 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.993668:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b529 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.993674:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b529 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994079:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b530 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994091:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b530 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994099:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b530 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334966.994159:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 2 00000004:00200000:2.0:1763334966.994164:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334966.994187:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b530 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994200:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b530 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994210:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b522 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994227:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b522 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994235:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b522 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994242:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.994247:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b522 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994255:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b522 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994270:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334966.994275:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.994281:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b522 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994287:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b522 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994302:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b529 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994308:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b529 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994314:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b529 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994318:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334966.994321:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b529 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994326:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b529 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994333:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334966.994335:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334966.994338:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b529 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994344:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b529 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334966.994386:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b51b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd81 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.994406:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b530 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd81 expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334966.994414:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:2.0:1763334966.994417:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334966.994420:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9a00, rc 0) 00000100:00100000:2.0:1763334966.994483:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53047:x1848989694486912:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1040us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334966.994492:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4736 00000100:00100000:1.0:1763334966.995775:0:5734:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad88bc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701843712:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334966.995826:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334966.995904:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2360:x1848989694486656:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 13755us (13872us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334966.995916:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2539 00000100:00100000:0.0:1763334966.997785:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334966.997820:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334966.997943:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694487040 00000100:00100000:1.0:1763334966.997956:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694487040 00002000:00010000:1.0:1763334966.998065:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/574 (0->18446744073709551615) 00002000:00100000:1.0:1763334966.998072:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac37cf480 with x1848989694487040 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334966.998087:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac37cf480. 00000100:00100000:1.0:1763334966.998119:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694487168 00000100:00100000:1.0:1763334966.998123:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694487168 00002000:00010000:1.0:1763334966.998138:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/570 (0->18446744073709551615) 00002000:00100000:1.0:1763334966.998142:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac37cd180 with x1848989694487168 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334966.998150:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac37cd180. 00000100:00100000:1.0:1763334966.998177:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1744 00000100:00100000:1.0:1763334966.998188:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2360:x1848989694487040:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:0.0:1763334966.998413:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1745 00000100:00100000:0.0:1763334966.998424:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694487168:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:0.0:1763334966.998828:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334966.998833:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb mtime from disk: 0 -> 1763334967 00002000:00010000:0.0:1763334966.998836:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334966.998838:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb ctime from disk: 0 -> 1763334967 00002000:00010000:0.0:1763334966.998840:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334966.998913:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694487168:12345-192.168.201.60@tcp:10:bash.0 Request processed in 491us (1091us total) trans 21474838379 rc 0/0 00000100:00100000:0.0:1763334966.998921:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1745 00002000:00010000:0.0:1763334966.998926:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/570 (0->18446744073709551615) 00002000:00100000:0.0:1763334966.998929:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac37cd180 with x1848989694487168 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334966.998934:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac37cd180. 00002000:00010000:1.0:1763334966.999353:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334966.999356:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb mtime from disk: 0 -> 1763334967 00002000:00010000:1.0:1763334966.999358:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334966.999360:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb ctime from disk: 0 -> 1763334967 00002000:00010000:1.0:1763334966.999362:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334966.999407:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2360:x1848989694487040:12345-192.168.201.60@tcp:10:bash.0 Request processed in 1219us (1634us total) trans 17179871098 rc 0/0 00000100:00100000:1.0:1763334966.999415:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1744 00002000:00010000:1.0:1763334966.999419:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/574 (0->18446744073709551615) 00002000:00100000:1.0:1763334966.999422:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac37cf480 with x1848989694487040 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334966.999428:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac37cf480. 00000100:00100000:0.0:1763334967.006191:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.007427:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694487424 00000100:00100000:2.0:1763334967.007448:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694487424 00000100:00100000:2.0:1763334967.007546:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1743 00000100:00100000:2.0:1763334967.007559:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694487424:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:2.0:1763334967.008143:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694487424:12345-192.168.201.60@tcp:35:bash.0 Request processed in 583us (1966us total) trans 8589938952 rc 0/0 00000100:00100000:2.0:1763334967.008153:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1743 00000100:00100000:3.0:1763334967.009315:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.009508:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694487680 00000100:00100000:2.0:1763334967.009521:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694487680 00000100:00100000:2.0:1763334967.009623:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4737 00000100:00100000:2.0:1763334967.009633:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53048:x1848989694487680:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334967.009659:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.009689:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b537 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd88 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.009823:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b53e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.009842:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b53e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.009855:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b53e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334967.009868:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 5 00010000:00010000:2.0:1763334967.010027:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b537 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd88 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.010049:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b53e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd88 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.010059:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:2.0:1763334967.010062:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763334967.010066:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8a00, rc 0) 00000100:00100000:2.0:1763334967.010135:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53048:x1848989694487680:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 503us (831us total) trans 8589938953 rc 0/0 00000100:00100000:2.0:1763334967.010144:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4737 00000100:00100000:3.0:1763334967.018746:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.019207:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694487936 00000100:00100000:0.0:1763334967.019232:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694487936 00000100:00100000:0.0:1763334967.019312:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4738 00000100:00100000:0.0:1763334967.019326:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53048:x1848989694487936:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334967.019360:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.019389:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b54c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd8f expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.019529:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.019547:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd65 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.019560:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b530 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd81 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.019568:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.019656:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b530 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd81 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.019671:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b530 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd81 expref: 189 pid: 32232 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334967.019688:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701843840:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334967.020957:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd65 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.020984:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd65 expref: 189 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334967.021000:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701843968:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334967.022351:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1000 going to sleep for 11 seconds 00000100:00100000:3.0:1763334967.026234:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.026524:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694488064 00000100:00100000:1.0:1763334967.026538:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694488064 00010000:00010000:1.0:1763334967.026643:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd65 expref: 190 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:1.0:1763334967.026689:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2540 00000100:00100000:1.0:1763334967.026702:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:2360:x1848989694488064:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1763334967.026705:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701843840:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334967.026720:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5ad500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701843968:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334967.026724:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334967.026734:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd65 expref: 190 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334967.026749:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd65 expref: 190 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:0.0:1763334967.027455:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.027686:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b4e3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd65 expref: 190 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334967.027709:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334967.027715:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.027727:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.027735:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334967.027828:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2360:x1848989694488064:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1127us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.027839:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2540 00000100:00100000:0.0:1763334967.028887:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.029706:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694488192 00000100:00100000:3.0:1763334967.029723:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694488192 00010000:00010000:3.0:1763334967.029790:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b530 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd81 expref: 189 pid: 32232 timeout: 1131 lvb_type: 0 00000100:00100000:3.0:1763334967.029846:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2541 00000100:00100000:3.0:1763334967.029868:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2360:x1848989694488192:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334967.029890:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334967.029898:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b530 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd81 expref: 189 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334967.030690:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b530 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd81 expref: 189 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334967.030730:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b530 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd81 expref: 189 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334967.030752:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:3.0:1763334967.030759:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.030770:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.030778:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.030822:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334967.030921:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:2360:x1848989694488192:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1063us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.030931:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2541 00000100:00100000:2.0:1763334967.031023:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334967.031155:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.031166:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334967.031194:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 5 00010000:00010000:1.0:1763334967.031441:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b54c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd8f expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.031467:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd8f expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.031476:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334967.031480:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334967.031483:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:1.0:1763334967.031543:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53048:x1848989694487936:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 12221us (12806us total) trans 8589938954 rc 0/0 00000100:00100000:1.0:1763334967.031552:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4738 00000100:00100000:1.0:1763334967.031597:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694488320 00000100:00100000:1.0:1763334967.031607:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694488320 00000100:00100000:1.0:1763334967.031655:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4739 00000100:00100000:1.0:1763334967.031665:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53049:x1848989694488320:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:1.0:1763334967.031691:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.031712:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b561 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd96 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.031790:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b568 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.031803:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b568 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.031813:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b568 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.031830:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b56f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.031842:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b56f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.031849:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b56f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.031985:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b576 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.031997:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd8f expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.032007:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b576 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.032050:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd8f expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.032066:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd8f expref: 189 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:1.0:1763334967.032085:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701844096:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334967.032171:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c1e48600 going to sleep for 11 seconds 00000100:00100000:2.0:1763334967.034659:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.034718:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694488448 00000100:00100000:2.0:1763334967.034730:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.034732:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694488448 00000100:00100000:0.0:1763334967.034784:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694488576 00010000:00010000:3.0:1763334967.034790:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd8f expref: 190 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334967.034791:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694488576 00000100:00100000:3.0:1763334967.034841:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2542 00000100:00100000:0.0:1763334967.034842:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4740 00000100:00100000:0.0:1763334967.034860:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53048:x1848989694488576:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334967.034884:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.034910:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b57d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afd9d expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.035022:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b584 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.035041:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b584 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.035054:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b584 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334967.035213:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701844096:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334967.035260:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b576 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334967.035529:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694488448:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334967.035546:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334967.035554:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd8f expref: 192 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334967.035601:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd8f expref: 192 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334967.035628:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b553 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1a0:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd8f expref: 192 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334967.035649:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:3.0:1763334967.035655:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b576 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.035665:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b576 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.035673:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b576 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.035682:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b584 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.035690:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b584 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.035696:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b584 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.035750:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334967.035765:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b576 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035779:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b576 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334967.035825:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 5 00000004:00200000:1.0:1763334967.035831:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334967.035857:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b576 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035871:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b576 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035882:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b568 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035889:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b568 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035897:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b568 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035904:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.035909:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b568 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035918:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b568 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035928:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.035932:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.035937:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b568 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035944:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b568 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035957:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b56f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035963:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b56f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035969:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b56f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035974:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.035977:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b56f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035983:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b56f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.035990:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28faa00) 00010000:00010000:1.0:1763334967.035992:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.035995:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b56f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.036001:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b56f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.036369:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b584 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.036379:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b584 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334967.036401:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 5 00000004:00200000:0.0:1763334967.036404:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334967.036415:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b584 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.036453:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b57d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd9d expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.036476:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b584 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd9d expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.036485:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334967.036487:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334967.036490:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334967.036617:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53048:x1848989694488576:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1760us (1884us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.036627:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4740 00010000:00010000:1.0:1763334967.037382:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b561 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd96 expref: 191 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.037396:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b576 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd96 expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.037403:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334967.037407:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334967.037410:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334967.037449:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53049:x1848989694488320:12345-192.168.201.60@tcp:101:rm.0 Request processed in 5785us (6428us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.037457:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4739 00000100:00100000:2.0:1763334967.038154:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2360:x1848989694488448:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 3294us (3505us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334967.038167:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2542 00000100:00100000:2.0:1763334967.040990:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.041093:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694488832 00000100:00100000:1.0:1763334967.041119:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694488832 00000100:00100000:1.0:1763334967.041800:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1744 00000100:00100000:1.0:1763334967.041815:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53048:x1848989694488832:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334967.042166:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53048:x1848989694488832:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 352us (1190us total) trans 8589938955 rc 0/0 00000100:00100000:1.0:1763334967.042175:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1744 00000100:00100000:3.0:1763334967.042503:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.044268:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694488960 00000100:00100000:2.0:1763334967.044290:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694488960 00000100:00100000:2.0:1763334967.044383:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 393 00000100:00100000:2.0:1763334967.044395:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:2360:x1848989694488960:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334967.044416:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334967.044453:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b576 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd96 expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.044481:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:2.0:1763334967.044489:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334967.044554:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2360:x1848989694488960:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 162us (2053us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334967.044562:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 393 00000100:00100000:3.0:1763334967.044872:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.045168:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694489216 00000100:00100000:1.0:1763334967.045175:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694489216 00000100:00100000:1.0:1763334967.045214:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4741 00000100:00100000:1.0:1763334967.045234:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53049:x1848989694489216:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:1.0:1763334967.045315:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1763334967.045338:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b584 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd9d expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.045360:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b4b2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd57 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.045371:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334967.045375:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334967.045422:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b58b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.045448:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b58b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.045480:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b58b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.045501:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b592 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.045509:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b592 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.045515:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b592 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.045753:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.045767:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b53e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd88 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.045777:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.045830:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b53e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd88 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.045848:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b53e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd88 expref: 187 pid: 32232 timeout: 1131 lvb_type: 0 00000100:00100000:1.0:1763334967.045868:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701844224:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334967.045965:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c1e48600 going to sleep for 11 seconds 00000100:00100000:3.0:1763334967.048053:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.048265:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694489472 00000100:00100000:0.0:1763334967.048279:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694489472 00000100:00100000:0.0:1763334967.048356:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4742 00000100:00100000:0.0:1763334967.048369:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53048:x1848989694489472:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334967.048404:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.048409:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334967.048429:0:32232:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b53e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd88 expref: 188 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:0.0:1763334967.048465:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334967.048471:0:32232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.048483:0:32232:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.048491:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.048522:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334967.048542:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b5a0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afda4 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.048719:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b5a7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.048731:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b5a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.048738:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b5a7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334967.048751:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 5 00010000:00010000:0.0:1763334967.048907:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b5a0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afda4 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.048929:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b5a7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afda4 expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.048936:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334967.048938:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334967.048941:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334967.049016:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53048:x1848989694489472:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 648us (1119us total) trans 8589938956 rc 0/0 00000100:00100000:0.0:1763334967.049024:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4742 00010000:00010000:0.0:1763334967.049936:0:29627:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.60@tcp) returned -22 from blocking AST (req@00000000e960433b x1848989701844224) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b53e lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd88 expref: 189 pid: 32232 timeout: 1131 lvb_type: 0 00010000:00010000:0.0:1763334967.049965:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b53e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd88 expref: 189 pid: 32232 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334967.049982:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701844224:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334967.050095:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334967.050103:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.050113:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.050421:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334967.051911:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.051992:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694489600 00000100:00100000:1.0:1763334967.052025:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694489600 00000100:00100000:1.0:1763334967.052090:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4743 00000100:00100000:1.0:1763334967.052100:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53048:x1848989694489600:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.052127:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.052158:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b5b5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afdab expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00000004:00080000:0.0:1763334967.052855:0:29627:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x1a0:0x0] is inserted into orphan list, open count = 2 00010000:00010000:0.0:1763334967.053071:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.053081:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.053090:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.053097:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.053103:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.053113:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.054017:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b5b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdab expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.054043:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b5b5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdab expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.054071:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334967.054076:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334967.054080:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334967.054185:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53048:x1848989694489600:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2084us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.054197:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4743 00010000:00010000:0.0:1763334967.054841:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334967.054844:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763334967.054850:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.054859:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b599 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.054884:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b58b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.054891:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b58b lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.054898:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b58b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.054904:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.054907:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b58b lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.054914:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b58b lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.054921:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334967.054924:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.054927:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b58b lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.054932:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b58b lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:0.0:1763334967.054943:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003f7abce7 reply state 00000000f45682c3 transno 8589938957 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b592 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334967.054952:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334967.055604:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53049:x1848989694489216:12345-192.168.201.60@tcp:36:rm.0 Request processed in 10339us (10700us total) trans 8589938957 rc 0/0 00000100:00100000:0.0:1763334967.055616:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4741 00000100:00100000:2.0:1763334967.056975:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334967.060775:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b592 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.060875:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b592 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.060884:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b592 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.060891:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.060897:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b592 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.060908:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b592 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.060932:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28faa00) 00010000:00010000:3.0:1763334967.060937:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.060943:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b592 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.060950:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b592 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334967.061055:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694489728 00000100:00100000:0.0:1763334967.061071:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694489728 00000100:00100000:0.0:1763334967.061151:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4817 00000100:00100000:0.0:1763334967.061164:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+37:2359:x1848989694489728:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:0.0:1763334967.061237:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.061258:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 37 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.061266:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334967.061269:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334967.061273:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.061320:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 37 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.061335:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 37 pid: 25383 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334967.061353:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701844352:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334967.061471:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1000 going to sleep for 11 seconds 00000100:00100000:2.0:1763334967.068416:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.069196:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701844352:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334967.069251:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334967.070210:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694489856 00000100:00100000:1.0:1763334967.070232:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694489856 00002000:00100000:1.0:1763334967.070309:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23e:0x0] (0->4) req@ffff9a5afc8c3b80 x1848989694489856/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:13/0 lens 496/0 e 0 to 0 dl 1763334978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334967.070322:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afc8c3b80 with x1848989694489856 ext(0->4) 00010000:00010000:1.0:1763334967.070332:0:14384:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 38 pid: 25383 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334967.070357:0:14384:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 38 pid: 25383 timeout: 1131 lvb_type: 0 00002000:00010000:1.0:1763334967.070365:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a5afc8c3b80 00000100:00100000:1.0:1763334967.071246:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 70 00000100:00100000:1.0:1763334967.071269:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+38:2360:x1848989694489856:12345-192.168.201.60@tcp:4:bash.0 00000100:00100000:1.0:1763334967.075212:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+40:2360:x1848989694489856:12345-192.168.201.60@tcp:4:bash.0 Request processed in 3927us (6790us total) trans 17179871099 rc 0/0 00000100:00100000:1.0:1763334967.075245:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 70 00002000:00100000:1.0:1763334967.075268:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x23e:0x0] (0->4) req@ffff9a5afc8c3b80 x1848989694489856/t17179871099(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:13/0 lens 496/448 e 0 to 0 dl 1763334978 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334967.075281:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afc8c3b80 with x1848989694489856 ext(0->4) 00010000:00010000:1.0:1763334967.075295:0:14384:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 40 pid: 25383 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334967.075320:0:14384:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 40 pid: 25383 timeout: 1131 lvb_type: 0 00002000:00010000:1.0:1763334967.075329:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a5afc8c3b80 00000100:00100000:3.0:1763334967.075938:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.077022:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694489984 00000100:00100000:0.0:1763334967.077039:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694489984 00000100:00100000:0.0:1763334967.077123:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4744 00000100:00100000:0.0:1763334967.077135:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53050:x1848989694489984:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334967.077166:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.077197:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b5c3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afdb2 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.077301:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b5ca lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077322:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b5ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077335:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b5ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077354:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b5d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077361:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077368:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077475:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b5ca lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077484:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b5ca lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077491:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b5ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077498:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.077503:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b5ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077511:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b5ca lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077525:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334967.077529:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.077536:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b5ca lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077543:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b5ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077558:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b5d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077564:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b5d1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077601:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b5d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077611:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.077614:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b5d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077620:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b5d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077628:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334967.077630:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.077633:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b5d1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077638:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b5d1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.077681:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b5c3 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdb2 expref: 191 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.077693:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334967.077696:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.077700:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b5c3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdb2 expref: 191 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.077710:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334967.077797:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53050:x1848989694489984:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 663us (1863us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334967.077806:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4744 00000100:00100000:2.0:1763334967.080258:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.080559:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694490112 00000100:00100000:0.0:1763334967.080613:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694490112 00010000:00010000:0.0:1763334967.080673:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 40 pid: 25383 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334967.080723:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2543 00000100:00100000:0.0:1763334967.080736:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+40:2362:x1848989694490112:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334967.080758:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1763334967.080788:0:5734:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb size from disk: 0 -> 5 00010000:00010000:0.0:1763334967.080796:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 40 pid: 25383 timeout: 1131 lvb_type: 0 00010000:00010000:0.0:1763334967.080811:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 40 pid: 25383 timeout: 1131 lvb_type: 0 00010000:00010000:0.0:1763334967.080843:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849b50d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd73 expref: 40 pid: 25383 timeout: 1131 lvb_type: 0 00010000:00010000:0.0:1763334967.080866:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.080868:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.080875:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.080887:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.080925:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334967.081008:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+39:2362:x1848989694490112:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 273us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.081016:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2543 00010000:00010000:3.0:1763334967.081403:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.081415:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.081457:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.081472:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.081482:0:32241:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.081491:0:32241:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334967.081498:0:32241:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.081509:0:32241:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.081526:0:32241:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.081535:0:32241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b5bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334967.081649:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+38:2359:x1848989694489728:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 20487us (24682us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.081661:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4817 00000100:00100000:1.0:1763334967.081818:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.082911:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694490240 00000100:00100000:3.0:1763334967.082929:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694490240 00000100:00100000:3.0:1763334967.083008:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4745 00000100:00100000:3.0:1763334967.083019:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53050:x1848989694490240:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334967.083046:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.083076:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b5d8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afdb9 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.083185:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b5df lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083204:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b5df lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083231:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b5df lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083252:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b5e6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083259:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083266:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083373:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b5df lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083382:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b5df lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083389:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b5df lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083395:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.083401:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b5df lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083409:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b5df lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083423:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.083426:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.083431:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b5df lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083438:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b5df lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083451:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b5e6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083457:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b5e6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083463:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083467:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.083469:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b5e6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083475:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b5e6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083482:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5ee00) 00010000:00010000:3.0:1763334967.083484:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.083486:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b5e6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083492:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b5e6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.083533:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b5d8 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdb9 expref: 191 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.083545:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.083548:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.083552:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b5d8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdb9 expref: 191 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.083561:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:3.0:1763334967.083677:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53050:x1848989694490240:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 659us (1858us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334967.083684:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4745 00000100:00100000:0.0:1763334967.085153:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.085265:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694490496 00000100:00100000:1.0:1763334967.085279:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694490496 00000100:00100000:0.0:1763334967.085468:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4746 00000100:00100000:0.0:1763334967.085482:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53048:x1848989694490496:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334967.085559:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334967.085725:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b5b5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdab expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.085751:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334967.085756:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334967.085799:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b5ed lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.085814:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b5ed lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.085825:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b5ed lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:0.0:1763334967.086379:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1115, 88 off95600 00000004:00080000:0.0:1763334967.086394:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1031719821437ns, next at 1032427980316ns, rc = 0 00000040:00080000:0.0:1763334967.086475:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1104, 88 off94512 00000004:00080000:0.0:1763334967.086482:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1031719910247ns, next at 1032427929403ns, rc = 0 00000040:00080000:0.0:1763334967.086507:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1105, 88 off94600 00000004:00080000:0.0:1763334967.086511:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1031719938962ns, next at 1032427929403ns, rc = 0 00000040:00080000:0.0:1763334967.086525:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1116, 88 off95688 00000004:00080000:0.0:1763334967.086529:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1031719957272ns, next at 1032427980316ns, rc = 0 00000100:00100000:2.0:1763334967.087198:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.087427:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694490624 00000100:00100000:3.0:1763334967.087444:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694490624 00000100:00100000:3.0:1763334967.087509:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4747 00000100:00100000:3.0:1763334967.087520:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53050:x1848989694490624:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334967.087545:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.087568:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b5f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afdc0 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.087689:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b5fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.087702:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b5fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.087713:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b5fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334967.087778:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334967.087783:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334967.087807:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b5fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.087837:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b5f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdc0 expref: 193 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.087857:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b5fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdc0 expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.087866:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.087870:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334967.087873:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:3.0:1763334967.087958:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53050:x1848989694490624:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 440us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.087965:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4747 00000100:00100000:3.0:1763334967.096961:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.097042:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694490752 00000100:00100000:2.0:1763334967.097057:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694490752 00000100:00100000:2.0:1763334967.097132:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4748 00000100:00100000:2.0:1763334967.097144:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53050:x1848989694490752:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334967.097171:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.097201:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b602 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afdc7 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.097316:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b609 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097332:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b609 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097348:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b609 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097366:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b610 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097373:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b610 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097379:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b610 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097523:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b609 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097531:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b609 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097538:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b609 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097545:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.097550:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b609 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097558:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b609 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097603:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334967.097608:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.097615:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b609 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097622:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b609 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097635:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b610 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097641:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b610 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097646:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b610 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097650:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.097654:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b610 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097659:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b610 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097666:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334967.097669:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.097672:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b610 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097677:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b610 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.097715:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b602 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdc7 expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.097725:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334967.097727:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.097730:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b602 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdc7 expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.097743:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8200, rc 0) 00000100:00100000:2.0:1763334967.097816:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53050:x1848989694490752:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 674us (868us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334967.097824:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4748 00000100:00100000:1.0:1763334967.109633:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.110299:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694491008 00000100:00100000:2.0:1763334967.110317:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694491008 00000100:00100000:2.0:1763334967.110386:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4749 00000100:00100000:2.0:1763334967.110399:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53050:x1848989694491008:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334967.110427:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.110432:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334967.110475:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b5fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdc0 expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.110498:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334967.110505:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334967.110523:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b617 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afdce expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.110920:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b61e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.110938:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b61e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.110948:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b61e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.110964:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b625 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.110971:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b625 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.110977:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b625 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.115355:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b62c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.115393:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b62c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.115411:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b62c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334967.115428:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a1:0x0]: returning size 0 00010000:00010000:2.0:1763334967.115471:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b61e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.115479:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b61e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.115487:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b61e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.115493:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.115499:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b61e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.115507:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b61e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.115521:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334967.115525:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.115532:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b61e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.115539:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b61e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:2.0:1763334967.115556:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c223fc40 reply state 000000004c751e3c transno 8589938959 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b625 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334967.115568:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334967.115664:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b617 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdce expref: 194 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.115683:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b62c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdce expref: 193 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.115690:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:2.0:1763334967.115693:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334967.115696:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9a00, rc 0) 00000100:00100000:2.0:1763334967.115807:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53050:x1848989694491008:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5410us (6187us total) trans 8589938959 rc 0/0 00000100:00100000:2.0:1763334967.115818:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4749 00010000:00010000:0.0:1763334967.118902:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b625 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.118927:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b625 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.118937:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b625 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.118944:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.118950:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b625 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.118959:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b625 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.118981:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:0.0:1763334967.118984:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.118989:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b625 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.118995:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b625 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334967.127840:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.127898:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694491264 00000100:00100000:1.0:1763334967.127913:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694491264 00000100:00100000:1.0:1763334967.127998:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4750 00000100:00100000:1.0:1763334967.128013:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53050:x1848989694491264:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.128045:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.128076:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b63a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afdd5 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.128244:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.128265:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b62c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdce expref: 194 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.128277:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.128329:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b62c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdce expref: 194 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.128348:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b62c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdce expref: 194 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:1.0:1763334967.128367:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701844480:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334967.129975:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c1e48cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334967.135232:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701844480:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334967.135256:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334967.135278:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334967.135748:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694491392 00000100:00100000:3.0:1763334967.135762:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694491392 00010000:00010000:3.0:1763334967.136094:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b62c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdce expref: 195 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:3.0:1763334967.136497:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2544 00000100:00100000:3.0:1763334967.136511:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2360:x1848989694491392:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334967.136533:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334967.136542:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b62c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdce expref: 195 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334967.136560:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b62c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdce expref: 195 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334967.136620:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b62c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdce expref: 195 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:3.0:1763334967.136644:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:3.0:1763334967.136652:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.136663:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.136672:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.137374:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334967.137407:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.137419:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334967.137446:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a1:0x0]: returning size 0 00000100:00100000:2.0:1763334967.137474:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2360:x1848989694491392:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 963us (2217us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334967.137486:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2544 00000004:00080000:1.0:1763334967.137884:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23c:0x0], index 0: 0 00000004:00080000:1.0:1763334967.137896:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x240:0x0], index 1: 0 00000004:00080000:1.0:1763334967.137903:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x241:0x0], index 1: 0 00000004:00080000:1.0:1763334967.137908:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23d:0x0], index 0: 0 00010000:00010000:1.0:1763334967.138120:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.138129:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.138136:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.138143:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.138148:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.138156:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.138171:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:1.0:1763334967.138174:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334967.138179:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.138185:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b641 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.138276:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b63a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdd5 expref: 194 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.138288:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.138290:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334967.138294:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b63a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdd5 expref: 194 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.138304:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334967.141415:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53050:x1848989694491264:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 13376us (13563us total) trans 8589938960 rc 301/301 00000100:00100000:1.0:1763334967.141434:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4750 00010000:00010000:1.0:1763334967.142721:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334967.146637:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.147139:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694491648 00000100:00100000:2.0:1763334967.147155:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694491648 00000100:00100000:2.0:1763334967.147239:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1745 00000100:00100000:2.0:1763334967.147252:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53050:x1848989694491648:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334967.147761:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53050:x1848989694491648:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 510us (1139us total) trans 8589938961 rc 0/0 00000100:00100000:2.0:1763334967.147771:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1745 00000001:00080000:0.0:1763334967.150414:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938958 is committed 00000004:00080000:0.0:1763334967.150435:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 736 committed 00000004:00080000:0.0:1763334967.150454:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 724 committed 00000004:00080000:0.0:1763334967.150463:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 723 committed 00000004:00080000:0.0:1763334967.150466:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 735 committed 00000004:00010000:3.0:1763334967.150635:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e3d47918 reply state 0000000056aa70dc transno 8589938958 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b5ed lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334967.150656:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334967.151072:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701844608:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334967.151146:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334967.151283:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701844736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334967.151316:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1763334967.151516:0:30972:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763334967.151544:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53048:x1848989694490496:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 66061us (66398us total) trans 8589938958 rc 0/0 00000100:00100000:3.0:1763334967.151555:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4746 00000100:00100000:1.0:1763334967.151710:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763334967.151719:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701844992:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334967.151748:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334967.151786:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701844864:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334967.151810:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334967.151853:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701844608 00000100:00100000:1.0:1763334967.151863:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701844608 00000100:00100000:1.0:1763334967.151918:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701844736 00000100:00100000:1.0:1763334967.151922:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701844736 00000100:00100000:1.0:1763334967.151940:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701844992 00000100:00100000:1.0:1763334967.151943:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701844992 00000100:00100000:1.0:1763334967.151959:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701844864 00000100:00100000:1.0:1763334967.151962:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701844864 00000100:00100000:1.0:1763334967.151983:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4818 00000100:00100000:1.0:1763334967.151993:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3292:x1848989701844608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334967.152328:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3292:x1848989701844608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 335us (1181us total) trans 17179871100 rc 0/0 00000100:00100000:1.0:1763334967.152335:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4818 00000100:00100000:1.0:1763334967.152355:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4819 00000100:00100000:1.0:1763334967.152362:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3289:x1848989701844736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334967.152461:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+60:3289:x1848989701844736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 100us (1144us total) trans 17179871101 rc 0/0 00000100:00100000:1.0:1763334967.152468:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4819 00000100:00100000:1.0:1763334967.152480:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4820 00000100:00100000:1.0:1763334967.152486:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3292:x1848989701844992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334967.152622:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa767100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3292:x1848989701844992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (873us total) trans 21474838380 rc 0/0 00000100:00100000:1.0:1763334967.152628:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4820 00000100:00100000:1.0:1763334967.152639:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4821 00000100:00100000:1.0:1763334967.152645:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3290:x1848989701844864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334967.152737:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334967.152741:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb mtime from disk: 1763334967 -> 1763334967 00002000:00010000:1.0:1763334967.152744:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334967.152746:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb ctime from disk: 1763334967 -> 1763334967 00002000:00010000:1.0:1763334967.152749:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334967.152781:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa767480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3290:x1848989701844864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (970us total) trans 21474838381 rc 0/0 00000100:00100000:1.0:1763334967.152791:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4821 00000004:00080000:1.0:1763334967.152864:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77d880/2, rc 0, transno 21474838381 00000100:00100000:1.0:1763334967.152872:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701844864:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334967.152895:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f0000/2, rc 0, transno 17179871101 00000100:00100000:1.0:1763334967.152900:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701844736:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334967.152916:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa766d80/2, rc 0, transno 21474838380 00000100:00100000:1.0:1763334967.152919:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701844992:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334967.152927:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1f0a80/2, rc 0, transno 17179871100 00000100:00100000:1.0:1763334967.152930:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701844608:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1763334967.153139:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b5ed lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.153152:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b5ed lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.153160:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b5ed lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.153167:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.153172:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b5ed lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.153181:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b5ed lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.153201:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:2.0:1763334967.153204:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334967.153210:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b5ed lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.153228:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b5ed lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334967.154418:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.154673:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694491904 00000100:00100000:3.0:1763334967.154685:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694491904 00000100:00100000:3.0:1763334967.154750:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1746 00000100:00100000:3.0:1763334967.154762:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeb2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53050:x1848989694491904:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334967.155040:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeb2b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53050:x1848989694491904:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 280us (633us total) trans 8589938962 rc 0/0 00000100:00100000:3.0:1763334967.155050:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1746 00000100:00100000:2.0:1763334967.163933:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.164041:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694492160 00000100:00100000:3.0:1763334967.164056:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694492160 00000100:00100000:3.0:1763334967.167851:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4751 00000100:00100000:3.0:1763334967.167889:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694492160:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334967.167923:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.167956:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b64f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afddc expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.168203:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b656 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168232:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b656 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168248:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b656 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168278:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b65d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168286:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b65d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168293:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b65d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168420:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b664 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168429:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b664 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168438:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b664 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334967.168452:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a1:0x0]: returning size 0 00010000:00010000:3.0:1763334967.168634:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b656 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168642:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b656 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168648:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b656 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168655:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.168660:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b656 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168669:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b656 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168682:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.168686:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.168691:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b656 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168696:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b656 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168710:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b65d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168716:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b65d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168725:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b65d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168730:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.168733:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b65d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168738:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b65d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168745:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5ee00) 00010000:00010000:3.0:1763334967.168748:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.168750:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b65d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168756:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b65d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.168810:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b64f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afddc expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.168826:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b664 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afddc expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.168834:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5acbb5ed00) 00010000:00010000:3.0:1763334967.168837:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334967.168839:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:3.0:1763334967.168926:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694492160:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1057us (5010us total) trans 8589938963 rc 0/0 00000100:00100000:3.0:1763334967.168935:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4751 00000100:00100000:0.0:1763334967.172326:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.173211:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694492288 00000100:00100000:3.0:1763334967.173238:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694492288 00000100:00100000:2.0:1763334967.174557:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.176924:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694492544 00000100:00100000:1.0:1763334967.176946:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694492544 00000100:00100000:1.0:1763334967.177028:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4752 00000100:00100000:1.0:1763334967.177041:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53048:x1848989694492288:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.177074:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.177104:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b672 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afde3 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.177182:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b672 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afde3 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.177199:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b672 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afde3 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.177233:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334967.177237:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334967.177243:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334967.177342:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53048:x1848989694492288:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 303us (5091us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.177350:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4752 00000100:00100000:1.0:1763334967.177374:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4753 00000100:00100000:1.0:1763334967.177382:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694492544:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1763334967.177428:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334967.177450:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b664 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afddc expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.177466:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5acbb5ed00) 00010000:00010000:1.0:1763334967.177476:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334967.177805:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b679 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.177816:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b679 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.177824:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b679 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:1.0:1763334967.177885:0:29627:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938964 00000004:00010000:1.0:1763334967.177914:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001c943045 reply state 00000000b9732f45 transno 8589938965 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b679 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334967.177925:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334967.177991:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52274:x1848989694492544:12345-192.168.201.60@tcp:36:bash.0 Request processed in 609us (3447us total) trans 8589938965 rc 0/0 00000100:00100000:1.0:1763334967.177998:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4753 00000020:00080000:1.0:1763334967.178002:0:29627:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763334967.182654:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.182691:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.182735:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694492672 00000100:00100000:0.0:1763334967.182749:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694492672 00000100:00100000:0.0:1763334967.182806:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694492800 00000100:00100000:0.0:1763334967.182809:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694492800 00000100:00100000:0.0:1763334967.182831:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4754 00000100:00100000:0.0:1763334967.182849:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4755 00000100:00100000:0.0:1763334967.182857:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52274:x1848989694492800:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334967.182891:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.182922:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b680 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afdf1 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.183005:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b680 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdf1 expref: 192 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.183021:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b680 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdf1 expref: 192 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.183042:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5ad28fa700) 00010000:00010000:0.0:1763334967.183046:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334967.183050:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334967.183121:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52274:x1848989694492800:12345-192.168.201.60@tcp:101:bash.0 Request processed in 266us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.183129:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4755 00000100:00100000:0.0:1763334967.183158:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53048:x1848989694492672:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334967.183166:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.183176:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b687 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afdea expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.183276:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b68e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.183287:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b68e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.183301:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b68e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334967.183338:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a0:0x0]: returning size 5 00000004:00200000:0.0:1763334967.183344:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334967.183365:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b68e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.183395:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b687 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdea expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.183413:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b68e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdea expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.183420:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334967.183422:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763334967.183424:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334967.183457:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53048:x1848989694492672:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 616us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.183463:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4754 00010000:00010000:2.0:1763334967.186598:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b679 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.186620:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b679 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.186630:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b679 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.186637:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.186643:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b679 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.186652:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b679 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.186676:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5ad28fa700) 00010000:00010000:2.0:1763334967.186679:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.186684:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b679 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.186689:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b679 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334967.188453:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.188777:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694493056 00000100:00100000:3.0:1763334967.188794:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694493056 00000100:00100000:3.0:1763334967.188868:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4756 00000100:00100000:3.0:1763334967.188879:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52274:x1848989694493056:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334967.188906:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.188911:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334967.188942:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b680 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdf1 expref: 191 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.188964:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5ad28fa700) 00010000:00010000:3.0:1763334967.188977:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334967.188995:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b695 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afdf8 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.189062:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b69c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.189077:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b69c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.189087:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b69c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334967.190507:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.191235:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694493184 00000100:00100000:2.0:1763334967.191258:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694493184 00000100:00100000:2.0:1763334967.191333:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4822 00000100:00100000:2.0:1763334967.191344:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+38:2359:x1848989694493184:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334967.191368:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.191394:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b6a3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afdff expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334967.191426:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23e:0x0] initial LVB size: 5, mtime: 0x691a5b37, atime: 0x0, ctime: 0x691a5b37, blocks: 0x1 00010000:00010000:2.0:1763334967.191451:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334967.191453:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334967.191467:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b6a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdff expref: 39 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334967.191487:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b6a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdff expref: 39 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334967.191502:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8a00, rc 0) 00000100:00100000:2.0:1763334967.191611:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+39:2359:x1848989694493184:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 267us (3040us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334967.191619:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4822 00000040:00080000:0.0:1763334967.193815:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1106, 88 off94688 00000004:00080000:0.0:1763334967.193836:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1031827263416ns, next at 1032427929403ns, rc = 0 00000040:00080000:0.0:1763334967.193908:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1117, 88 off95776 00000004:00080000:0.0:1763334967.193912:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1031827339956ns, next at 1032427980316ns, rc = 0 00000040:00080000:0.0:1763334967.193935:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1118, 88 off95864 00000004:00080000:0.0:1763334967.193938:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1031827366416ns, next at 1032427980316ns, rc = 0 00000040:00080000:0.0:1763334967.193953:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1107, 88 off94776 00000004:00080000:0.0:1763334967.193955:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1031827383735ns, next at 1032427929403ns, rc = 0 00000100:00100000:0.0:1763334967.267068:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.267177:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694493312 00000100:00100000:2.0:1763334967.267192:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694493312 00000100:00100000:2.0:1763334967.267292:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1746 00000100:00100000:2.0:1763334967.267303:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+39:2361:x1848989694493312:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334967.267354:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b6aa lrc: 3/1,0 mode: --/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.267372:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334967.267375:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334967.267380:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b6aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.267400:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b6aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.268476:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b6aa lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.268496:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b6aa lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.268511:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b6aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.268519:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334967.268523:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b6aa lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.268533:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b6aa lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.268556:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b6aa lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.268565:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b6aa lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334967.268710:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+39:2361:x1848989694493312:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 1404us (1655us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763334967.268723:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1746 00010000:00010000:3.0:1763334967.268910:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b69c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdf8 expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.268922:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5acbb5ee00) 00010000:00010000:3.0:1763334967.268926:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334967.268944:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b695 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdf8 expref: 193 pid: 32232 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763334967.268963:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b69c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdf8 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.269021:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5acbb5ee00) 00010000:00010000:3.0:1763334967.269024:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334967.269026:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:3.0:1763334967.269070:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52274:x1848989694493056:12345-192.168.201.60@tcp:101:bash.0 Request processed in 80192us (80630us total) trans 8589938966 rc 0/0 00000100:00100000:3.0:1763334967.269078:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4756 00000001:00080000:0.0:1763334967.269171:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938965 is committed 00000001:00080000:0.0:1763334967.269210:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938966 is committed 00000004:00080000:0.0:1763334967.269224:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 726 committed 00000004:00080000:0.0:1763334967.269242:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 738 committed 00000004:00080000:0.0:1763334967.269252:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 737 committed 00000004:00080000:0.0:1763334967.269255:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 725 committed 00000100:00100000:1.0:1763334967.270098:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701845120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334967.270179:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334967.270291:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701845248:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334967.270322:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.270549:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701845120 00000100:00100000:0.0:1763334967.270558:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701845120 00000100:00100000:0.0:1763334967.270622:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701845248 00000100:00100000:0.0:1763334967.270625:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701845248 00000100:00100000:0.0:1763334967.270643:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4823 00000100:00100000:0.0:1763334967.270652:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3292:x1848989701845120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334967.270822:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4824 00000100:00100000:2.0:1763334967.270834:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3289:x1848989701845248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334967.270979:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa765c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+63:3289:x1848989701845248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (655us total) trans 17179871103 rc 0/0 00000100:00100000:0.0:1763334967.270979:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3292:x1848989701845120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 327us (799us total) trans 17179871102 rc 0/0 00000100:00100000:2.0:1763334967.270988:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4824 00000004:00080000:1.0:1763334967.271282:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad809c380/2, rc 0, transno 17179871103 00000100:00100000:1.0:1763334967.271290:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701845248:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334967.271315:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad809e680/2, rc 0, transno 17179871102 00000100:00100000:1.0:1763334967.271320:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701845120:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334967.271978:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701845504:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334967.272038:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334967.272097:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701845504 00000100:00100000:3.0:1763334967.272103:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701845504 00000100:00100000:2.0:1763334967.272153:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701845376:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334967.272186:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.273046:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4823 00000100:00100000:0.0:1763334967.273084:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701845376 00000100:00100000:0.0:1763334967.273091:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701845376 00000100:00100000:0.0:1763334967.273137:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4825 00000100:00100000:0.0:1763334967.273148:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+24:3290:x1848989701845376:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334967.273975:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb345850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3290:x1848989701845376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 825us (1783us total) trans 21474838382 rc 0/0 00000100:00100000:0.0:1763334967.273986:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4825 00000004:00080000:2.0:1763334967.274185:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81fd500/2, rc 0, transno 21474838382 00000100:00100000:2.0:1763334967.274193:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701845376:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334967.274607:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4826 00000100:00100000:3.0:1763334967.274627:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+24:3291:x1848989701845504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334967.274849:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3291:x1848989701845504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 231us (2809us total) trans 21474838383 rc 0/0 00000100:00100000:3.0:1763334967.274857:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4826 00000004:00080000:2.0:1763334967.275156:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81fdc00/2, rc 0, transno 21474838383 00000100:00100000:2.0:1763334967.275163:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701845504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334967.275298:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.275425:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.275505:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694493440 00000100:00100000:1.0:1763334967.275517:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694493440 00000100:00100000:1.0:1763334967.275602:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4827 00000100:00100000:1.0:1763334967.275612:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+14:52274:x1848989694493440:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334967.275628:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.275659:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b6b1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe06 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334967.275673:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694493568 00000100:00100000:3.0:1763334967.275677:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694493568 00002000:00010000:1.0:1763334967.275687:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x23c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334967.275711:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.275714:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1763334967.275716:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4757 00000100:00100000:3.0:1763334967.275723:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53048:x1848989694493568:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.275726:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b6b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe06 expref: 15 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.275738:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.275744:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b6b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe06 expref: 15 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.275754:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b6b8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe0d expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.275758:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478000, rc 0) 00010000:00010000:3.0:1763334967.275789:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b6bf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.275808:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b6bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.275820:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b6bf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334967.275821:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+15:52274:x1848989694493440:12345-192.168.201.60@tcp:101:bash.0 Request processed in 211us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.275828:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4827 00010000:00010000:3.0:1763334967.275946:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b6b8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe0d expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.276026:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067c00/0xcedf0054f849b6bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe0d expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.276035:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:3.0:1763334967.276039:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763334967.276043:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067c00, rc 0) 00000100:00100000:3.0:1763334967.276082:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53048:x1848989694493568:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 359us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.276089:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4757 00000100:00100000:0.0:1763334967.279698:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.279818:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694493696 00000100:00100000:1.0:1763334967.279832:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694493696 00000100:00100000:1.0:1763334967.279909:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4828 00000100:00100000:1.0:1763334967.279922:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+39:52274:x1848989694493696:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334967.279948:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.279981:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b6c6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe14 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334967.280013:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x240:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334967.280047:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.280050:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.280062:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b6c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe14 expref: 40 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.280082:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b6c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe14 expref: 40 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.280103:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334967.280536:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+40:52274:x1848989694493696:12345-192.168.201.60@tcp:101:bash.0 Request processed in 615us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.280545:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4828 00000100:00100000:2.0:1763334967.280566:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.280645:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694493824 00000100:00100000:0.0:1763334967.280650:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694493824 00000100:00100000:0.0:1763334967.280835:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1747 00000100:00100000:0.0:1763334967.280846:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694493824:12345-192.168.201.60@tcp:4:lfs.0 00002000:00010000:0.0:1763334967.280890:0:14384:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x23b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334967.280899:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b6cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.280910:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.280912:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.280916:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b6cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.280928:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b6cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334967.283826:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.284090:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.284091:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694493952 00000100:00100000:1.0:1763334967.284105:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694493952 00002000:00010000:1.0:1763334967.284154:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/572 (0->18446744073709551615) 00002000:00100000:1.0:1763334967.284160:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac841aa00 with x1848989694493952 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334967.284178:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac841aa00. 00000100:00100000:1.0:1763334967.284206:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694494080 00000100:00100000:1.0:1763334967.284210:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694494080 00002000:00010000:1.0:1763334967.284235:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/576 (0->18446744073709551615) 00002000:00100000:1.0:1763334967.284239:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac8418e00 with x1848989694494080 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334967.284245:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac8418e00. 00000100:00100000:1.0:1763334967.284267:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1748 00000100:00100000:1.0:1763334967.284278:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694493952:12345-192.168.201.60@tcp:10:bash.0 00000100:00100000:3.0:1763334967.285675:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1749 00000100:00100000:3.0:1763334967.285697:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+40:2360:x1848989694494080:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:3.0:1763334967.285980:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334967.285984:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb mtime from disk: 0 -> 1763334967 00002000:00010000:3.0:1763334967.285987:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334967.285989:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb ctime from disk: 0 -> 1763334967 00002000:00010000:3.0:1763334967.285991:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x240:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334967.286361:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+41:2360:x1848989694494080:12345-192.168.201.60@tcp:10:bash.0 Request processed in 672us (2268us total) trans 17179871104 rc 0/0 00000100:00100000:3.0:1763334967.286374:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1749 00002000:00010000:3.0:1763334967.286380:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/576 (0->18446744073709551615) 00002000:00100000:3.0:1763334967.286383:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac8418e00 with x1848989694494080 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334967.286385:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x23c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334967.286388:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x23c:0x0] updating lvb mtime from disk: 0 -> 1763334967 00002000:00010000:3.0:1763334967.286391:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac8418e00. 00002000:00010000:1.0:1763334967.286391:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x23c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334967.286393:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x23c:0x0] updating lvb ctime from disk: 0 -> 1763334967 00002000:00010000:1.0:1763334967.286395:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x23c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334967.286420:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694493952:12345-192.168.201.60@tcp:10:bash.0 Request processed in 2144us (2608us total) trans 21474838385 rc 0/0 00000100:00100000:1.0:1763334967.286427:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1748 00002000:00010000:1.0:1763334967.286430:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/572 (0->18446744073709551615) 00002000:00100000:1.0:1763334967.286433:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac841aa00 with x1848989694493952 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334967.286438:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac841aa00. 00000100:00100000:1.0:1763334967.290522:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.291698:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694494336 00000100:00100000:0.0:1763334967.291717:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694494336 00000100:00100000:0.0:1763334967.291800:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1747 00000100:00100000:0.0:1763334967.291813:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694494336:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:0.0:1763334967.292353:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa766680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694494336:12345-192.168.201.60@tcp:35:bash.0 Request processed in 541us (1846us total) trans 8589938967 rc 0/0 00000100:00100000:0.0:1763334967.292361:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1747 00000100:00100000:2.0:1763334967.298610:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.298704:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694494464 00000100:00100000:3.0:1763334967.298720:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694494464 00000100:00100000:3.0:1763334967.298786:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4758 00000100:00100000:3.0:1763334967.298797:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53051:x1848989694494464:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:3.0:1763334967.298828:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.298859:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b6d4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe1b expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.298948:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b6db lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.298965:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b6db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.298980:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b6db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.298996:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b6e2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299003:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299010:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299165:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b6e9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299174:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299182:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334967.299238:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a1:0x0]: returning size 5 00000004:00200000:3.0:1763334967.299244:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334967.299270:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299283:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b6e9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299293:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b6db lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299300:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b6db lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299307:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b6db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299314:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.299319:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b6db lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299328:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b6db lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299342:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.299347:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.299353:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b6db lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299358:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849b6db lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299372:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b6e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299377:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b6e2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299383:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299387:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.299390:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b6e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299396:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b6e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299402:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5acbb5e600) 00010000:00010000:3.0:1763334967.299405:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.299407:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b6e2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299413:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b6e2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.299450:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b6d4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe1b expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.299470:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b6e9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe1b expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.299477:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5acbb5ee00) 00010000:00010000:3.0:1763334967.299479:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334967.299481:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:3.0:1763334967.305764:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53051:x1848989694494464:12345-192.168.201.60@tcp:101:rm.0 Request processed in 6944us (7180us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.305783:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4758 00000100:00100000:2.0:1763334967.310545:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.310823:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694494720 00000100:00100000:3.0:1763334967.310837:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694494720 00000100:00100000:3.0:1763334967.310908:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4759 00000100:00100000:3.0:1763334967.310922:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53051:x1848989694494720:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:3.0:1763334967.310994:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1763334967.311033:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b6e9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe1b expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.311057:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b69c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a1:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdf8 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.311068:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5acbb5ee00) 00010000:00010000:3.0:1763334967.311081:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334967.311111:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b6f0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.311128:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b6f0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.311144:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b6f0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.311159:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b6f7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.311166:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b6f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.311172:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b6f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.311313:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b6fe lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.311322:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b6fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.311329:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b6fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:3.0:1763334967.311912:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1108, 64 off94840 00000040:00080000:3.0:1763334967.311987:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1119, 64 off95928 00000040:00080000:3.0:1763334967.312005:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1120, 64 off95992 00000040:00080000:3.0:1763334967.312020:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1109, 64 off94904 00010000:00010000:3.0:1763334967.312095:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b705 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312105:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b705 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312113:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b705 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312125:0:32232:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b705 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312131:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b705 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312137:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b705 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312154:0:32232:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763334967.312178:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b6fe lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312184:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b6fe lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312190:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b6fe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312196:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.312201:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b6fe lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312209:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b6fe lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312232:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5ac71b4100) 00010000:00010000:3.0:1763334967.312235:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1763334967.312239:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b6fe lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312246:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b6fe lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312359:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b6f0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312365:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b6f0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312370:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b6f0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312375:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.312378:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b6f0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312384:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b6f0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312392:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.312394:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.312397:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b6f0 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.312402:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b6f0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:3.0:1763334967.312412:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c59edbfc reply state 00000000e6b84dad transno 8589938968 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b6f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334967.312420:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334967.312530:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53051:x1848989694494720:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1608us (1996us total) trans 8589938968 rc 0/0 00000100:00100000:3.0:1763334967.312540:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4759 00010000:00010000:2.0:1763334967.312809:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334967.312818:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b705 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.312826:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334967.312830:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b705 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.312836:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b705 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.312847:0:8205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a1:0x0].0x0 (ffff9a5ac71b4100) 00010000:00010000:2.0:1763334967.312849:0:8205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763334967.312852:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b705 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.312857:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849b705 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.312873:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334967.312875:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334967.312877:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334967.318153:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b6f7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.318183:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b6f7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.318193:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b6f7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.318200:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.318207:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b6f7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.318226:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b6f7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.318251:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4800) 00010000:00010000:3.0:1763334967.318256:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.318263:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b6f7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.318269:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b6f7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334967.332774:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.333024:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694494848 00000100:00100000:3.0:1763334967.333039:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694494848 00000100:00100000:3.0:1763334967.333110:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4760 00000100:00100000:3.0:1763334967.333124:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53052:x1848989694494848:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334967.333156:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.333188:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b70c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe22 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.333293:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b713 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333314:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b713 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333328:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b713 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333345:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b71a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333352:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b71a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333358:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b71a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333440:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b713 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333448:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b713 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333456:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b713 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333463:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.333468:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b713 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333477:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b713 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333491:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.333495:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.333501:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b713 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333508:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b713 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333520:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b71a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333526:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b71a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333532:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b71a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333537:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.333540:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b71a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333545:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b71a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333552:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac71b4100) 00010000:00010000:3.0:1763334967.333555:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.333558:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b71a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333564:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b71a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.333635:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b70c lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe22 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.333647:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.333650:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.333655:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b70c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe22 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.333664:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:3.0:1763334967.333752:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53052:x1848989694494848:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 631us (998us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334967.333762:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4760 00000100:00100000:2.0:1763334967.335804:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.335972:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694494976 00000100:00100000:3.0:1763334967.335986:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694494976 00002000:00010000:3.0:1763334967.336388:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:3.0:1763334967.336394:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb mtime from disk: 0 -> 1763334967 00002000:00010000:3.0:1763334967.336397:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb ctime from disk: 0 -> 1763334967 00002000:00010000:3.0:1763334967.336399:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1763334967.336416:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b6cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.336429:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b6cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.336438:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b6cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.336446:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334967.336450:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b6cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.336460:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b6cd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.336488:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b6cd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.336495:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b6cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763334967.336567:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838384 is committed 00000001:00080000:1.0:1763334967.336607:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838382 is committed 00000100:00100000:3.0:1763334967.336614:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694493824:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 55768us (56045us total) trans 21474838384 rc 0/0 00000100:00100000:3.0:1763334967.336625:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1747 00000001:00080000:1.0:1763334967.336671:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838383 is committed 00000100:00100000:0.0:1763334967.337238:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4761 00000100:00100000:0.0:1763334967.337266:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53052:x1848989694494976:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334967.337297:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.337324:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b721 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe29 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.337418:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b728 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337434:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b728 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337447:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b728 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337462:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b72f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337468:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b72f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337475:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b72f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337563:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b728 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337596:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b728 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337603:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b728 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337610:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.337614:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b728 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337622:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b728 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337634:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334967.337638:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.337642:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b728 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337648:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b728 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337664:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b72f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337670:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b72f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337675:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b72f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337680:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.337683:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b72f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337689:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b72f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337696:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60800) 00010000:00010000:0.0:1763334967.337699:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.337701:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b72f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337706:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b72f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.337744:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b721 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe29 expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.337755:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334967.337758:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.337761:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b721 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe29 expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.337770:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334967.337822:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53052:x1848989694494976:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 572us (2032us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334967.337829:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4761 00000100:00100000:2.0:1763334967.340364:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.340534:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694495104 00000100:00100000:3.0:1763334967.340554:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694495104 00000100:00100000:3.0:1763334967.340710:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4762 00000100:00100000:3.0:1763334967.340722:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53052:x1848989694495104:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334967.340750:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.340780:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe30 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.340913:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b73d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.340931:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b73d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.340944:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b73d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334967.341027:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334967.341032:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334967.341064:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b73d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.341103:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849b736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe30 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.341126:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b73d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe30 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.341137:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.341141:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334967.341145:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:3.0:1763334967.341250:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53052:x1848989694495104:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 529us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.341259:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4762 00000100:00100000:2.0:1763334967.345189:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.346338:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694495232 00000100:00100000:0.0:1763334967.346356:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694495232 00000100:00100000:1.0:1763334967.347170:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4763 00000100:00100000:1.0:1763334967.347186:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53052:x1848989694495232:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.347225:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.347267:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b744 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe37 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.347374:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b74b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347393:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b74b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347408:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b74b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347428:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b752 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347435:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b752 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347441:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b752 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347532:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b74b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347540:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b74b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347547:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b74b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347554:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.347559:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b74b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347567:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b74b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347609:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.347613:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.347620:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b74b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347627:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b74b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347644:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b752 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347651:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b752 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347656:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b752 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347661:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.347664:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b752 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347671:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b752 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347678:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa500) 00010000:00010000:1.0:1763334967.347680:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.347683:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b752 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347689:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b752 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.347733:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b744 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe37 expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.347745:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.347748:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.347751:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b744 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe37 expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.347762:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334967.347860:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53052:x1848989694495232:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 676us (2687us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334967.347869:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4763 00000100:00100000:2.0:1763334967.353784:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.354226:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694495488 00000100:00100000:1.0:1763334967.354244:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694495488 00000100:00100000:1.0:1763334967.354343:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4764 00000100:00100000:1.0:1763334967.354358:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53052:x1848989694495488:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.354391:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.354396:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334967.354437:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849b73d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe30 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.354465:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.354472:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334967.354492:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b759 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe3e expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.354794:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b760 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.354811:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b760 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.354823:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b760 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.354838:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b767 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.354844:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b767 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.354850:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b767 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.355560:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b76e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.355616:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b76e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.355627:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b76e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334967.355639:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a3:0x0]: returning size 0 00010000:00010000:1.0:1763334967.355675:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b760 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.355682:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b760 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.355689:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b760 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.355695:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.355700:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b760 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.355709:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b760 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.355719:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.355722:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.355727:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b760 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.355733:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b760 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:1.0:1763334967.355750:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001f9b08cd reply state 00000000f66fabc9 transno 8589938969 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b767 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334967.355759:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763334967.355795:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b759 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe3e expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.355811:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b76e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe3e expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.355823:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:1.0:1763334967.355825:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334967.355827:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334967.355933:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53052:x1848989694495488:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1578us (2167us total) trans 8589938969 rc 0/0 00000100:00100000:1.0:1763334967.355943:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4764 00000100:00100000:3.0:1763334967.359619:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.359687:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.359845:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694496000 00000100:00100000:1.0:1763334967.359860:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694496000 00000100:00100000:1.0:1763334967.359945:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694495744 00000100:00100000:1.0:1763334967.359950:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694495744 00000100:00100000:1.0:1763334967.359980:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4765 00000100:00100000:1.0:1763334967.359998:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4766 00000100:00100000:1.0:1763334967.360020:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53048:x1848989694495744:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334967.360120:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334967.360159:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b68e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a0:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdea expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.360185:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334967.360191:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334967.360305:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b77c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.360316:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b767 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.360325:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b77c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.360328:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b767 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.360341:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b767 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.360342:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b77c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.360357:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.360365:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b767 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.360374:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b767 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.360389:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa500) 00010000:00010000:0.0:1763334967.360393:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.360397:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b767 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.360403:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b767 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334967.360459:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53052:x1848989694496000:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334967.360473:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.360489:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b783 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe45 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.360610:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00000004:00010000:1.0:1763334967.360624:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fc09ce67 reply state 00000000bf83cb16 transno 8589938970 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b77c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.360625:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b76e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe3e expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.360642:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334967.360643:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763334967.360690:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b76e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe3e expref: 191 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.360706:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b76e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe3e expref: 191 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334967.360724:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701845632:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334967.360756:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53048:x1848989694495744:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 737us (1067us total) trans 8589938970 rc 0/0 00000100:00100000:1.0:1763334967.360765:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4766 00000100:00100000:0.0:1763334967.360809:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1f00 going to sleep for 11 seconds 00010000:00010000:0.0:1763334967.363608:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b77c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.363635:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b77c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.363644:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b77c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.363651:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.363657:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b77c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.363667:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b77c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.363691:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334967.363695:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.363701:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b77c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.363709:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b77c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:2.0:1763334967.366004:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.366044:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.366142:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694496128 00000100:00100000:3.0:1763334967.366146:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694496256 00000100:00100000:3.0:1763334967.366156:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694496256 00000100:00100000:1.0:1763334967.366156:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694496128 00010000:00010000:3.0:1763334967.366225:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b76e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe3e expref: 190 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:1.0:1763334967.366238:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4829 00000100:00100000:1.0:1763334967.366255:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+12:53048:x1848989694496128:12345-192.168.201.60@tcp:101:lfs.0 00000100:00100000:3.0:1763334967.366272:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2545 00010000:00010000:1.0:1763334967.366279:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763334967.366284:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:2360:x1848989694496256:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334967.366304:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334967.366312:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b76e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe3e expref: 190 pid: 29627 timeout: 1131 lvb_type: 0 00010000:00010000:1.0:1763334967.366314:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b791 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe4c expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.366335:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b76e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe3e expref: 190 pid: 29627 timeout: 1131 lvb_type: 0 00002000:00010000:1.0:1763334967.366356:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x23b:0x0] initial LVB size: 4096, mtime: 0x691a5b37, atime: 0x0, ctime: 0x691a5b37, blocks: 0xb 00010000:00010000:3.0:1763334967.366372:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:3.0:1763334967.366379:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.366382:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.366386:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334967.366390:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.366397:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b791 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe4c expref: 13 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.366401:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.366425:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b791 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe4c expref: 13 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.366433:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334967.366441:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00010000:00010000:0.0:1763334967.366557:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849b76e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe3e expref: 190 pid: 29627 timeout: 1131 lvb_type: 0 00000100:00100000:0.0:1763334967.366601:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701845632:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334967.366630:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.366641:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.366648:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:0.0:1763334967.366672:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a3:0x0]: returning size 0 00000100:00100000:3.0:1763334967.367726:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2360:x1848989694496256:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1435us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.367740:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2545 00000100:00100000:1.0:1763334967.367904:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+13:53048:x1848989694496128:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1651us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.367913:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4829 00000004:00080000:0.0:1763334967.367928:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x242:0x0], index 1: 0 00000004:00080000:0.0:1763334967.367943:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23e:0x0], index 0: 0 00000004:00080000:0.0:1763334967.367952:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23f:0x0], index 0: 0 00000004:00080000:0.0:1763334967.367958:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x243:0x0], index 1: 0 00010000:00010000:0.0:1763334967.368179:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.368189:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.368196:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.368202:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.368207:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.368224:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.368244:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:0.0:1763334967.368247:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334967.368259:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.368266:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b78a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.368347:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b783 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe45 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.368358:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334967.368360:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334967.368364:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b783 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe45 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.368373:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334967.370512:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53052:x1848989694496000:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 10503us (10889us total) trans 8589938971 rc 301/301 00000100:00100000:0.0:1763334967.370530:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4765 00000100:00100000:2.0:1763334967.374483:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.374601:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694496512 00000100:00100000:0.0:1763334967.374615:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694496512 00000100:00100000:0.0:1763334967.374679:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1748 00000100:00100000:0.0:1763334967.374691:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53052:x1848989694496512:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334967.375195:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53052:x1848989694496512:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 503us (724us total) trans 8589938972 rc 0/0 00000100:00100000:0.0:1763334967.375206:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1748 00000100:00100000:2.0:1763334967.377852:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.378328:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694496640 00000100:00100000:1.0:1763334967.378343:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694496640 00000100:00100000:1.0:1763334967.378420:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4830 00000100:00100000:1.0:1763334967.378435:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+41:53048:x1848989694496640:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.378460:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.378493:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b79f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe53 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334967.378527:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x23f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334967.378558:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.378562:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.378590:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b79f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe53 expref: 42 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.378614:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b79f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe53 expref: 42 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.378629:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334967.378714:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+42:53048:x1848989694496640:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 283us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.378724:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4830 00000100:00100000:2.0:1763334967.379798:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.380744:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694496896 00000100:00100000:3.0:1763334967.380760:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694496896 00000100:00100000:3.0:1763334967.380847:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1749 00000100:00100000:3.0:1763334967.380860:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53052:x1848989694496896:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334967.381242:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53052:x1848989694496896:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 357us (1423us total) trans 8589938973 rc 0/0 00000100:00100000:3.0:1763334967.381253:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1749 00000100:00100000:1.0:1763334967.387562:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.387669:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.387773:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694497024 00000100:00100000:3.0:1763334967.387788:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694497024 00002000:00010000:3.0:1763334967.387853:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/571 (5->18446744073709551615) 00002000:00100000:3.0:1763334967.387859:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa764e00 with x1848989694497024 ext(5->18446744073709551615) 00002000:00010000:3.0:1763334967.387876:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa764e00. 00000100:00100000:3.0:1763334967.387910:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694497152 00000100:00100000:3.0:1763334967.387914:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694497152 00002000:00010000:3.0:1763334967.387928:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/575 (0->18446744073709551615) 00002000:00100000:3.0:1763334967.387931:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa765500 with x1848989694497152 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334967.387937:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa765500. 00000100:00100000:3.0:1763334967.387971:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1750 00000100:00100000:3.0:1763334967.387982:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2362:x1848989694497024:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:3.0:1763334967.388405:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:3.0:1763334967.388410:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb mtime from disk: 1763334967 -> 1763334968 00002000:00010000:3.0:1763334967.388413:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334967.388415:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb ctime from disk: 1763334967 -> 1763334968 00002000:00010000:3.0:1763334967.388418:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1763334967.388498:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa764e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2362:x1848989694497024:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 517us (956us total) trans 21474838386 rc 0/0 00000100:00100000:3.0:1763334967.388508:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1750 00002000:00010000:3.0:1763334967.388513:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/571 (5->18446744073709551615) 00002000:00100000:3.0:1763334967.388515:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa764e00 with x1848989694497024 ext(5->18446744073709551615) 00002000:00010000:3.0:1763334967.388520:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa764e00. 00000100:00100000:3.0:1763334967.388543:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1751 00000100:00100000:3.0:1763334967.388551:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+42:2362:x1848989694497152:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:3.0:1763334967.388822:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334967.388826:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb mtime from disk: 0 -> 1763334968 00002000:00010000:3.0:1763334967.388828:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334967.388831:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb ctime from disk: 0 -> 1763334968 00002000:00010000:3.0:1763334967.388833:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334967.388859:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa765500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+43:2362:x1848989694497152:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 309us (1188us total) trans 17179871105 rc 0/0 00000100:00100000:3.0:1763334967.388866:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1751 00002000:00010000:3.0:1763334967.388870:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/575 (0->18446744073709551615) 00002000:00100000:3.0:1763334967.388872:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa765500 with x1848989694497152 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334967.388877:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa765500. 00000100:00100000:2.0:1763334967.391986:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.394527:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.395955:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694497408 00000100:00100000:0.0:1763334967.395974:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694497408 00000100:00100000:1.0:1763334967.396202:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694497664 00000100:00100000:1.0:1763334967.396208:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694497664 00000100:00100000:0.0:1763334967.396448:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4767 00000100:00100000:0.0:1763334967.396463:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53048:x1848989694497408:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334967.396644:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b7a6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.396672:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.396686:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334967.396880:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b7f36bee reply state 00000000d6ba85ab transno 8589938974 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334967.396891:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334967.397029:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53048:x1848989694497408:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 569us (5057us total) trans 8589938974 rc 0/0 00000100:00100000:0.0:1763334967.397036:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4767 00000100:00100000:0.0:1763334967.397063:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4768 00000100:00100000:0.0:1763334967.397071:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:52274:x1848989694497664:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334967.397083:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.397098:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b7ad lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe5a expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334967.400142:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334967.400318:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b7b4 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400343:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b7b4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400356:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b7b4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400375:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b7bb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400387:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b7bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400393:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b7bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400557:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b7c2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400567:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b7c2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400611:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b7c2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334967.400626:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a3:0x0]: returning size 0 00010000:00010000:0.0:1763334967.400760:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b7b4 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400769:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b7b4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400777:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b7b4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400784:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.400789:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b7b4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400799:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b7b4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400813:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334967.400817:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.400823:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b7b4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400829:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b7b4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400844:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b7bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400849:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b7bb lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400855:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b7bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400859:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.400861:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b7bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400867:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b7bb lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400873:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60800) 00010000:00010000:0.0:1763334967.400875:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.400877:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b7bb lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400882:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b7bb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.400942:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b7ad lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe5a expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.400963:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b7c2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe5a expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.400970:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334967.400973:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334967.400975:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334967.401046:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:52274:x1848989694497664:12345-192.168.201.60@tcp:101:bash.0 Request processed in 3974us (6535us total) trans 8589938975 rc 0/0 00000100:00100000:0.0:1763334967.401056:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4768 00010000:00010000:1.0:1763334967.401368:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b7a6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.401377:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b7a6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.401383:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b7a6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.401387:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.401391:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b7a6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.401397:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b7a6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.401407:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334967.401410:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.401413:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b7a6 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.401419:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b7a6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334967.401534:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694497792 00000100:00100000:3.0:1763334967.401546:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694497792 00000100:00100000:3.0:1763334967.401630:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4831 00000100:00100000:3.0:1763334967.401642:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+43:53048:x1848989694497792:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334967.401661:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.401679:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849b7d0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe61 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.401711:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b6a3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdff expref: 44 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334967.401720:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334967.401723:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334967.401728:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849b7d0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe61 expref: 44 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.401768:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b6a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdff expref: 44 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334967.401785:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b6a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdff expref: 44 pid: 25383 timeout: 1132 lvb_type: 1 00000100:00100000:3.0:1763334967.401806:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701845760:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334967.401890:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad094ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334967.405895:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.405938:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.406196:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694498048 00000100:00100000:0.0:1763334967.406218:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694498048 00000100:00100000:3.0:1763334967.406337:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701845760:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334967.406390:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849b7d0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe61 expref: 44 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.406416:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:0.0:1763334967.406432:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4769 00000100:00100000:0.0:1763334967.406444:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52274:x1848989694498048:12345-192.168.201.60@tcp:36:bash.0 00000100:00100000:3.0:1763334967.406495:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+44:53048:x1848989694497792:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4856us (6369us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.406504:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4831 00010000:00010000:0.0:1763334967.406522:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334967.406561:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849b7c2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe5a expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.406609:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334967.406621:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334967.406839:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694498176 00000100:00100000:1.0:1763334967.406845:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694498176 00010000:00010000:1.0:1763334967.406870:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b6a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdff expref: 44 pid: 25383 timeout: 1132 lvb_type: 1 00000100:00100000:1.0:1763334967.406894:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2546 00000100:00100000:1.0:1763334967.406901:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+44:2360:x1848989694498176:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334967.406911:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334967.406969:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b7d7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.406985:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.406996:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:0.0:1763334967.407059:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938976 00000004:00010000:0.0:1763334967.407083:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d52aca23 reply state 000000008eb77ad4 transno 8589938977 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334967.407093:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334967.407164:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52274:x1848989694498048:12345-192.168.201.60@tcp:36:bash.0 Request processed in 721us (1284us total) trans 8589938977 rc 0/0 00000100:00100000:0.0:1763334967.407170:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4769 00000020:00080000:0.0:1763334967.407174:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763334967.407444:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b6a3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdff expref: 44 pid: 25383 timeout: 1132 lvb_type: 1 00010000:00010000:1.0:1763334967.407458:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b6a3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdff expref: 44 pid: 25383 timeout: 1132 lvb_type: 1 00010000:00010000:1.0:1763334967.407477:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b6a3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afdff expref: 44 pid: 25383 timeout: 1132 lvb_type: 1 00010000:00010000:1.0:1763334967.407491:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.407493:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.407501:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849b7d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe61 expref: 43 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.407513:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849b7d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe61 expref: 43 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.407561:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849b7d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe61 expref: 43 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334967.407594:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa767b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701845888:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334967.407679:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac36bfcc0 going to sleep for 11 seconds 00010000:00010000:3.0:1763334967.409987:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b7d7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.410012:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b7d7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.410020:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b7d7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.410093:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.410101:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b7d7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.410110:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b7d7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334967.410364:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.410475:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694498304 00010000:00010000:3.0:1763334967.410477:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ac7d60900) 00010000:00010000:3.0:1763334967.410482:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.410489:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b7d7 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334967.410489:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694498304 00010000:00010000:3.0:1763334967.410496:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b7d7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334967.410553:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4770 00000100:00100000:2.0:1763334967.410565:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+194:52274:x1848989694498304:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334967.410619:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.410645:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b7de lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe68 expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.410719:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b7de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe68 expref: 195 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.410735:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b7de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe68 expref: 195 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.410755:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334967.410758:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334967.410761:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9a00, rc 0) 00000100:00100000:2.0:1763334967.410835:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52274:x1848989694498304:12345-192.168.201.60@tcp:101:bash.0 Request processed in 272us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334967.410843:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4770 00000100:00100000:0.0:1763334967.412011:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.412108:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa767b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701845888:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334967.412138:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334967.412188:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+43:2360:x1848989694498176:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5286us (6248us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.412200:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2546 00000100:00100000:3.0:1763334967.412424:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694498432 00000100:00100000:3.0:1763334967.412431:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694498432 00000100:00100000:3.0:1763334967.412488:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4832 00000100:00100000:3.0:1763334967.412499:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+43:2360:x1848989694498432:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:3.0:1763334967.412811:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:3.0:1763334967.412816:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb mtime from disk: 1763334967 -> 1763334967 00002000:00010000:3.0:1763334967.412820:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb atime from disk: 0 -> 1763334967 00002000:00010000:3.0:1763334967.412823:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb ctime from disk: 1763334967 -> 1763334968 00002000:00010000:3.0:1763334967.412825:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334967.412873:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+44:2360:x1848989694498432:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 375us (870us total) trans 17179871106 rc 0/0 00000100:00100000:3.0:1763334967.412881:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4832 00000100:00100000:0.0:1763334967.415686:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.415771:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694498688 00000100:00100000:2.0:1763334967.415787:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694498688 00000100:00100000:0.0:1763334967.415787:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.415833:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694498944 00000100:00100000:1.0:1763334967.415838:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694498944 00000100:00100000:1.0:1763334967.415898:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1750 00000100:00100000:1.0:1763334967.415910:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53048:x1848989694498944:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:1.0:1763334967.415988:0:29630:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x1a0:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b5a7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afda4 expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.416053:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334967.416069:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b672 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afde3 expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.416079:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334967.416128:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b672 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afde3 expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334967.416183:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4771 00000100:00100000:2.0:1763334967.416191:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+196:52274:x1848989694498688:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334967.416202:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.416207:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334967.416233:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849b7de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe68 expref: 196 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.416261:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334967.416274:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334967.416290:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b7ec lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe6f expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.416338:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b7f3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334967.416349:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b7f3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:2.0:1763334967.416360:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b7f3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000040:00080000:2.0:1763334967.416846:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1121, 88 off96080 00000004:00080000:2.0:1763334967.416858:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032050285844ns, next at 1032427980316ns, rc = 0 00000040:00080000:2.0:1763334967.416901:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1110, 88 off94992 00000004:00080000:2.0:1763334967.416907:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032050334782ns, next at 1032427929403ns, rc = 0 00000040:00080000:2.0:1763334967.416934:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1111, 88 off95080 00000004:00080000:2.0:1763334967.416939:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032050367238ns, next at 1032427929403ns, rc = 0 00000040:00080000:2.0:1763334967.416954:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1122, 88 off96168 00000004:00080000:2.0:1763334967.416958:0:29629:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032050386339ns, next at 1032427980316ns, rc = 0 00010000:00010000:1.0:1763334967.418453:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b672 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afde3 expref: 197 pid: 29627 timeout: 1132 lvb_type: 0 00000100:00100000:1.0:1763334967.418478:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa767b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701846016:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334967.418659:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac36bfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334967.425699:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.425802:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694499072 00000100:00100000:0.0:1763334967.425812:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694499072 00000100:00100000:1.0:1763334967.425827:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa767b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701846016:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334967.425859:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.425859:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b672 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afde3 expref: 198 pid: 29627 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.425906:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2547 00000100:00100000:0.0:1763334967.425916:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+198:2359:x1848989694499072:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334967.425934:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334967.425943:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b672 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afde3 expref: 198 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.425957:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b672 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afde3 expref: 198 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.425989:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b672 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afde3 expref: 198 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.426010:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334967.426016:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.426028:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.426037:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.426067:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334967.426093:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334967.426100:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:0.0:1763334967.426133:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694499072:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 217us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.426141:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2547 00000040:00080000:0.0:1763334967.429092:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1123, 88 off96256 00000004:00080000:0.0:1763334967.429115:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032062542290ns, next at 1032427980316ns, rc = 0 00000040:00080000:0.0:1763334967.429176:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1112, 88 off95168 00000004:00080000:0.0:1763334967.429182:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032062610220ns, next at 1032427929403ns, rc = 0 00000040:00080000:0.0:1763334967.429207:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1113, 88 off95256 00000004:00080000:0.0:1763334967.429222:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032062650743ns, next at 1032427929403ns, rc = 0 00000040:00080000:0.0:1763334967.429242:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1124, 88 off96344 00000004:00080000:0.0:1763334967.429246:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032062673857ns, next at 1032427980316ns, rc = 0 00000001:00080000:3.0:1763334967.460418:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938977 is committed 00000001:00080000:1.0:1763334967.460711:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938978 is committed 00000004:00080000:1.0:1763334967.460718:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 740 committed 00000004:00080000:1.0:1763334967.460729:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 728 committed 00000004:00080000:1.0:1763334967.460736:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 727 committed 00000004:00080000:1.0:1763334967.460738:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 739 committed 00000100:00100000:0.0:1763334967.462055:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701846528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.462150:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.462192:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701847040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334967.462232:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.462258:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1763334967.462265:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701846144:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.462286:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.462305:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701846656:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334967.462327:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.462356:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701846272:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.462379:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.462398:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701846784:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334967.462421:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.462440:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1763334967.462445:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701846400:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.462465:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.462482:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701846912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334967.462501:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.462540:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701846528 00000100:00100000:0.0:1763334967.462551:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701846528 00000100:00100000:0.0:1763334967.462628:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701847040 00000100:00100000:0.0:1763334967.462631:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701847040 00000100:00100000:0.0:1763334967.462651:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701846144 00000100:00100000:0.0:1763334967.462654:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701846144 00000100:00100000:0.0:1763334967.462663:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701846656 00000100:00100000:0.0:1763334967.462665:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701846656 00000100:00100000:0.0:1763334967.462672:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701846272 00000100:00100000:0.0:1763334967.462674:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701846272 00000100:00100000:0.0:1763334967.462682:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701846784 00000100:00100000:0.0:1763334967.462684:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701846784 00000100:00100000:0.0:1763334967.462692:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701846400 00000100:00100000:0.0:1763334967.462694:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701846400 00000100:00100000:0.0:1763334967.462701:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701846912 00000100:00100000:0.0:1763334967.462702:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701846912 00000100:00100000:0.0:1763334967.462715:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4833 00000100:00100000:0.0:1763334967.462725:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+65:3291:x1848989701846528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.463009:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3291:x1848989701846528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 283us (858us total) trans 17179871107 rc 0/0 00000100:00100000:0.0:1763334967.463017:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4833 00000100:00100000:0.0:1763334967.463036:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4834 00000100:00100000:0.0:1763334967.463042:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701847040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334967.463185:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701847040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (953us total) trans 21474838387 rc 0/0 00000100:00100000:0.0:1763334967.463192:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4834 00000100:00100000:0.0:1763334967.463205:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4835 00000100:00100000:0.0:1763334967.463223:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+65:3291:x1848989701846144:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334967.463238:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:576 count 1 00010000:00010000:0.0:1763334967.463263:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.463288:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b6c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe14 expref: 43 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.463298:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334967.463300:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334967.463305:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.463344:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b6c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe14 expref: 43 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.463360:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b6c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe14 expref: 43 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.463372:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701847168:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334967.463442:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1300 going to sleep for 11 seconds 00000100:00100000:0.0:1763334967.463463:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4836 00000100:00100000:0.0:1763334967.463471:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701846656:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334967.463484:0:25383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:572 count 1 00010000:00010000:0.0:1763334967.463498:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.463510:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b6b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe06 expref: 13 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.463517:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334967.463518:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334967.463521:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.463540:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b6b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe06 expref: 13 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.463549:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b6b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe06 expref: 13 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.463559:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701847296:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334967.463607:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1000 going to sleep for 11 seconds 00000100:00100000:0.0:1763334967.463626:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4837 00000100:00100000:0.0:1763334967.463634:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3289:x1848989701846272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334967.463648:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:577 count 1 00002000:00010000:0.0:1763334967.463676:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x241:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334967.463682:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b808 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.463690:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.463691:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.463697:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.463710:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.463720:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b808 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.463727:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b808 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.463749:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334967.463962:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3289:x1848989701846272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 328us (1581us total) trans 17179871108 rc 0/0 00000100:00100000:0.0:1763334967.463972:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4837 00000100:00100000:0.0:1763334967.463990:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4838 00000100:00100000:0.0:1763334967.463997:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701846784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334967.464009:0:7819:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:573 count 1 00002000:00010000:0.0:1763334967.464025:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x23d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334967.464030:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b80f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464038:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.464039:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.464042:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b80f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464053:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b80f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464060:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b80f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464067:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b80f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464083:0:7819:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1763334967.464281:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701846784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 284us (1857us total) trans 21474838388 rc 0/0 00000100:00100000:0.0:1763334967.464288:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4838 00000100:00100000:0.0:1763334967.464303:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4839 00000100:00100000:0.0:1763334967.464310:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+65:3289:x1848989701846400:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.464440:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+66:3289:x1848989701846400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 130us (1973us total) trans 17179871109 rc 0/0 00000100:00100000:0.0:1763334967.464446:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4839 00000100:00100000:0.0:1763334967.464459:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4840 00000100:00100000:0.0:1763334967.464466:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701846912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334967.464625:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701846912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 159us (2122us total) trans 21474838389 rc 0/0 00000100:00100000:0.0:1763334967.464632:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4840 00010000:00010000:0.0:1763334967.464662:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1763334967.464671:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b808 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464680:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334967.464685:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b808 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464695:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b808 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464715:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b808 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464722:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849b808 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464739:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334967.464744:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b80f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464750:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334967.464754:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b80f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464760:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b80f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464769:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b80f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464776:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b80f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.464787:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.464788:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.464790:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.464797:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334967.464859:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1fd180/2, rc 0, transno 17179871107 00000100:00100000:0.0:1763334967.464874:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701846528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.464889:0:3291:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838383 gen 2 00000004:00080000:0.0:1763334967.464894:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af68cdf80, transno 21474838361 00000004:00080000:0.0:1763334967.464903:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af68cea00, transno 21474838362 00000004:00080000:0.0:1763334967.464907:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af68cfb80, transno 21474838363 00000004:00080000:0.0:1763334967.464910:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af68cf100, transno 21474838364 00000004:00080000:0.0:1763334967.464912:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6bec380, transno 21474838366 00000004:00080000:0.0:1763334967.464916:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6bed500, transno 21474838367 00000004:00080000:0.0:1763334967.464919:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e14000, transno 21474838368 00000004:00080000:0.0:1763334967.464921:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6bed880, transno 21474838369 00000004:00080000:0.0:1763334967.464924:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca871880, transno 21474838370 00000004:00080000:0.0:1763334967.464927:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e14e00, transno 21474838371 00000004:00080000:0.0:1763334967.464930:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6beea00, transno 21474838372 00000004:00080000:0.0:1763334967.464932:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e15180, transno 21474838373 00000004:00080000:0.0:1763334967.464935:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6451880, transno 21474838375 00000004:00080000:0.0:1763334967.464939:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aef0a2a00, transno 21474838376 00000004:00080000:0.0:1763334967.464942:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4e680, transno 21474838377 00000004:00080000:0.0:1763334967.464945:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4ca80, transno 21474838378 00000004:00080000:0.0:1763334967.464948:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa766d80, transno 21474838380 00000004:00080000:0.0:1763334967.464952:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77d880, transno 21474838381 00000004:00080000:0.0:1763334967.464954:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fd500, transno 21474838382 00000004:00080000:0.0:1763334967.464956:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fdc00, transno 21474838383 00000100:00100000:0.0:1763334967.464964:0:3291:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5afb1ff480 x1848989701847040/t21474838387(21474838387) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334983 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763334967.464972:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1ff480/2, rc 0, transno 21474838387 00000100:00100000:0.0:1763334967.464976:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701847040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334967.465286:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 2 changes, 4 in progress, 3 in flight, 20 done 00000004:00080000:0.0:1763334967.465313:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1fea00/2, rc 0, transno 17179871109 00000100:00100000:0.0:1763334967.465324:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701846400:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334967.465332:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1fc700/2, rc 0, transno 21474838389 00000100:00100000:0.0:1763334967.465336:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701846912:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334967.465344:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1fd880/2, rc 0, transno 17179871108 00000100:00100000:0.0:1763334967.465347:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701846272:0@lo:6:osp-syn-1-0.0 00000004:00080000:0.0:1763334967.465353:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1fe300/2, rc 0, transno 21474838388 00000100:00100000:0.0:1763334967.465356:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701846784:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763334967.466893:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b7f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe6f expref: 186 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.466922:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:2.0:1763334967.466925:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334967.466954:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b7ec lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe6f expref: 186 pid: 29629 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763334967.466979:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b7f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a3:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe6f expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.467038:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:2.0:1763334967.467042:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334967.467044:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8800, rc 0) 00000100:00100000:2.0:1763334967.467157:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694498688:12345-192.168.201.60@tcp:101:bash.0 Request processed in 50963us (51481us total) trans 8589938978 rc 0/0 00000100:00100000:2.0:1763334967.467168:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4771 00000100:00100000:2.0:1763334967.467847:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701847168:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334967.467883:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334967.475067:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.475311:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694499200 00000100:00100000:1.0:1763334967.475326:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694499200 00000100:00100000:1.0:1763334967.475390:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4841 00000100:00100000:1.0:1763334967.475401:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+44:52274:x1848989694499200:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334967.475425:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.475457:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b816 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe76 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334967.475492:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x242:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334967.475523:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.475526:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.475538:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe76 expref: 45 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.475558:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe76 expref: 45 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.475593:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334967.475671:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+45:52274:x1848989694499200:12345-192.168.201.60@tcp:101:bash.0 Request processed in 271us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.475679:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4841 00000100:00100000:2.0:1763334967.475866:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.476699:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694499328 00000100:00100000:1.0:1763334967.476709:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694499328 00010000:00010000:1.0:1763334967.476751:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b6c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe14 expref: 45 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.476965:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701847296:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334967.477000:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334967.478323:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2548 00000100:00100000:1.0:1763334967.478341:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+45:2362:x1848989694499328:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334967.478362:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334967.478372:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b6c6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe14 expref: 45 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:1.0:1763334967.478391:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b6c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe14 expref: 45 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:1.0:1763334967.478424:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b6c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe14 expref: 45 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:1.0:1763334967.478443:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.478446:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.478452:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.478463:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.478503:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334967.478601:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+44:2362:x1848989694499328:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 265us (2733us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.478610:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2548 00000100:00100000:3.0:1763334967.479377:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.479419:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.479444:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694499584 00000100:00100000:3.0:1763334967.479455:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694499584 00000100:00100000:3.0:1763334967.479498:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4842 00000100:00100000:3.0:1763334967.479509:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+14:52274:x1848989694499584:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334967.479528:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.479554:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b81d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe7d expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334967.479622:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x23e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334967.479643:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334967.479645:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334967.479653:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b81d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe7d expref: 15 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.479671:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b81d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe7d expref: 15 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.479683:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:3.0:1763334967.479720:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+15:52274:x1848989694499584:12345-192.168.201.60@tcp:101:bash.0 Request processed in 214us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.479727:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4842 00000100:00100000:2.0:1763334967.479925:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694499456 00000100:00100000:2.0:1763334967.479930:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694499456 00010000:00010000:2.0:1763334967.479955:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b6b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe06 expref: 15 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.479975:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2549 00000100:00100000:2.0:1763334967.479982:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2361:x1848989694499456:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334967.479990:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334967.479995:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b6b1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe06 expref: 15 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.480005:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b6b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe06 expref: 15 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.480026:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b6b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe06 expref: 15 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.480039:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334967.480041:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334967.480044:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.480051:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.480074:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334967.480095:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694499456:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 114us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334967.480101:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2549 00010000:00010000:2.0:1763334967.480158:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.480167:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.480177:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.480185:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.480205:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334967.480616:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701846656:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17143us (18285us total) trans 21474838390 rc 0/0 00000100:00100000:2.0:1763334967.480624:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4836 00000004:00080000:2.0:1763334967.480685:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1fdc00/2, rc 0, transno 21474838390 00000100:00100000:2.0:1763334967.480700:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701846656:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763334967.480904:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334967.480914:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.480925:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334967.480930:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.480941:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.480955:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.480963:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b801 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.480982:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334967.480984:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334967.480986:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334967.482711:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.482750:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.482853:0:21633:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694499712 00000100:00100000:2.0:1763334967.482867:0:21633:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694499712 00002000:00010000:2.0:1763334967.482921:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/578 (0->18446744073709551615) 00002000:00100000:2.0:1763334967.482927:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad81fea00 with x1848989694499712 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334967.482943:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad81fea00. 00000100:00100000:2.0:1763334967.482967:0:21633:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694499840 00000100:00100000:2.0:1763334967.482969:0:21633:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694499840 00002000:00010000:2.0:1763334967.482979:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/574 (0->18446744073709551615) 00002000:00100000:2.0:1763334967.482982:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad81ff800 with x1848989694499840 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334967.482989:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ad81ff800. 00000100:00100000:2.0:1763334967.483007:0:21633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1752 00000100:00100000:2.0:1763334967.483017:0:21633:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+44:2360:x1848989694499712:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334967.483411:0:21633:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x242:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334967.483416:0:21633:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x242:0x0] updating lvb mtime from disk: 0 -> 1763334968 00002000:00010000:2.0:1763334967.483419:0:21633:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x242:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334967.483421:0:21633:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x242:0x0] updating lvb ctime from disk: 0 -> 1763334968 00002000:00010000:2.0:1763334967.483423:0:21633:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x242:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334967.483491:0:21633:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+45:2360:x1848989694499712:12345-192.168.201.60@tcp:10:bash.0 Request processed in 474us (795us total) trans 17179871110 rc 0/0 00000100:00100000:2.0:1763334967.483505:0:21633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1752 00002000:00010000:2.0:1763334967.483510:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/578 (0->18446744073709551615) 00002000:00100000:2.0:1763334967.483513:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad81fea00 with x1848989694499712 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334967.483517:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad81fea00. 00000100:00100000:2.0:1763334967.483539:0:21633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1753 00000100:00100000:2.0:1763334967.483547:0:21633:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694499840:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334967.483752:0:21633:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x23e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334967.483756:0:21633:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x23e:0x0] updating lvb mtime from disk: 0 -> 1763334968 00002000:00010000:2.0:1763334967.483758:0:21633:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x23e:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334967.483760:0:21633:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x23e:0x0] updating lvb ctime from disk: 0 -> 1763334968 00002000:00010000:2.0:1763334967.483763:0:21633:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x23e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334967.483786:0:21633:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694499840:12345-192.168.201.60@tcp:10:bash.0 Request processed in 240us (1035us total) trans 21474838391 rc 0/0 00000100:00100000:2.0:1763334967.483793:0:21633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1753 00002000:00010000:2.0:1763334967.483796:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/574 (0->18446744073709551615) 00002000:00100000:2.0:1763334967.483798:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad81ff800 with x1848989694499840 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334967.483802:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ad81ff800. 00010000:00010000:0.0:1763334967.485013:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.485032:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.485044:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.485052:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.485078:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334967.485430:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+66:3291:x1848989701846144:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22216us (23139us total) trans 17179871111 rc 0/0 00000100:00100000:0.0:1763334967.485440:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4835 00010000:00010000:0.0:1763334967.485481:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334967.485488:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.485497:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334967.485502:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.485512:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.485540:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.485546:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849b7fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.485593:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.485595:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.485597:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334967.485650:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afb1fed80/2, rc 0, transno 17179871111 00000100:00100000:0.0:1763334967.485668:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701846144:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334967.491111:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.493816:0:30956:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694500096 00000100:00100000:0.0:1763334967.493836:0:30956:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694500096 00000100:00100000:0.0:1763334967.493984:0:30956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1751 00000100:00100000:0.0:1763334967.493994:0:30956:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeb29050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:52274:x1848989694500096:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:0.0:1763334967.494515:0:30956:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeb29050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694500096:12345-192.168.201.60@tcp:35:bash.0 Request processed in 518us (3415us total) trans 8589938980 rc 0/0 00000100:00100000:0.0:1763334967.494523:0:30956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1751 00000004:00010000:1.0:1763334967.510345:0:29630:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000e63e6ad reply state 00000000904a9eb3 transno 8589938979 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:1.0:1763334967.510372:0:29630:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1763334967.510388:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:1.0:1763334967.510392:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334967.510403:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b5a7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afda4 expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334967.511243:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53048:x1848989694498944:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 95330us (95449us total) trans 8589938979 rc 0/0 00000100:00100000:1.0:1763334967.511258:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1750 00000001:00080000:1.0:1763334967.511373:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938979 is committed 00000004:00080000:1.0:1763334967.511382:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 742 committed 00000004:00080000:1.0:1763334967.511391:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 730 committed 00000004:00080000:1.0:1763334967.511404:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 729 committed 00000004:00080000:1.0:1763334967.511407:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 741 committed 00010000:00010000:0.0:1763334967.511544:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.511554:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.511567:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.511591:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.511596:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.511604:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.511620:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334967.511622:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334967.511626:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.511632:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b7e5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00000100:00100000:0.0:1763334967.511662:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701847552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334967.511726:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.511812:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701847680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.511835:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.511861:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701847808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.511882:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.511902:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763334967.511907:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701847424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334967.511928:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.511957:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701847552 00000100:00100000:0.0:1763334967.511966:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701847552 00000100:00100000:0.0:1763334967.512011:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701847680 00000100:00100000:0.0:1763334967.512014:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701847680 00000100:00100000:0.0:1763334967.512031:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701847808 00000100:00100000:0.0:1763334967.512034:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701847808 00000100:00100000:0.0:1763334967.512048:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701847424 00000100:00100000:0.0:1763334967.512050:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701847424 00000100:00100000:0.0:1763334967.512071:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4843 00000100:00100000:0.0:1763334967.512080:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701847552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334967.512388:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763334967.512393:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb mtime from disk: 1763334968 -> 1763334968 00002000:00010000:0.0:1763334967.512395:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334967.512397:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb ctime from disk: 1763334968 -> 1763334968 00002000:00010000:0.0:1763334967.512399:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x23b:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1763334967.512440:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701847552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 359us (712us total) trans 21474838392 rc 0/0 00000100:00100000:0.0:1763334967.512446:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4843 00000100:00100000:0.0:1763334967.512464:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4844 00000100:00100000:0.0:1763334967.512471:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3290:x1848989701847680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334967.512618:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763334967.512621:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb mtime from disk: 1763334967 -> 1763334967 00002000:00010000:0.0:1763334967.512623:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb atime from disk: 1763334967 -> 1763334967 00002000:00010000:0.0:1763334967.512625:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb ctime from disk: 1763334968 -> 1763334968 00002000:00010000:0.0:1763334967.512627:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334967.512658:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3290:x1848989701847680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (821us total) trans 17179871112 rc 0/0 00000100:00100000:0.0:1763334967.512664:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4844 00000100:00100000:0.0:1763334967.512677:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4845 00000100:00100000:0.0:1763334967.512683:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3291:x1848989701847808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334967.512759:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334967.512763:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb mtime from disk: 1763334968 -> 1763334968 00002000:00010000:0.0:1763334967.512765:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334967.512767:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb ctime from disk: 1763334968 -> 1763334968 00002000:00010000:0.0:1763334967.512770:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x23f:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334967.512797:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3291:x1848989701847808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 114us (914us total) trans 17179871113 rc 0/0 00000100:00100000:0.0:1763334967.512804:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4845 00000100:00100000:0.0:1763334967.512816:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4846 00000100:00100000:0.0:1763334967.512823:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701847424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334967.512929:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334967.512933:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb mtime from disk: 1763334967 -> 1763334967 00002000:00010000:0.0:1763334967.512936:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334967.512938:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb ctime from disk: 1763334967 -> 1763334967 00002000:00010000:0.0:1763334967.512940:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x23a:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:0.0:1763334967.512964:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701847424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 141us (1034us total) trans 21474838393 rc 0/0 00000100:00100000:0.0:1763334967.512970:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4846 00000004:00080000:0.0:1763334967.513043:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab30a80/2, rc 0, transno 17179871112 00000100:00100000:0.0:1763334967.513050:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701847680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334967.513071:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa767b80/2, rc 0, transno 21474838392 00000100:00100000:0.0:1763334967.513075:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa767b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701847552:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334967.513091:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa766680/2, rc 0, transno 21474838393 00000100:00100000:0.0:1763334967.513094:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701847424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334967.513102:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab31500/2, rc 0, transno 17179871113 00000100:00100000:0.0:1763334967.513106:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701847808:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334967.513638:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.514298:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694500224 00000100:00100000:0.0:1763334967.514308:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694500224 00000100:00100000:3.0:1763334967.514761:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4772 00000100:00100000:1.0:1763334967.515408:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+183:53053:x1848989694500224:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:1.0:1763334967.515434:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.515459:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b824 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe84 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.515544:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b82b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.515561:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b82b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.515718:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b82b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.515738:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b832 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.515745:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b832 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.515751:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b832 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.515884:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b839 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.515891:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b839 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.515897:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b839 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334967.515936:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a3:0x0]: returning size 5 00000004:00200000:1.0:1763334967.515940:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334967.515961:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b839 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.515972:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b839 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.515980:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b82b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.515987:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b82b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.515993:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b82b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.515998:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.516003:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b82b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.516010:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b82b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.516022:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.516025:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.516029:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b82b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.516035:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b82b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.516046:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b832 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.516051:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b832 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.516055:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b832 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.516060:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.516063:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b832 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.516068:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b832 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.516073:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa000) 00010000:00010000:1.0:1763334967.516075:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.516077:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b832 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.516082:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b832 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.516111:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b824 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe84 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.516122:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b839 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe84 expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.516128:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:1.0:1763334967.516130:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334967.516132:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334967.516304:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53053:x1848989694500224:12345-192.168.201.60@tcp:101:rm.0 Request processed in 1532us (2669us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.516313:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4772 00000100:00100000:2.0:1763334967.520566:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.521008:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.521082:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694500480 00000100:00100000:0.0:1763334967.521096:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694500480 00000100:00100000:0.0:1763334967.521172:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694500608 00000100:00100000:0.0:1763334967.521176:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694500608 00000100:00100000:0.0:1763334967.521203:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4773 00000100:00100000:0.0:1763334967.521225:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53053:x1848989694500480:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:0.0:1763334967.521307:0:29629:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1763334967.521343:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b839 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe84 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.521368:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b7f3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a3:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe6f expref: 184 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.521381:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:0.0:1763334967.521394:0:29629:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334967.521427:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b840 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.521444:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b840 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.521454:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b840 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.521472:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b847 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.521479:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b847 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.521486:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b847 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.521677:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b84e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.521687:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b84e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.521694:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b84e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000040:00080000:0.0:1763334967.522319:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1125, 64 off96408 00000040:00080000:0.0:1763334967.522362:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1114, 64 off95320 00000040:00080000:0.0:1763334967.522380:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1115, 64 off95384 00000040:00080000:0.0:1763334967.522396:0:29629:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1126, 64 off96472 00010000:00010000:0.0:1763334967.522480:0:29629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b855 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522491:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b855 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522500:0:29629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b855 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522508:0:29629:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b855 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522514:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b855 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522520:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b855 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522552:0:29629:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763334967.522602:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b84e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522609:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b84e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522616:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b84e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522623:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.522628:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b84e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522636:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b84e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522648:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ac7d60800) 00010000:00010000:0.0:1763334967.522651:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1763334967.522655:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b84e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522662:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849b84e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a3:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522734:0:29629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b840 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522741:0:29629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b840 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522746:0:29629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b840 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522754:0:29629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.522758:0:29629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b840 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522764:0:29629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b840 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522772:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334967.522774:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.522777:0:29629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b840 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.522783:0:29629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849b840 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000004:00010000:0.0:1763334967.522792:0:29629:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000000e73b683 reply state 000000005ce86038 transno 8589938981 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b847 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29629 initiator: MDT0 00000100:00100000:0.0:1763334967.522801:0:29629:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334967.522918:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53053:x1848989694500480:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1690us (2362us total) trans 8589938981 rc 0/0 00000100:00100000:0.0:1763334967.522927:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4773 00000100:00100000:0.0:1763334967.522967:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4774 00000100:00100000:0.0:1763334967.522982:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53048:x1848989694500608:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334967.523002:0:29629:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.523016:0:29629:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b85c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe8b expref: -99 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.523069:0:29629:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b85c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe8b expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.523084:0:29629:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792600/0xcedf0054f849b85c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe8b expref: 185 pid: 29629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.523102:0:29629:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:0.0:1763334967.523105:0:29629:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334967.523108:0:29629:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792600, rc 0) 00000100:00100000:0.0:1763334967.523130:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53048:x1848989694500608:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 154us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.523136:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4774 00010000:00010000:0.0:1763334967.523168:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334967.523174:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b855 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.523180:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334967.523183:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b855 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.523189:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b855 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.523199:0:8206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a3:0x0].0x0 (ffff9a5ac7d60800) 00010000:00010000:0.0:1763334967.523201:0:8206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763334967.523204:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b855 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.523224:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b855 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29629 initiator: MDT0 00010000:00010000:0.0:1763334967.523240:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.523242:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.523245:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334967.527080:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b847 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334967.527104:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b847 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334967.527117:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b847 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334967.527124:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.527130:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b847 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334967.527139:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b847 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334967.527161:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60100) 00010000:00010000:1.0:1763334967.527165:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.527170:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b847 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00010000:00010000:1.0:1763334967.527177:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849b847 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29629 initiator: MDT0 00000100:00100000:2.0:1763334967.535509:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.536865:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.537481:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694500736 00000100:00100000:1.0:1763334967.537497:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694500736 00000100:00100000:1.0:1763334967.537610:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4775 00000100:00100000:1.0:1763334967.537621:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53054:x1848989694500736:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.537653:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.537681:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b863 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe92 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.537763:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b86a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.537779:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b86a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.537792:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b86a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.537807:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b871 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.537813:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b871 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.537818:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b871 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334967.538001:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694500992 00000100:00100000:0.0:1763334967.538007:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694500992 00000100:00100000:0.0:1763334967.538039:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1752 00000100:00100000:0.0:1763334967.538048:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53048:x1848989694500992:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:0.0:1763334967.538535:0:29630:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x1a0:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1763334967.538676:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1127, 64 off96536 00000040:00080000:0.0:1763334967.538705:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1116, 64 off95448 00000040:00080000:0.0:1763334967.538721:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1117, 64 off95512 00000040:00080000:0.0:1763334967.538737:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1128, 64 off96600 00010000:00010000:0.0:1763334967.538832:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b878 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.538850:0:29630:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b878 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.538862:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b878 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.538871:0:29630:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b878 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.538878:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b878 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334967.538885:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b878 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334967.539049:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b86a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539057:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b86a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539065:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b86a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539074:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.539079:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b86a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539089:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b86a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539107:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.539110:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.539118:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b86a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539125:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b86a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539140:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b871 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539146:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b871 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539152:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b871 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539158:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.539161:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b871 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539166:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b871 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539173:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa000) 00010000:00010000:1.0:1763334967.539175:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.539178:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b871 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539183:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b871 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.539558:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b863 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe92 expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.539600:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.539603:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.539608:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b863 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe92 expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.539626:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334967.539738:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53054:x1848989694500736:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2117us (4241us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334967.539748:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4775 00010000:00010000:0.0:1763334967.544448:0:29630:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334967.544766:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53048:x1848989694500992:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 6709us (7902us total) trans 8589938982 rc 0/0 00000100:00100000:0.0:1763334967.544780:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1752 00010000:00010000:2.0:1763334967.545461:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334967.545477:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b878 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334967.545493:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334967.545499:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b878 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334967.545511:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b878 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334967.545536:0:5736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a0:0x0].0x0 (ffff9a5ac71b4400) 00010000:00010000:2.0:1763334967.545540:0:5736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763334967.545547:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b878 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334967.545554:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849b878 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a0:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334967.545601:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334967.545603:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334967.545605:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334967.550352:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.550437:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694501120 00000100:00100000:1.0:1763334967.550452:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694501120 00000100:00100000:1.0:1763334967.550540:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4776 00000100:00100000:1.0:1763334967.550552:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53054:x1848989694501120:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.550649:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.550679:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b87f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afe99 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.550804:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b886 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.550823:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b886 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.550837:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b886 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.550852:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b88d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.550859:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b88d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.550867:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b88d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.550959:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b886 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.550968:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b886 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.550976:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b886 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.550984:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.550989:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b886 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.550999:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b886 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.551014:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.551018:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.551023:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b886 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.551031:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b886 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.551045:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b88d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.551051:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b88d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.551057:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b88d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.551067:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.551070:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b88d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.551075:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b88d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.551082:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa000) 00010000:00010000:1.0:1763334967.551085:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.551087:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b88d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.551093:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849b88d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.551132:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b87f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe99 expref: 186 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.551144:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.551147:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.551151:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b87f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe99 expref: 186 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.551160:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334967.551262:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53054:x1848989694501120:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 712us (927us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334967.551271:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4776 00000100:00100000:3.0:1763334967.555026:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.555096:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694501376 00000100:00100000:1.0:1763334967.555113:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694501376 00000100:00100000:1.0:1763334967.555199:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4777 00000100:00100000:1.0:1763334967.555221:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53048:x1848989694501376:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.555254:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.555285:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b894 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afea0 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.555392:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b89b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.555409:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b89b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.555423:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b89b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.555442:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8a2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.555450:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.555456:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.555547:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b89b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.555555:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b89b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.555561:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b89b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.555568:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00000100:00100000:2.0:1763334967.555950:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.555991:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694501504 00000100:00100000:3.0:1763334967.555997:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694501504 00010000:00010000:1.0:1763334967.556012:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b89b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.556021:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b89b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.556034:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.556038:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.556043:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b89b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334967.556046:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4778 00010000:00010000:1.0:1763334967.556050:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b89b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334967.556055:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53054:x1848989694501504:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.556064:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.556065:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.556069:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8a2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.556075:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.556076:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b8a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afea7 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.556080:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.556083:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.556089:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.556094:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa100) 00010000:00010000:1.0:1763334967.556096:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.556099:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8a2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.556108:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.556126:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b8b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.556135:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.556143:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334967.556197:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334967.556201:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334967.556239:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b8b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.556422:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b894 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afea0 expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.556429:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b8a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afea7 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.556434:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.556437:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334967.556440:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b894 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afea0 expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.556444:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b8b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afea7 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.556449:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00010000:00010000:3.0:1763334967.556451:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.556453:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334967.556455:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:1.0:1763334967.556883:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53048:x1848989694501376:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1671us (1873us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334967.556892:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4777 00000100:00100000:3.0:1763334967.557185:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53054:x1848989694501504:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1130us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.557193:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4778 00000100:00100000:3.0:1763334967.565473:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.566308:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694501632 00000100:00100000:1.0:1763334967.566326:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694501632 00000100:00100000:1.0:1763334967.566422:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4779 00000100:00100000:1.0:1763334967.566436:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53054:x1848989694501632:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.566469:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.566500:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b8b7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afeae expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.566641:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8be lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566658:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566674:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566690:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b8c5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566696:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566701:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566787:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8be lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566795:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8be lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566802:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566808:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.566812:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8be lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566820:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8be lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566833:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.566836:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.566841:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8be lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566848:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849b8be lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566863:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566869:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b8c5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566874:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566878:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.566881:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566886:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566893:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa100) 00010000:00010000:1.0:1763334967.566895:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.566898:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b8c5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566903:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b8c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.566941:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b8b7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeae expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.566952:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.566954:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.566958:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b8b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeae expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.566972:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334967.567068:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53054:x1848989694501632:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 635us (1612us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334967.567077:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4779 00000100:00100000:1.0:1763334967.574313:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.574421:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694501888 00000100:00100000:2.0:1763334967.574437:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694501888 00000100:00100000:2.0:1763334967.574516:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4780 00000100:00100000:2.0:1763334967.574528:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53054:x1848989694501888:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334967.574561:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.574565:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1763334967.574646:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849b8b0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afea7 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.574673:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334967.574679:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334967.574699:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b8cc lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afeb5 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.574875:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b8d3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.574893:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.574904:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.574921:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b8da lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.574928:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b8da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.574934:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b8da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.575670:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b8e1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.575683:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.575691:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334967.575703:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 0 00010000:00010000:2.0:1763334967.575730:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b8d3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.575737:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b8d3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.575749:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b8d3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.575756:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.575760:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b8d3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.575767:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b8d3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.575776:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334967.575779:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.575782:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b8d3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.575788:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b8d3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:2.0:1763334967.575798:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005d49ff2a reply state 00000000f8b1968d transno 8589938983 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b8da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:2.0:1763334967.575806:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334967.575838:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b8cc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeb5 expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.575851:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeb5 expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.575858:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:2.0:1763334967.575861:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334967.575863:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9800, rc 0) 00000100:00100000:2.0:1763334967.575970:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa767800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53054:x1848989694501888:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1444us (1677us total) trans 8589938983 rc 0/0 00000100:00100000:2.0:1763334967.575981:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4780 00000100:00100000:1.0:1763334967.578969:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.579027:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694502144 00000100:00100000:3.0:1763334967.579041:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694502144 00010000:00010000:0.0:1763334967.579049:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b8da lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.579064:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b8da lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.579071:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b8da lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.579077:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.579084:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b8da lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.579092:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b8da lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.579112:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334967.579116:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1763334967.579118:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4781 00010000:00010000:0.0:1763334967.579121:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b8da lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.579127:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b8da lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334967.579128:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53054:x1848989694502144:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334967.579161:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.579184:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b8ef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afebc expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.579394:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.579411:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b8e1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeb5 expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.579422:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.579481:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeb5 expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.579500:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b8e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeb5 expref: 188 pid: 29627 timeout: 1132 lvb_type: 0 00000100:00100000:3.0:1763334967.579519:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701847936:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334967.579930:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5ada480 going to sleep for 11 seconds 00000100:00100000:1.0:1763334967.582553:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab37480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701847936:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334967.582643:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334967.585476:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.585671:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.585731:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694502272 00000100:00100000:0.0:1763334967.585748:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694502272 00010000:00010000:0.0:1763334967.585813:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b8e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeb5 expref: 189 pid: 29627 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.585873:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2550 00000100:00100000:0.0:1763334967.585886:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2359:x1848989694502272:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334967.585909:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334967.585922:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b8e1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeb5 expref: 189 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.585938:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeb5 expref: 189 pid: 29627 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.585939:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694502528 00000100:00100000:2.0:1763334967.585944:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694502528 00010000:00010000:0.0:1763334967.585971:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849b8e1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeb5 expref: 190 pid: 29627 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.585982:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4782 00000100:00100000:2.0:1763334967.585989:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53055:x1848989694502528:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334967.585992:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:0.0:1763334967.585998:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.586008:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.586008:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.586016:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.586028:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b8fd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afec3 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.586056:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334967.586122:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b904 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334967.586128:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:2359:x1848989694502272:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 244us (458us total) trans 0 rc 0/0 00010000:00010000:2.0:1763334967.586134:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b904 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334967.586136:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2550 00010000:00010000:2.0:1763334967.586144:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b904 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586159:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b90b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586166:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b90b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586172:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b90b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586714:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b912 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586728:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b912 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586736:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b912 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334967.586746:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 0 00010000:00010000:2.0:1763334967.586864:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b912 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586872:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b912 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586878:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b912 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586883:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.586888:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b912 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586895:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b912 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586904:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:2.0:1763334967.586907:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334967.586912:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b912 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586917:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849b912 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586933:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b904 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586942:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b904 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586947:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b904 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586951:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.586953:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b904 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586958:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b904 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586964:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334967.586966:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.586969:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b904 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586974:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849b904 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586981:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b90b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586987:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b90b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586993:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b90b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.586998:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.587001:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b90b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.587011:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b90b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.587017:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab300) 00010000:00010000:2.0:1763334967.587020:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.587022:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b90b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.587027:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849b90b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.587076:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b8fd lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afec3 expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.587087:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334967.587090:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334967.587094:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849b8fd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afec3 expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.587103:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8a00, rc 0) 00010000:00010000:1.0:1763334967.587276:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.587285:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334967.587299:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 0 00000100:00100000:2.0:1763334967.587541:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53055:x1848989694502528:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1549us (2082us total) trans 8589938984 rc 301/301 00000100:00100000:2.0:1763334967.587551:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4782 00000004:00080000:1.0:1763334967.587674:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x240:0x0], index 0: 0 00000004:00080000:1.0:1763334967.587685:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x244:0x0], index 1: 0 00000004:00080000:1.0:1763334967.587691:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x245:0x0], index 1: 0 00000004:00080000:1.0:1763334967.587697:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x241:0x0], index 0: 0 00010000:00010000:1.0:1763334967.587865:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.587872:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.587883:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.587888:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.587891:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.587897:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.587909:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab900) 00010000:00010000:1.0:1763334967.587912:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334967.587915:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.587920:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849b8f6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.587966:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b8ef lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afebc expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.587976:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.587979:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334967.587982:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849b8ef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afebc expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.587991:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:1.0:1763334967.588050:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa764000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53054:x1848989694502144:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 8923us (9095us total) trans 8589938985 rc 301/301 00000100:00100000:1.0:1763334967.588057:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4781 00000100:00100000:0.0:1763334967.590772:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.592602:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694502784 00000100:00100000:1.0:1763334967.592622:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694502784 00000100:00100000:1.0:1763334967.592719:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1753 00000100:00100000:1.0:1763334967.592730:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53054:x1848989694502784:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334967.594657:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.594825:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694502912 00000100:00100000:2.0:1763334967.594838:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694502912 00000100:00100000:2.0:1763334967.595372:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4783 00000100:00100000:2.0:1763334967.595389:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53055:x1848989694502912:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334967.595418:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.595456:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b927 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afeca expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.595694:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b92e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.595712:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b92e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.595727:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b92e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334967.595762:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 0 00000004:00200000:2.0:1763334967.595767:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334967.595788:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b92e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.595817:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849b927 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeca expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.595838:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b92e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeca expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.595848:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334967.595851:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334967.595855:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abe800, rc 0) 00000100:00100000:2.0:1763334967.597430:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53055:x1848989694502912:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2035us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334967.597443:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4783 00000100:00100000:1.0:1763334967.598522:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53054:x1848989694502784:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 5782us (7752us total) trans 8589938986 rc 0/0 00000100:00100000:1.0:1763334967.598538:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1753 00000100:00100000:0.0:1763334967.601790:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.601860:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694503040 00000100:00100000:1.0:1763334967.601875:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694503040 00000100:00100000:1.0:1763334967.601966:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4847 00000100:00100000:1.0:1763334967.601981:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694503040:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.602007:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.602039:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b935 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afed1 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334967.602079:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x240:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334967.602109:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.602111:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.602125:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b935 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed1 expref: 16 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334967.602144:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b935 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed1 expref: 16 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334967.602161:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334967.602249:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694503040:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 271us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.602270:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4847 00000100:00100000:3.0:1763334967.603164:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.603481:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694503296 00000100:00100000:1.0:1763334967.603494:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694503296 00000100:00100000:1.0:1763334967.603560:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1754 00000100:00100000:1.0:1763334967.603592:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53054:x1848989694503296:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334967.604534:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53054:x1848989694503296:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 958us (1371us total) trans 8589938987 rc 0/0 00000100:00100000:1.0:1763334967.604545:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1754 00000100:00100000:1.0:1763334967.605650:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.605869:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694503552 00000100:00100000:2.0:1763334967.605882:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694503552 00000100:00100000:2.0:1763334967.605943:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1755 00000100:00100000:2.0:1763334967.605954:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53055:x1848989694503552:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334967.606381:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53055:x1848989694503552:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 426us (734us total) trans 8589938988 rc 0/0 00000100:00100000:2.0:1763334967.606390:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1755 00000100:00100000:0.0:1763334967.610447:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.610623:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694503808 00000100:00100000:2.0:1763334967.610637:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694503808 00000100:00100000:2.0:1763334967.610715:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4784 00000100:00100000:2.0:1763334967.610727:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53055:x1848989694503808:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334967.610763:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.610792:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b93c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afed8 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.610899:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b943 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.610918:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b943 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.610933:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b943 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.610949:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b94a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.610955:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b94a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.610962:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b94a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611133:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b951 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611143:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b951 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611149:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b951 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334967.611160:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 0 00010000:00010000:2.0:1763334967.611303:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b943 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611311:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b943 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611318:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b943 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611324:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abf400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.611329:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b943 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611337:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b943 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611351:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334967.611354:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.611360:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b943 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611367:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b943 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611381:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b94a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611391:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b94a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611397:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b94a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611401:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abee00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.611404:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b94a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611409:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b94a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611416:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab300) 00010000:00010000:2.0:1763334967.611418:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.611421:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b94a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611426:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b94a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.611479:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b93c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed8 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.611494:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b951 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed8 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.611502:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334967.611504:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334967.611507:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5aec6d5200, rc 0) 00000100:00100000:2.0:1763334967.611640:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53055:x1848989694503808:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 913us (1220us total) trans 8589938989 rc 0/0 00000100:00100000:2.0:1763334967.611651:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4784 00000100:00100000:3.0:1763334967.618329:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.618407:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694504064 00000100:00100000:2.0:1763334967.618422:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694504064 00000100:00100000:2.0:1763334967.618504:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4785 00000100:00100000:2.0:1763334967.618516:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:52274:x1848989694504064:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334967.618552:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.618618:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f849b95f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afedf expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.619463:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.619730:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b92e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeca expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.619740:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b951 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed8 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.619750:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.619802:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b951 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed8 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.619819:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b951 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed8 expref: 195 pid: 30972 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.619837:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701848064:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334967.619986:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b92e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeca expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.619994:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b92e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeca expref: 195 pid: 30972 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.620003:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701848192:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334967.620030:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac55313c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334967.620472:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.621752:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694504320 00000100:00100000:0.0:1763334967.621770:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694504320 00000100:00100000:3.0:1763334967.621815:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.621850:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694504448 00000100:00100000:0.0:1763334967.621854:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694504448 00010000:00010000:0.0:1763334967.621880:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b951 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed8 expref: 197 pid: 30972 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.621913:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2551 00000100:00100000:0.0:1763334967.621923:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694504448:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334967.621941:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334967.621949:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b951 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed8 expref: 197 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.621960:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b951 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed8 expref: 197 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:3.0:1763334967.621964:0:29627:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.60@tcp) returned -22 from blocking AST (req@000000000e63e6ad x1848989701848064) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b951 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed8 expref: 197 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:3.0:1763334967.621994:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b951 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed8 expref: 197 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.621995:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334967.622000:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.622009:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334967.622012:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8418000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701848064:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334967.622015:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334967.622026:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701848192:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334967.622046:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334967.622050:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.622056:0:29627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334967.622065:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694504448:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 143us (254us total) trans 0 rc 0/0 00010000:00010000:3.0:1763334967.622066:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334967.622073:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2551 00000100:00100000:0.0:1763334967.622102:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1756 00000100:00100000:0.0:1763334967.622110:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53055:x1848989694504320:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334967.622420:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53055:x1848989694504320:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 308us (1948us total) trans 8589938990 rc 0/0 00000100:00100000:0.0:1763334967.622427:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1756 00000100:00100000:3.0:1763334967.622959:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.623013:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694504576 00000100:00100000:0.0:1763334967.623020:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694504576 00010000:00010000:0.0:1763334967.623049:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b92e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeca expref: 196 pid: 30972 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.623387:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2552 00000100:00100000:0.0:1763334967.623397:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694504576:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334967.623413:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334967.623420:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b92e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeca expref: 196 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.623433:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b92e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeca expref: 196 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.623455:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849b92e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeca expref: 196 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.623473:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334967.623477:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.623486:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.623494:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.623525:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334967.623551:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334967.623559:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334967.623606:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2359:x1848989694504576:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 209us (651us total) trans 0 rc 0/0 00000004:00200000:3.0:1763334967.623611:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 0 00000100:00100000:0.0:1763334967.623616:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2552 00010000:00010000:3.0:1763334967.623793:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f849b95f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afedf expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.623811:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afedf expref: 195 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.623825:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334967.623829:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763334967.623831:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5aec6d4a00, rc 0) 00000100:00100000:3.0:1763334967.623872:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52274:x1848989694504064:12345-192.168.201.60@tcp:101:bash.0 Request processed in 5358us (5564us total) trans 8589938991 rc 0/0 00000100:00100000:3.0:1763334967.623881:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4785 00000100:00100000:1.0:1763334967.628683:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.628740:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.628801:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694504832 00000100:00100000:2.0:1763334967.628817:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694504832 00000100:00100000:2.0:1763334967.628890:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694505088 00000100:00100000:2.0:1763334967.628894:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694505088 00000100:00100000:1.0:1763334967.628904:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4786 00000100:00100000:1.0:1763334967.628923:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:52274:x1848989694504832:12345-192.168.201.60@tcp:36:bash.0 00000100:00100000:2.0:1763334967.628964:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4787 00000100:00100000:2.0:1763334967.628972:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53055:x1848989694505088:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334967.628985:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.629018:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b974 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afee6 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.629087:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b97b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629104:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b97b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629118:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b97b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629134:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b982 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629140:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b982 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629146:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b982 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629330:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b989 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629339:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b989 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629347:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b989 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.629353:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334967.629358:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 0 00010000:00010000:1.0:1763334967.629360:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b989 lrc: 2/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.629367:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.629385:0:32232:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b989 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.629396:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.629420:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b97b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629428:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b97b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629436:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b97b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629443:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abf000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.629446:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b97b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629456:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b97b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629471:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334967.629475:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.629480:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b97b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629490:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849b97b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629504:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b982 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629510:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b982 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629515:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b982 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629520:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abee00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.629522:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b982 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629528:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b982 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629535:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab300) 00010000:00010000:2.0:1763334967.629537:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.629539:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b982 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629545:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849b982 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.629619:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849b974 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afee6 expref: 200 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.629641:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b989 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afee6 expref: 199 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.629655:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b989 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afee6 expref: 199 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.629663:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abf400, rc 0) 00000100:00100000:2.0:1763334967.629749:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa765c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53055:x1848989694505088:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 777us (1007us total) trans 8589938993 rc 0/0 00000100:00100000:2.0:1763334967.629758:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4787 00000100:00100000:3.0:1763334967.640817:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.640911:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694505344 00000100:00100000:2.0:1763334967.640930:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694505344 00000100:00100000:2.0:1763334967.641038:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1757 00000100:00100000:2.0:1763334967.641052:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeb29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53055:x1848989694505344:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334967.641636:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeb29850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53055:x1848989694505344:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 583us (833us total) trans 8589938994 rc 0/0 00000100:00100000:2.0:1763334967.641648:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1757 00000100:00100000:1.0:1763334967.647548:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.647646:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.647747:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694505600 00000100:00100000:2.0:1763334967.647762:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694505600 00010000:00010000:2.0:1763334967.647822:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b989 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afee6 expref: 200 pid: 29627 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.647876:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2553 00000100:00100000:2.0:1763334967.647889:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+200:2362:x1848989694505600:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334967.647912:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334967.647920:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b989 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afee6 expref: 200 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.647941:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b989 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afee6 expref: 200 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.647972:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849b989 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afee6 expref: 200 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.647991:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334967.647997:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.648008:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.648016:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.648055:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334967.648131:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa767100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:2362:x1848989694505600:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 242us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334967.648139:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2553 00000100:00100000:0.0:1763334967.648227:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694505472 00000100:00100000:0.0:1763334967.648232:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694505472 00000100:00100000:0.0:1763334967.648271:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1758 00000100:00100000:0.0:1763334967.648280:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53055:x1848989694505472:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:0.0:1763334967.648431:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa766300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53055:x1848989694505472:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 153us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.648439:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1758 00010000:00010000:1.0:1763334967.648538:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.648547:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:1.0:1763334967.648740:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589938992 00000004:00010000:1.0:1763334967.648811:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000061312faa reply state 000000008d3dc97b transno 8589938995 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334967.648822:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334967.648884:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa767480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+200:52274:x1848989694504832:12345-192.168.201.60@tcp:36:bash.0 Request processed in 19970us (20217us total) trans 8589938995 rc 0/0 00000100:00100000:1.0:1763334967.648892:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4786 00000020:00080000:1.0:1763334967.648896:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763334967.657883:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334967.658008:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.658024:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.658033:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.658041:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.658047:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.658057:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.658079:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334967.658084:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.658090:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.658097:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849b990 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334967.658201:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694505728 00000100:00100000:3.0:1763334967.658225:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694505728 00000100:00100000:3.0:1763334967.658307:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4788 00000100:00100000:3.0:1763334967.658319:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+199:52274:x1848989694505728:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334967.658353:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.658376:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b99e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afeed expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.658453:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b99e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeed expref: 200 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.658468:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b99e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeed expref: 200 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.658489:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334967.658492:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334967.658494:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:3.0:1763334967.658613:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+200:52274:x1848989694505728:12345-192.168.201.60@tcp:101:bash.0 Request processed in 296us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.658629:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4788 00000100:00100000:2.0:1763334967.661228:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.661322:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694505984 00000100:00100000:1.0:1763334967.661337:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694505984 00000100:00100000:1.0:1763334967.661404:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4789 00000100:00100000:1.0:1763334967.661414:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+200:52274:x1848989694505984:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334967.661439:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.661442:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334967.661475:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849b99e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afeed expref: 200 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.661496:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:1.0:1763334967.661502:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334967.661518:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b9a5 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afef4 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.661613:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b9ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.661629:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b9ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.661640:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b9ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:1.0:1763334967.662057:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1118, 88 off95600 00000004:00080000:1.0:1763334967.662067:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032295494405ns, next at 1032427929403ns, rc = 0 00000040:00080000:1.0:1763334967.662096:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1129, 88 off96688 00000004:00080000:1.0:1763334967.662100:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032295528107ns, next at 1032427980316ns, rc = 0 00000040:00080000:1.0:1763334967.662138:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1130, 88 off96776 00000004:00080000:1.0:1763334967.662142:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032295569840ns, next at 1032427980316ns, rc = 0 00000040:00080000:1.0:1763334967.662154:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1119, 88 off95688 00000004:00080000:1.0:1763334967.662157:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032295585650ns, next at 1032427929403ns, rc = 0 00000100:00100000:3.0:1763334967.668956:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.669291:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694506240 00000100:00100000:0.0:1763334967.669306:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694506240 00000100:00100000:0.0:1763334967.669380:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4790 00000100:00100000:0.0:1763334967.669393:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53056:x1848989694506240:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334967.669421:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.669451:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b9b3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afefb expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.669612:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9ba lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.669630:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9ba lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.669645:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9ba lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.669659:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9c1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.669665:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.669671:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.669907:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9c8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.669916:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.669926:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334967.669939:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 2 00010000:00010000:0.0:1763334967.670119:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9c8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670127:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9c8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670134:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670141:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.670147:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9c8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670157:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9c8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670172:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334967.670176:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 10 00010000:00010000:0.0:1763334967.670182:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9c8 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670189:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9c8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x10/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670220:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9ba lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670226:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9ba lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670235:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9ba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670240:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.670242:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9ba lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670249:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9ba lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670256:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334967.670259:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.670263:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9ba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670268:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9ba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670277:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670282:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9c1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670287:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670292:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.670295:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670300:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9c1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670307:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60800) 00010000:00010000:0.0:1763334967.670309:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.670312:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9c1 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670316:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9c1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.670363:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b9b3 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afefb expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.670375:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334967.670378:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334967.670381:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849b9b3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afefb expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.670390:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334967.670478:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53056:x1848989694506240:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1088us (1539us total) trans 8589938997 rc 301/301 00000100:00100000:0.0:1763334967.670488:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4790 00000100:00100000:2.0:1763334967.676466:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.676940:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694506368 00000100:00100000:1.0:1763334967.676956:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694506368 00000100:00100000:1.0:1763334967.677028:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4791 00000100:00100000:1.0:1763334967.677041:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53056:x1848989694506368:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.677068:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.677093:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b9d6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff02 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.677217:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.677239:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afedf expref: 204 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.677246:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b9ac lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.678193:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 5/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.678671:0:30972:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b9ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.678724:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afedf expref: 204 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.678742:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afedf expref: 204 pid: 29627 timeout: 1132 lvb_type: 0 00000100:00100000:1.0:1763334967.678766:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5574380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701848320:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334967.678903:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334967.681027:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5574380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701848320:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334967.681072:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334967.681846:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.681970:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694506496 00000100:00100000:1.0:1763334967.681981:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694506496 00010000:00010000:1.0:1763334967.682031:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afedf expref: 205 pid: 29627 timeout: 1132 lvb_type: 0 00000100:00100000:1.0:1763334967.682088:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2554 00000100:00100000:1.0:1763334967.682100:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+205:2360:x1848989694506496:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334967.682120:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334967.682127:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afedf expref: 205 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:1.0:1763334967.682139:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afedf expref: 205 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:1.0:1763334967.682167:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849b966 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afedf expref: 205 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:1.0:1763334967.682185:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:1.0:1763334967.682190:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.682200:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.682218:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.682225:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334967.682308:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2360:x1848989694506496:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 209us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.682317:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2554 00000001:00080000:3.0:1763334967.711605:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938990 is committed 00000001:00080000:3.0:1763334967.711646:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938996 is committed 00000004:00080000:3.0:1763334967.711651:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 732 committed 00000004:00080000:3.0:1763334967.711666:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 744 committed 00000004:00080000:3.0:1763334967.711676:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 743 committed 00000004:00080000:3.0:1763334967.711679:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 731 committed 00000100:00100000:3.0:1763334967.711858:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701848448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334967.711949:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334967.711994:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701848960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334967.712017:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334967.712040:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334967.712046:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701848832:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334967.712064:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334967.712097:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701848448 00000100:00100000:3.0:1763334967.712105:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701848448 00000100:00100000:3.0:1763334967.712159:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701848960 00000100:00100000:3.0:1763334967.712162:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701848960 00000100:00100000:3.0:1763334967.712176:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701848832 00000100:00100000:3.0:1763334967.712179:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701848832 00000100:00100000:3.0:1763334967.712196:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4848 00000100:00100000:3.0:1763334967.712220:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+70:3292:x1848989701848448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334967.712258:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:578 count 1 00010000:00010000:3.0:1763334967.712297:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.712324:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b816 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe76 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.712335:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334967.712338:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334967.712343:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.712375:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe76 expref: 44 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.712391:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe76 expref: 44 pid: 6517 timeout: 1132 lvb_type: 0 00000100:00100000:3.0:1763334967.712405:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701849216:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334967.712480:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1600 going to sleep for 11 seconds 00000100:00100000:0.0:1763334967.712763:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701848576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.712805:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.712838:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701849088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.712862:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.712885:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763334967.712891:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701848704:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.712909:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.712937:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701848576 00000100:00100000:0.0:1763334967.712941:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701848576 00000100:00100000:0.0:1763334967.712971:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701849088 00000100:00100000:0.0:1763334967.712973:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701849088 00000100:00100000:0.0:1763334967.712982:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701848704 00000100:00100000:0.0:1763334967.712984:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701848704 00000100:00100000:0.0:1763334967.712995:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4849 00000100:00100000:0.0:1763334967.713002:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3292:x1848989701848960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.713324:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+74:3292:x1848989701848960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 320us (1304us total) trans 17179871114 rc 0/0 00000100:00100000:0.0:1763334967.713333:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4849 00000100:00100000:0.0:1763334967.713355:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4850 00000100:00100000:0.0:1763334967.713361:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3292:x1848989701848832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334967.713372:0:6517:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:575 count 1 00010000:00010000:0.0:1763334967.713390:0:6517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.713414:0:6517:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b79f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe53 expref: 44 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.713420:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334967.713422:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334967.713425:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.713454:0:6517:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b79f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe53 expref: 44 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.713465:0:6517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b79f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe53 expref: 44 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.713477:0:6517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9831500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6517:1848989701849344:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334967.713490:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b9ac lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afef4 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.713505:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:1.0:1763334967.713508:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334967.713511:0:32232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.713521:0:32232:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.713527:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334967.713530:0:6517:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c96ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1763334967.713552:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4851 00000100:00100000:0.0:1763334967.713558:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+73:3289:x1848989701848576:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763334967.713587:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849b9a5 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afef4 expref: 187 pid: 32232 timeout: 0 lvb_type: 3 00002000:00080000:0.0:1763334967.713591:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:579 count 1 00010000:00010000:1.0:1763334967.713612:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b9ac lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afef4 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334967.713621:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x243:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334967.713626:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.713634:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.713635:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.713640:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.713648:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00010000:00010000:0.0:1763334967.713652:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.713662:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.713670:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334967.713676:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:52274:x1848989694505984:12345-192.168.201.60@tcp:101:bash.0 Request processed in 52265us (52473us total) trans 8589938996 rc 0/0 00000100:00100000:1.0:1763334967.713684:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4789 00010000:00010000:0.0:1763334967.713690:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334967.713723:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.713730:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334967.713768:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 2 00000004:00200000:1.0:1763334967.713773:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334967.713794:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.713825:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849b9d6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff02 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.713835:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff02 expref: 185 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.713843:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:1.0:1763334967.713845:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1763334967.713848:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478800, rc 0) 00000100:00100000:1.0:1763334967.713878:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53056:x1848989694506368:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 36841us (37432us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.713884:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4791 00000100:00100000:0.0:1763334967.713928:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:3289:x1848989701848576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 369us (1122us total) trans 17179871115 rc 0/0 00000100:00100000:0.0:1763334967.713938:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4851 00000100:00100000:0.0:1763334967.713953:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4852 00000100:00100000:0.0:1763334967.713959:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+73:3289:x1848989701849088:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334967.713961:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa3aed80/2, rc 0, transno 17179871115 00000100:00100000:1.0:1763334967.713968:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701848576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.714084:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:3289:x1848989701849088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 125us (1220us total) trans 17179871116 rc 0/0 00000100:00100000:0.0:1763334967.714091:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4852 00000100:00100000:0.0:1763334967.714102:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4853 00000100:00100000:0.0:1763334967.714108:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+73:3289:x1848989701848704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334967.714118:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:574 count 1 00010000:00010000:0.0:1763334967.714129:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.714140:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849b7d0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe61 expref: 44 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.714147:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334967.714149:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334967.714151:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.714169:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849b7d0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe61 expref: 44 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.714179:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849b7d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe61 expref: 44 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.714189:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9830a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701849472:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334967.714231:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c96ee000 going to sleep for 11 seconds 00010000:00010000:0.0:1763334967.714275:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334967.714282:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.714290:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334967.714295:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.714304:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.714319:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9f2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.714325:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793e00/0xcedf0054f849b9f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.714341:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.714343:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.714344:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334967.714365:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa3ae300/2, rc 0, transno 17179871114 00000100:00100000:0.0:1763334967.714370:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701848960:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334967.714650:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa3ad180/2, rc 0, transno 17179871116 00000100:00100000:1.0:1763334967.714656:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701849088:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334967.714858:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701849984:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334967.714899:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334967.714938:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1763334967.714945:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af68cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701849600:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334967.714966:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334967.714981:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701850112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334967.715001:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.715133:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701849984 00000100:00100000:0.0:1763334967.715140:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701849984 00000100:00100000:0.0:1763334967.715471:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701849600 00000100:00100000:0.0:1763334967.715476:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701849600 00000100:00100000:1.0:1763334967.715527:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701850112 00000100:00100000:1.0:1763334967.715531:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701850112 00000100:00100000:1.0:1763334967.715567:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4854 00000100:00100000:1.0:1763334967.715601:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701849984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763334967.715630:0:25383:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:571 count 1 00010000:00010000:1.0:1763334967.715656:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.715674:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b791 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe4c expref: 15 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.715688:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334967.715690:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334967.715693:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.715723:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b791 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe4c expref: 15 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.715733:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b791 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe4c expref: 15 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:1.0:1763334967.715746:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5574380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701850368:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334967.715803:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334967.715866:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4855 00000100:00100000:2.0:1763334967.715876:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701849600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334967.715888:0:6518:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:574 count 1 00010000:00010000:2.0:1763334967.715901:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.715912:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b81d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe7d expref: 15 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.715918:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334967.715920:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334967.715922:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.715938:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b81d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe7d expref: 15 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.715945:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b81d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe7d expref: 15 pid: 32239 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.715954:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca873480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6518:1848989701850496:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334967.715974:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5531cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334967.716042:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4856 00000100:00100000:0.0:1763334967.716051:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701850112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334967.716315:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334967.716319:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1763334967.716321:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334967.716323:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1763334967.716326:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334967.717720:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701849728:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334967.717803:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334967.717844:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701850240:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334967.717865:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334967.717894:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763334967.717902:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701849856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334967.717922:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334967.717961:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701849728 00000100:00100000:1.0:1763334967.717972:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701849728 00000100:00100000:1.0:1763334967.718013:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701850240 00000100:00100000:1.0:1763334967.718015:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701850240 00000100:00100000:1.0:1763334967.718026:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701849856 00000100:00100000:1.0:1763334967.718028:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701849856 00000100:00100000:1.0:1763334967.718043:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4857 00000100:00100000:1.0:1763334967.718051:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701849728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763334967.718094:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:575 count 1 00002000:00010000:1.0:1763334967.718142:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x23f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334967.718151:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ba0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.718168:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.718171:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.718178:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ba0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.718193:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ba0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.718215:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ba0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.718224:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ba0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.718245:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334967.718499:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4858 00000100:00100000:3.0:1763334967.718512:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701850240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334967.718635:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701849728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 584us (832us total) trans 21474838395 rc 0/0 00000100:00100000:1.0:1763334967.718643:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4857 00000100:00100000:1.0:1763334967.718663:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4859 00000100:00100000:1.0:1763334967.718670:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701849856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763334967.718682:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:570 count 1 00000100:00100000:3.0:1763334967.718695:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701850240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 188us (828us total) trans 21474838396 rc 0/0 00010000:00010000:1.0:1763334967.718696:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334967.718703:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4858 00010000:00010000:1.0:1763334967.718712:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b514 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd7a expref: 15 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.718720:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334967.718721:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334967.718724:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.718760:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b514 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd7a expref: 15 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.718774:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b514 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd7a expref: 15 pid: 25383 timeout: 1132 lvb_type: 0 00000100:00100000:1.0:1763334967.718788:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5575180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701850624:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334967.718872:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee9c0 going to sleep for 11 seconds 00000004:00080000:1.0:1763334967.718916:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b4000/2, rc 0, transno 21474838395 00000100:00100000:1.0:1763334967.718923:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701849728:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1763334967.718932:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca871880/2, rc 0, transno 21474838396 00000100:00100000:1.0:1763334967.718935:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701850240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334967.719035:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701850112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2983us (4030us total) trans 21474838394 rc 0/0 00000100:00100000:0.0:1763334967.719043:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4856 00010000:00010000:0.0:1763334967.719068:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334967.719076:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ba0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.719085:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334967.719090:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ba0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.719101:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ba0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.719122:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ba0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.719129:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ba0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.719148:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.719151:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.719152:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1763334967.719262:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afc8eb100/2, rc 0, transno 21474838394 00000100:00100000:2.0:1763334967.719268:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701850112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334967.724891:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.724968:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.725026:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.725052:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.725098:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.725115:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.725134:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.725187:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694506752 00000100:00100000:2.0:1763334967.725196:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694506752 00000100:00100000:3.0:1763334967.725219:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701849216:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334967.725256:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.725257:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe76 expref: 45 pid: 6517 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.725289:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694506880 00000100:00100000:2.0:1763334967.725292:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694506880 00010000:00010000:2.0:1763334967.725307:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b79f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe53 expref: 46 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.725319:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694507008 00000100:00100000:2.0:1763334967.725321:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694507008 00010000:00010000:2.0:1763334967.725332:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849b7d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe61 expref: 47 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.725341:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694507136 00000100:00100000:2.0:1763334967.725343:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694507136 00010000:00010000:2.0:1763334967.725354:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b791 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe4c expref: 16 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.725364:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694507264 00000100:00100000:2.0:1763334967.725366:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694507264 00010000:00010000:2.0:1763334967.725374:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b81d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe7d expref: 17 pid: 32239 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.725392:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2555 00000100:00100000:2.0:1763334967.725400:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+47:2359:x1848989694506752:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334967.725418:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334967.725422:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b816 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe76 expref: 47 pid: 6517 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.725435:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b816 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe76 expref: 47 pid: 6517 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.725464:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849b816 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe76 expref: 47 pid: 6517 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.725483:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334967.725486:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334967.725491:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.725503:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.725536:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334967.725658:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2556 00000100:00100000:0.0:1763334967.725668:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+46:2361:x1848989694506880:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334967.725677:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334967.725681:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b79f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe53 expref: 46 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.725690:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b79f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe53 expref: 46 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.725703:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.725704:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.725708:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.725716:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.725727:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334967.725758:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+46:2361:x1848989694506880:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 93us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.725765:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2556 00000100:00100000:0.0:1763334967.725789:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2557 00000100:00100000:0.0:1763334967.725793:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+45:2361:x1848989694507008:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334967.725800:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334967.725804:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849b7d0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe61 expref: 45 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.725813:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849b7d0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe61 expref: 45 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.725823:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.725824:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.725828:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.725835:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.725843:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334967.725856:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+45:2361:x1848989694507008:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 63us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.725861:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2557 00000100:00100000:0.0:1763334967.725871:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2558 00000100:00100000:0.0:1763334967.725876:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2361:x1848989694507136:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334967.725886:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334967.725889:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b791 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe4c expref: 17 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.725898:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b791 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe4c expref: 17 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.725910:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.725911:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.725915:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.725922:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.725931:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334967.725944:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2361:x1848989694507136:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 68us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.725949:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2558 00000100:00100000:0.0:1763334967.725959:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2559 00000100:00100000:0.0:1763334967.725964:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694507264:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334967.725972:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334967.725976:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b81d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe7d expref: 16 pid: 32239 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.725985:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b81d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe7d expref: 16 pid: 32239 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.725996:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.725998:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.726001:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.726002:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726009:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.726018:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726021:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334967.726029:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.726038:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334967.726039:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694507264:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 75us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.726045:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2559 00010000:00010000:3.0:1763334967.726061:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1763334967.726068:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334967.726074:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726081:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334967.726086:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726095:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726105:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726111:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849b9e4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726131:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.726133:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.726135:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334967.726148:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694507392 00000100:00100000:0.0:1763334967.726152:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694507392 00000100:00100000:0.0:1763334967.726181:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4860 00000100:00100000:0.0:1763334967.726186:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+16:52274:x1848989694507392:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334967.726201:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.726231:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff10 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726251:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b935 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed1 expref: 17 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334967.726258:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.726260:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.726263:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 17 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726296:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b935 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed1 expref: 17 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334967.726310:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b935 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed1 expref: 17 pid: 26564 timeout: 1132 lvb_type: 1 00000100:00100000:0.0:1763334967.726325:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9833100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701850752:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334967.726388:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c96ee600 going to sleep for 11 seconds 00010000:00010000:0.0:1763334967.726424:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849b79f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe53 expref: 44 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.726435:0:6517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9831500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6517:1848989701849344:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334967.726450:0:6517:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726458:0:6517:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726465:0:6517:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726474:0:6517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726480:0:6517:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726498:0:6517:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334967.726770:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+74:3292:x1848989701848832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13408us (14703us total) trans 17179871117 rc 0/0 00000100:00100000:0.0:1763334967.726777:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4850 00010000:00010000:0.0:1763334967.726799:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334967.726804:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726812:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334967.726814:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726822:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726833:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726844:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849b9eb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726857:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.726859:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.726860:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334967.726889:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa3adc00/2, rc 0, transno 17179871117 00000100:00100000:0.0:1763334967.726897:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701848832:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1763334967.726925:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849b7d0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe61 expref: 43 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.726935:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9830a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701849472:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334967.726948:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726956:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726962:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726970:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726976:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.726990:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334967.727153:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+74:3289:x1848989701848704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13044us (14242us total) trans 17179871118 rc 0/0 00000100:00100000:0.0:1763334967.727159:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4853 00010000:00010000:0.0:1763334967.727180:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334967.727185:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.727192:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334967.727194:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.727202:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.727224:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.727231:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849b9f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.727244:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.727246:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.727247:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334967.727271:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa3ace00/2, rc 0, transno 17179871118 00000100:00100000:0.0:1763334967.727276:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701848704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334967.727404:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694506624 00000100:00100000:1.0:1763334967.727410:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694506624 00000100:00100000:1.0:1763334967.727458:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4792 00000100:00100000:1.0:1763334967.727468:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53056:x1848989694506624:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.727486:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.727506:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba23 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff09 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.727596:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba23 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff09 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.727609:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba23 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff09 expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.727633:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:1.0:1763334967.727636:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334967.727640:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334967.727671:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53056:x1848989694506624:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 205us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.727677:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4792 00000100:00100000:3.0:1763334967.727681:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa3ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+74:3292:x1848989701848448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 15476us (15732us total) trans 17179871119 rc 0/0 00000100:00100000:3.0:1763334967.727689:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4848 00000100:00100000:3.0:1763334967.727746:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000004:00080000:0.0:1763334967.727776:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa3adf80/2, rc 0, transno 17179871119 00000100:00100000:0.0:1763334967.727781:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa3adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701848448:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334967.727842:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694507520 00000100:00100000:1.0:1763334967.727846:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694507520 00010000:00010000:1.0:1763334967.727866:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b514 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd7a expref: 18 pid: 25383 timeout: 1132 lvb_type: 0 00000100:00100000:1.0:1763334967.727882:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2560 00000100:00100000:1.0:1763334967.727889:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694507520:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334967.727902:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334967.727906:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b514 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd7a expref: 18 pid: 25383 timeout: 1132 lvb_type: 0 00010000:00010000:1.0:1763334967.727923:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b514 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd7a expref: 18 pid: 25383 timeout: 1132 lvb_type: 0 00010000:00010000:1.0:1763334967.727941:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.727944:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334967.727948:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.727957:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.727974:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334967.727996:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694507520:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 107us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.728003:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2560 00000100:00100000:2.0:1763334967.728102:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+42:2359:x1848989694506752:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 2699us (3130us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334967.728110:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2555 00010000:00010000:2.0:1763334967.728203:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849b81d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe7d expref: 17 pid: 32239 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.728232:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca873480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6518:1848989701850496:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334967.728249:0:6518:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.728259:0:6518:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.728266:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.728275:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.728282:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.728307:0:6518:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334967.728610:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701849600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12735us (13641us total) trans 21474838397 rc 0/0 00000100:00100000:2.0:1763334967.728619:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4855 00010000:00010000:2.0:1763334967.728662:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849b791 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afe4c expref: 16 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.728673:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5574380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701850368:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334967.728686:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.728695:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.728702:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.728710:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.728718:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.728731:0:25383:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000004:00080000:3.0:1763334967.728844:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af68cfb80/2, rc 0, transno 21474838397 00000100:00100000:3.0:1763334967.728850:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af68cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701849600:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334967.728955:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701849984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13354us (14056us total) trans 21474838398 rc 0/0 00000100:00100000:2.0:1763334967.728962:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4854 00010000:00010000:2.0:1763334967.728998:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849b514 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afd7a expref: 15 pid: 25383 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.729009:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5575180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701850624:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334967.729021:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.729029:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.729042:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.729049:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.729056:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.729068:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000100:00100000:2.0:1763334967.729234:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701849856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10564us (11310us total) trans 21474838399 rc 0/0 00000100:00100000:2.0:1763334967.729241:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4859 00000004:00080000:2.0:1763334967.729272:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afc8ead80/2, rc 0, transno 21474838399 00000100:00100000:2.0:1763334967.729277:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701849856:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1763334967.729341:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afc8e8000/2, rc 0, transno 21474838398 00000100:00100000:3.0:1763334967.729346:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701849984:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763334967.729347:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1763334967.729354:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729363:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c3abf400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334967.729367:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729376:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729393:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729402:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729423:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763334967.729427:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729433:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334967.729436:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729443:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729451:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729459:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729471:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334967.729474:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729481:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334967.729485:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729493:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729501:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729508:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.729519:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334967.729521:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334967.729523:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.729601:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334967.729608:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334967.731690:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.731740:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694507776 00000100:00100000:2.0:1763334967.731753:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694507776 00000100:00100000:3.0:1763334967.732192:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.732415:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9833100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701850752:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334967.732460:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 14 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.732485:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334967.732556:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+14:52274:x1848989694507392:12345-192.168.201.60@tcp:101:bash.0 Request processed in 6367us (7419us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.732565:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4860 00000100:00100000:1.0:1763334967.732646:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1759 00000100:00100000:1.0:1763334967.732660:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53056:x1848989694507776:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334967.732726:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.732928:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53056:x1848989694507776:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 271us (1251us total) trans 8589938998 rc 0/0 00000100:00100000:1.0:1763334967.732936:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1759 00000100:00100000:3.0:1763334967.733863:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694508032 00000100:00100000:3.0:1763334967.733879:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694508032 00000100:00100000:3.0:1763334967.733937:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694507904 00000100:00100000:3.0:1763334967.733941:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694507904 00010000:00010000:3.0:1763334967.733963:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b935 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed1 expref: 15 pid: 26564 timeout: 1132 lvb_type: 1 00000100:00100000:3.0:1763334967.733991:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2561 00000100:00100000:3.0:1763334967.733999:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2362:x1848989694507904:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334967.734017:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334967.734023:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b935 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed1 expref: 15 pid: 26564 timeout: 1132 lvb_type: 1 00010000:00010000:3.0:1763334967.734038:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b935 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed1 expref: 15 pid: 26564 timeout: 1132 lvb_type: 1 00010000:00010000:3.0:1763334967.734067:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849b935 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afed1 expref: 15 pid: 26564 timeout: 1132 lvb_type: 1 00010000:00010000:3.0:1763334967.734083:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334967.734086:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334967.734094:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 14 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.734104:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 14 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.734147:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 14 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334967.734164:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701850880:192.168.201.60@tcp:105: 00000100:00100000:3.0:1763334967.734278:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1540 going to sleep for 11 seconds 00000100:00100000:3.0:1763334967.742555:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.742986:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701850880:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334967.743024:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334967.743092:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2362:x1848989694507904:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 9093us (10366us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.743107:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2561 00000100:00100000:3.0:1763334967.743155:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 394 00000100:00100000:3.0:1763334967.743171:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:2362:x1848989694508032:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334967.743193:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334967.743242:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba23 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff09 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.743340:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334967.743346:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334967.743372:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:2362:x1848989694508032:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 209us (11181us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.743380:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 394 00000100:00100000:3.0:1763334967.743672:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694508160 00000100:00100000:3.0:1763334967.743682:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694508160 00000100:00100000:3.0:1763334967.743743:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4793 00000100:00100000:3.0:1763334967.743752:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53056:x1848989694508160:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334967.743783:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.743805:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ba2a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff17 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.743920:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ba31 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.743938:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ba31 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.743952:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ba31 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.743969:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849ba38 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.743977:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849ba38 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.743983:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849ba38 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745558:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ba3f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745597:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ba3f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745609:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ba3f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334967.745662:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 2 00000004:00200000:3.0:1763334967.745668:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334967.745690:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ba3f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745701:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ba3f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745710:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ba31 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745722:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ba31 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745729:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ba31 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745736:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.745741:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ba31 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745750:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ba31 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745762:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.745766:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.745772:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ba31 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745777:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849ba31 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745793:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849ba38 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745799:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849ba38 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745804:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849ba38 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745808:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.745811:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849ba38 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745821:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849ba38 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745830:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5af66de800) 00010000:00010000:3.0:1763334967.745833:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.745836:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849ba38 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745842:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849ba38 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.745890:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ba2a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff17 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.745908:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ba3f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff17 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.745916:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334967.745918:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334967.745921:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:3.0:1763334967.746013:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53056:x1848989694508160:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2260us (3473us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.746023:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4793 00000100:00100000:3.0:1763334967.746141:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.749677:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694508288 00000100:00100000:0.0:1763334967.749701:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694508288 00000100:00100000:0.0:1763334967.749785:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4861 00000100:00100000:0.0:1763334967.749797:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+42:52274:x1848989694508288:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334967.749822:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.749854:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ba46 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff1e expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334967.749887:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x244:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334967.749918:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.749920:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.749933:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ba46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff1e expref: 43 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.749953:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ba46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff1e expref: 43 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.749969:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334967.750051:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb345050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+43:52274:x1848989694508288:12345-192.168.201.60@tcp:101:bash.0 Request processed in 256us (3909us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.750059:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4861 00000100:00100000:1.0:1763334967.756625:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.756687:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.756757:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694508416 00000100:00100000:2.0:1763334967.756772:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694508416 00000100:00100000:3.0:1763334967.756780:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694508544 00000100:00100000:3.0:1763334967.756785:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694508544 00002000:00010000:3.0:1763334967.756843:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/580 (0->18446744073709551615) 00002000:00010000:2.0:1763334967.756843:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/576 (0->18446744073709551615) 00002000:00100000:3.0:1763334967.756850:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5575500 with x1848989694508544 ext(0->18446744073709551615) 00002000:00100000:2.0:1763334967.756850:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5577800 with x1848989694508416 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334967.756869:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5575500. 00002000:00010000:2.0:1763334967.756869:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac5577800. 00000100:00100000:2.0:1763334967.756911:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1754 00000100:00100000:2.0:1763334967.756924:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694508416:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334967.757346:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334967.757352:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb mtime from disk: 0 -> 1763334968 00002000:00010000:2.0:1763334967.757355:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334967.757357:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb ctime from disk: 0 -> 1763334968 00002000:00010000:2.0:1763334967.757359:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334967.757442:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694508416:12345-192.168.201.60@tcp:10:bash.0 Request processed in 519us (876us total) trans 21474838400 rc 0/0 00000100:00100000:0.0:1763334967.757443:0:21633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1755 00000100:00100000:2.0:1763334967.757450:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1754 00000100:00100000:0.0:1763334967.757454:0:21633:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+43:2360:x1848989694508544:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334967.757455:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/576 (0->18446744073709551615) 00002000:00100000:2.0:1763334967.757459:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5577800 with x1848989694508416 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334967.757463:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac5577800. 00002000:00010000:0.0:1763334967.757698:0:21633:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334967.757701:0:21633:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb mtime from disk: 0 -> 1763334968 00002000:00010000:0.0:1763334967.757703:0:21633:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334967.757705:0:21633:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb ctime from disk: 0 -> 1763334968 00002000:00010000:0.0:1763334967.757707:0:21633:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334967.757731:0:21633:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+44:2360:x1848989694508544:12345-192.168.201.60@tcp:10:bash.0 Request processed in 281us (1045us total) trans 17179871120 rc 0/0 00000100:00100000:0.0:1763334967.757738:0:21633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1755 00002000:00010000:0.0:1763334967.757741:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/580 (0->18446744073709551615) 00002000:00100000:0.0:1763334967.757743:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5575500 with x1848989694508544 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334967.757747:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5575500. 00000100:00100000:3.0:1763334967.760952:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.761045:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694508800 00000100:00100000:2.0:1763334967.761060:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694508800 00000100:00100000:1.0:1763334967.761755:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1760 00000100:00100000:1.0:1763334967.761774:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694508800:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:1.0:1763334967.762332:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694508800:12345-192.168.201.60@tcp:35:bash.0 Request processed in 562us (1397us total) trans 8589938999 rc 0/0 00000100:00100000:1.0:1763334967.762342:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1760 00000100:00100000:3.0:1763334967.770469:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.771891:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694509056 00000100:00100000:1.0:1763334967.771916:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694509056 00000100:00100000:1.0:1763334967.772035:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4794 00000100:00100000:1.0:1763334967.772048:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53057:x1848989694509056:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.772083:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.772114:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba4d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff25 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.772325:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba54 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.772348:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba54 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.772364:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba54 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334967.772380:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 5 00010000:00010000:1.0:1763334967.772618:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849ba4d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff25 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.772644:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba54 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff25 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.772655:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:1.0:1763334967.772659:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763334967.772664:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334967.772777:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53057:x1848989694509056:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 731us (2327us total) trans 8589939000 rc 0/0 00000100:00100000:1.0:1763334967.772786:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4794 00000100:00100000:0.0:1763334967.778067:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.779741:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694509312 00000100:00100000:1.0:1763334967.779764:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694509312 00000100:00100000:1.0:1763334967.779868:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4795 00000100:00100000:1.0:1763334967.779882:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53057:x1848989694509312:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.779921:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.779956:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ba62 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff2c expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.780126:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.780145:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff02 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.780155:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ba3f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff17 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.780165:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.780232:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ba3f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff17 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.780248:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ba3f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff17 expref: 191 pid: 32232 timeout: 1132 lvb_type: 0 00000100:00100000:1.0:1763334967.780278:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5576300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701851008:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334967.782827:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff02 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.782854:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff02 expref: 191 pid: 30972 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.782874:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afc8c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701851136:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334967.782973:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334967.783183:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.783445:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694509568 00000100:00100000:2.0:1763334967.783458:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694509568 00000100:00100000:1.0:1763334967.784087:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1761 00000100:00100000:1.0:1763334967.784108:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53058:x1848989694509568:12345-192.168.201.60@tcp:35:rm.0 00000100:00100000:1.0:1763334967.784439:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53058:x1848989694509568:12345-192.168.201.60@tcp:35:rm.0 Request processed in 336us (1255us total) trans 8589939001 rc 0/0 00000100:00100000:1.0:1763334967.784448:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1761 00000100:00100000:1.0:1763334967.790781:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.790810:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.790915:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.790953:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694510208 00000100:00100000:1.0:1763334967.790965:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694510208 00000100:00100000:1.0:1763334967.791034:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4796 00000100:00100000:1.0:1763334967.791047:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53058:x1848989694510208:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:1.0:1763334967.791123:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1763334967.791158:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849ba54 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff25 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.791185:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849b9ac lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afef4 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.791198:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:1.0:1763334967.791219:0:32232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.791230:0:32232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.791238:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334967.791273:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba70 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.791291:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba70 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.791302:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba70 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.791320:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ba77 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.791326:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ba77 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.791332:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ba77 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.791498:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.791507:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.791514:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.791534:0:32232:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334967.791545:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334967.791744:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694509696 00000100:00100000:3.0:1763334967.791751:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694509696 00010000:00010000:3.0:1763334967.791781:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ba3f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff17 expref: 192 pid: 32232 timeout: 1132 lvb_type: 0 00000100:00100000:3.0:1763334967.791815:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694509824 00000100:00100000:3.0:1763334967.791819:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694509824 00010000:00010000:3.0:1763334967.791834:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff02 expref: 193 pid: 30972 timeout: 1132 lvb_type: 0 00000100:00100000:3.0:1763334967.791857:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2562 00000100:00100000:3.0:1763334967.791866:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2360:x1848989694509696:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334967.791878:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334967.791884:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ba3f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff17 expref: 193 pid: 32232 timeout: 1132 lvb_type: 0 00010000:00010000:3.0:1763334967.791898:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ba3f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff17 expref: 193 pid: 32232 timeout: 1132 lvb_type: 0 00010000:00010000:3.0:1763334967.791914:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334967.791918:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.791925:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.791931:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.791942:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334967.792016:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2360:x1848989694509696:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 150us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.792024:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2562 00000100:00100000:3.0:1763334967.792089:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2563 00000100:00100000:3.0:1763334967.792097:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694509824:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334967.792105:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334967.792111:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff02 expref: 192 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:3.0:1763334967.792121:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff02 expref: 192 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:3.0:1763334967.792133:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334967.792137:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.792145:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.792151:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290400000020 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.792157:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.792164:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334967.792181:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334967.792200:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694509824:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 104us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.792219:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2563 00010000:00010000:2.0:1763334967.792526:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ba3f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff17 expref: 191 pid: 32232 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.792544:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5576300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701851008:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334967.792562:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849b9dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff02 expref: 190 pid: 30972 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.792618:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afc8c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701851136:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334967.792643:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.792651:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334967.792657:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334967.792679:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 5 00010000:00010000:2.0:1763334967.792868:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ba62 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff2c expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.792890:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff2c expref: 190 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.792899:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff2c expref: 190 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.792906:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:2.0:1763334967.792949:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53057:x1848989694509312:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 13070us (14901us total) trans 8589939002 rc 0/0 00000100:00100000:2.0:1763334967.792955:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4795 00000100:00100000:1.0:1763334967.803010:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.803146:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694510336 00000100:00100000:0.0:1763334967.803162:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694510336 00010000:00010000:0.0:1763334967.803229:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff2c expref: 190 pid: 30972 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.803280:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2564 00000100:00100000:0.0:1763334967.803292:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:2361:x1848989694510336:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334967.803317:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334967.803325:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff2c expref: 190 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.803339:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff2c expref: 190 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.803369:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849ba69 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1a5:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff2c expref: 190 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.803391:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334967.803397:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.803409:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.803417:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.803461:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334967.803540:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2361:x1848989694510336:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 250us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.803549:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2564 00010000:00010000:2.0:1763334967.803706:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.803716:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00080000:2.0:1763334967.804321:0:32232:0:(mdd_dir.c:1980:mdd_finish_unlink()) Object [0x200000404:0x1a5:0x0] is inserted into orphan list, open count = 1 00010000:00010000:2.0:1763334967.804491:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.804501:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.804509:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.804515:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.804520:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.804529:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.804541:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334967.804544:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763334967.804548:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.804555:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ba7e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.804617:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba70 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.804624:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba70 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.804630:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba70 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.804641:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.804643:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba70 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.804650:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba70 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.804658:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334967.804661:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.804664:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba70 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.804671:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ba70 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:2.0:1763334967.804680:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f717b3ea reply state 00000000b479b987 transno 8589939003 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ba77 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334967.804690:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334967.804758:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53058:x1848989694510208:12345-192.168.201.60@tcp:36:rm.0 Request processed in 13712us (13841us total) trans 8589939003 rc 0/0 00000100:00100000:2.0:1763334967.804767:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4796 00000100:00100000:3.0:1763334967.805179:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.805833:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694510464 00000100:00100000:2.0:1763334967.805845:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694510464 00000100:00100000:2.0:1763334967.805900:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4797 00000100:00100000:2.0:1763334967.805910:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53057:x1848989694510464:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334967.805938:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.805967:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849ba8c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff33 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.806061:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849ba93 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.806076:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849ba93 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.806088:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849ba93 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334967.806122:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 5 00000004:00200000:2.0:1763334967.806127:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334967.806146:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849ba93 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.806173:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849ba8c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff33 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.806192:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849ba93 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff33 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.806200:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:2.0:1763334967.806213:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763334967.806216:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abee00, rc 0) 00000100:00100000:2.0:1763334967.806349:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53057:x1848989694510464:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 440us (1172us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334967.806357:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4797 00010000:00010000:0.0:1763334967.807102:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ba77 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.807114:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ba77 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.807121:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ba77 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.807126:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.807131:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ba77 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.807138:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ba77 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.807150:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa800) 00010000:00010000:0.0:1763334967.807152:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.807156:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ba77 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334967.807162:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ba77 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334967.810834:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.811921:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694510720 00000100:00100000:2.0:1763334967.811938:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694510720 00000100:00100000:2.0:1763334967.812019:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4798 00000100:00100000:2.0:1763334967.812030:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53057:x1848989694510720:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334967.812062:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.812088:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba9a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff3a expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.812231:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849baa1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.812249:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849baa1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.812263:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849baa1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334967.812684:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 5 00010000:00010000:2.0:1763334967.812867:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf400/0xcedf0054f849ba9a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff3a expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.812892:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849baa1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff3a expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.812902:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:2.0:1763334967.812905:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334967.812910:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abe800, rc 0) 00000100:00100000:2.0:1763334967.813019:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53057:x1848989694510720:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 989us (2200us total) trans 8589939004 rc 0/0 00000100:00100000:2.0:1763334967.813029:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4798 00000100:00100000:3.0:1763334967.818894:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.819068:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694510848 00000100:00100000:2.0:1763334967.819083:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694510848 00000100:00100000:0.0:1763334967.819764:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4862 00000100:00100000:0.0:1763334967.819782:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2362:x1848989694510848:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:0.0:1763334967.819843:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.819864:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 14 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.819873:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334967.819875:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334967.819880:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.819924:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 14 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.819941:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 14 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.819958:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9833b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701851264:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334967.820068:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c96ee600 going to sleep for 11 seconds 00000100:00100000:1.0:1763334967.824885:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.825106:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9833b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701851264:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334967.825144:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334967.825236:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694510976 00000100:00100000:3.0:1763334967.825247:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694510976 00002000:00100000:3.0:1763334967.825319:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x240:0x0] (0->4) req@ffff9a59c58c7b80 x1848989694510976/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:13/0 lens 496/0 e 0 to 0 dl 1763334978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334967.825329:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c7b80 with x1848989694510976 ext(0->4) 00010000:00010000:3.0:1763334967.825337:0:14384:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 15 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:3.0:1763334967.825354:0:14384:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 15 pid: 32241 timeout: 1132 lvb_type: 0 00002000:00010000:3.0:1763334967.825362:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a59c58c7b80 00000100:00100000:3.0:1763334967.825405:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 71 00000100:00100000:3.0:1763334967.825416:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2362:x1848989694510976:12345-192.168.201.60@tcp:4:bash.0 00000100:00100000:3.0:1763334967.826015:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2362:x1848989694510976:12345-192.168.201.60@tcp:4:bash.0 Request processed in 597us (1142us total) trans 21474838401 rc 0/0 00000100:00100000:3.0:1763334967.826025:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 71 00002000:00100000:3.0:1763334967.826034:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x240:0x0] (0->4) req@ffff9a59c58c7b80 x1848989694510976/t21474838401(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:13/0 lens 496/448 e 0 to 0 dl 1763334978 ref 1 fl Complete:H/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334967.826050:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c7b80 with x1848989694510976 ext(0->4) 00010000:00010000:3.0:1763334967.826057:0:14384:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 17 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:3.0:1763334967.826069:0:14384:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 17 pid: 32241 timeout: 1132 lvb_type: 0 00002000:00010000:3.0:1763334967.826076:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9a59c58c7b80 00000100:00100000:1.0:1763334967.831043:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.831162:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694511104 00000100:00100000:2.0:1763334967.831179:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694511104 00000100:00100000:2.0:1763334967.831274:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4799 00000100:00100000:2.0:1763334967.831288:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53059:x1848989694511104:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334967.831327:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334967.831364:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849bab6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff41 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.831511:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849babd lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831532:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849babd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831548:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849babd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831567:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bac4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831637:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bac4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831644:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bac4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831735:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849babd lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831744:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849babd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831756:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849babd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831763:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.831768:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849babd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831777:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849babd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831791:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334967.831795:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.831802:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849babd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831808:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849babd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831822:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bac4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831829:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bac4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831835:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bac4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831841:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334967.831843:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bac4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831850:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bac4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831858:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334967.831861:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.831864:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bac4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831870:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bac4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334967.831913:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849bab6 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff41 expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.831925:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334967.831928:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334967.831931:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abf000/0xcedf0054f849bab6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff41 expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334967.831943:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c3abf000, rc 0) 00000100:00100000:2.0:1763334967.832022:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53059:x1848989694511104:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 737us (997us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334967.832030:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4799 00000100:00100000:1.0:1763334967.833100:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.833195:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694511232 00000100:00100000:0.0:1763334967.833217:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694511232 00010000:00010000:0.0:1763334967.833264:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 17 pid: 32241 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334967.833310:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2565 00000100:00100000:0.0:1763334967.833320:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2361:x1848989694511232:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334967.833338:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1763334967.833364:0:11727:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb size from disk: 0 -> 5 00010000:00010000:0.0:1763334967.833371:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 17 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.833386:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 17 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.833412:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849ba1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff10 expref: 17 pid: 32241 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334967.833431:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.833433:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334967.833439:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.833450:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.833493:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334967.833549:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694511232:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 230us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334967.833558:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2565 00010000:00010000:1.0:1763334967.833686:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.833696:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.833724:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.833731:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.833739:0:25383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.833746:0:25383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334967.833750:0:25383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.833760:0:25383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.833773:0:25383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.833780:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849baaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334967.833832:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2362:x1848989694510848:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 14057us (14956us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.833841:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4862 00000100:00100000:1.0:1763334967.834410:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.834475:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694511360 00000100:00100000:3.0:1763334967.834483:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694511360 00000100:00100000:3.0:1763334967.834534:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4800 00000100:00100000:3.0:1763334967.834545:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53059:x1848989694511360:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334967.834566:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.834624:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bacb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff48 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.834707:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bad2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834723:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bad2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834734:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bad2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834747:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bad9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834754:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bad9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834761:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bad9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834841:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bad2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834848:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bad2 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834853:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bad2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834859:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.834863:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bad2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834870:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bad2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834881:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.834885:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.834889:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bad2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834896:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bad2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834907:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bad9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834914:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bad9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834920:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bad9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834927:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.834930:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bad9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834936:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bad9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834944:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5af66de800) 00010000:00010000:3.0:1763334967.834946:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.834949:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bad9 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834955:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bad9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.834989:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bacb lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff48 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.835000:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.835003:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.835007:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bacb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff48 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.835017:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:3.0:1763334967.835066:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53059:x1848989694511360:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 524us (660us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334967.835074:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4800 00000100:00100000:3.0:1763334967.845658:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.845819:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694511616 00000100:00100000:1.0:1763334967.845835:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694511616 00000100:00100000:1.0:1763334967.845919:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4801 00000100:00100000:1.0:1763334967.845931:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53057:x1848989694511616:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334967.846005:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334967.846047:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abee00/0xcedf0054f849ba93 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff33 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.846080:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:1.0:1763334967.846087:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334967.846133:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bae0 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.846151:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bae0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.846160:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bae0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334967.846187:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.846269:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694511744 00000100:00100000:3.0:1763334967.846275:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694511744 00000100:00100000:3.0:1763334967.846318:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4802 00000100:00100000:3.0:1763334967.846326:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53059:x1848989694511744:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334967.846338:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.846353:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bae7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff4f expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.846411:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849baee lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.846421:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849baee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.846430:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849baee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334967.846482:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:3.0:1763334967.846488:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334967.846516:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849baee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.846544:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bae7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff4f expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.846559:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849baee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff4f expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.846566:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334967.846606:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334967.846610:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:3.0:1763334967.846681:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53059:x1848989694511744:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 355us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.846689:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4802 00000040:00080000:1.0:1763334967.846801:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1120, 88 off95776 00000004:00080000:1.0:1763334967.846812:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032480239062ns, next at 1032427929403ns, rc = 0 00000040:00080000:1.0:1763334967.846912:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1131, 88 off96864 00000004:00080000:1.0:1763334967.846918:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032480346053ns, next at 1032427980316ns, rc = 0 00000040:00080000:1.0:1763334967.846954:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1132, 88 off96952 00000004:00080000:1.0:1763334967.846959:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032480387034ns, next at 1032427980316ns, rc = 0 00000040:00080000:1.0:1763334967.846976:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1121, 88 off95864 00000004:00080000:1.0:1763334967.846980:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032480408327ns, next at 1032427929403ns, rc = 0 00000100:00100000:3.0:1763334967.851015:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.851078:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694511872 00000100:00100000:1.0:1763334967.851093:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694511872 00000100:00100000:1.0:1763334967.851166:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4803 00000100:00100000:1.0:1763334967.851179:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53059:x1848989694511872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.851215:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.851249:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849baf5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff56 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.851341:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bafc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.851359:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bafc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.851372:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bafc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856499:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bb03 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856534:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bb03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856550:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bb03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856662:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bafc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856671:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bafc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856680:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bafc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856686:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.856692:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bafc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856701:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bafc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856716:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.856720:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.856727:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bafc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856733:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bafc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856748:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bb03 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856755:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bb03 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856760:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bb03 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856766:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.856769:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bb03 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856775:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bb03 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856783:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa100) 00010000:00010000:1.0:1763334967.856786:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.856789:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bb03 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856795:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bb03 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.856855:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849baf5 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff56 expref: 195 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.856868:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.856870:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.856875:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849baf5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff56 expref: 195 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.856885:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334967.857005:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53059:x1848989694511872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5826us (6001us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334967.857016:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4803 00000100:00100000:1.0:1763334967.866481:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334967.868164:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694512128 00000100:00100000:0.0:1763334967.868185:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694512128 00000100:00100000:3.0:1763334967.874042:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4804 00000100:00100000:0.0:1763334967.874771:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53059:x1848989694512128:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334967.874806:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334967.874811:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334967.874851:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849baee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff4f expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.874875:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334967.874881:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334967.874897:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849bb0a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff5d expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.875067:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bb11 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.875083:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bb11 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.875093:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bb11 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.875109:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bb18 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.875115:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bb18 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.875122:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bb18 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.875876:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bb1f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.875888:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bb1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.875897:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bb1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334967.875908:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a6:0x0]: returning size 0 00010000:00010000:0.0:1763334967.875941:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bb11 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.875948:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bb11 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.875956:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bb11 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.875964:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334967.875969:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bb11 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.875977:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bb11 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.875988:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334967.875991:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334967.875995:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bb11 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334967.876001:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bb11 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334967.876013:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000054bd0076 reply state 0000000031db1979 transno 8589939006 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bb18 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334967.876023:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763334967.876062:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849bb0a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff5d expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.876077:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bb1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff5d expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.876083:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:0.0:1763334967.876086:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334967.876089:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334967.876197:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53059:x1848989694512128:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2137us (9729us total) trans 8589939006 rc 0/0 00000100:00100000:0.0:1763334967.880871:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4804 00010000:00010000:3.0:1763334967.883282:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bb18 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.883308:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bb18 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.883317:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bb18 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.883324:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334967.883330:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bb18 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.883341:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bb18 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.883363:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60400) 00010000:00010000:3.0:1763334967.883367:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334967.883373:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bb18 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334967.883381:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bb18 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334967.884274:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.885013:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694512384 00000100:00100000:3.0:1763334967.885030:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694512384 00000100:00100000:1.0:1763334967.886097:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4805 00000100:00100000:1.0:1763334967.886122:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53059:x1848989694512384:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334967.886155:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.886185:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bb2d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff64 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.886350:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.886369:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bb1f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff5d expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.886379:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.886426:0:29627:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bb1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff5d expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.886442:0:29627:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bb1f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff5d expref: 196 pid: 30972 timeout: 1132 lvb_type: 0 00000100:00100000:1.0:1763334967.886459:0:29627:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701851392:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334967.888622:0:29627:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee300 going to sleep for 11 seconds 00000100:00100000:2.0:1763334967.892619:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.892663:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694512512 00000100:00100000:2.0:1763334967.892675:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694512512 00010000:00010000:2.0:1763334967.892726:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bb1f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff5d expref: 197 pid: 30972 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334967.892766:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2566 00000100:00100000:2.0:1763334967.892775:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694512512:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334967.892795:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334967.892801:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bb1f lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff5d expref: 197 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.892815:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bb1f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff5d expref: 197 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334967.892845:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:2.0:1763334967.892852:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.892863:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.892871:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334967.892892:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334967.892950:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694512512:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 176us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334967.892957:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2566 00010000:00010000:1.0:1763334967.893830:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bb1f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff5d expref: 196 pid: 30972 timeout: 1132 lvb_type: 0 00000100:00100000:1.0:1763334967.893854:0:29627:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c7480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:29627:1848989701851392:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334967.893878:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.893888:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.893894:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:1.0:1763334967.893918:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a6:0x0]: returning size 0 00000004:00080000:1.0:1763334967.894303:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x246:0x0], index 1: 0 00000004:00080000:1.0:1763334967.894317:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x242:0x0], index 0: 0 00000004:00080000:1.0:1763334967.894324:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x243:0x0], index 0: 0 00000004:00080000:1.0:1763334967.894329:0:29627:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x247:0x0], index 1: 0 00010000:00010000:1.0:1763334967.894528:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.894539:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.894546:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.894552:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.894556:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.894565:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.902170:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:1.0:1763334967.902179:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334967.902193:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.902215:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb34 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.902333:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bb2d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff64 expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.902348:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.902351:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334967.902356:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bb2d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff64 expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.902367:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334967.902479:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53059:x1848989694512384:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 16365us (18215us total) trans 8589939007 rc 301/301 00000100:00100000:1.0:1763334967.902492:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4805 00000100:00100000:3.0:1763334967.910906:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.911846:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694512768 00000100:00100000:1.0:1763334967.911868:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694512768 00000100:00100000:1.0:1763334967.911952:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1762 00000100:00100000:1.0:1763334967.911966:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53059:x1848989694512768:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334967.912493:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53059:x1848989694512768:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 528us (1603us total) trans 8589939008 rc 0/0 00000100:00100000:1.0:1763334967.912504:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1762 00000100:00100000:1.0:1763334967.918519:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.918672:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694513024 00000100:00100000:3.0:1763334967.918688:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694513024 00000100:00100000:3.0:1763334967.918824:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1763 00000100:00100000:3.0:1763334967.918838:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeb28c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53059:x1848989694513024:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334967.919174:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeb28c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53059:x1848989694513024:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 337us (667us total) trans 8589939009 rc 0/0 00000100:00100000:3.0:1763334967.919183:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1763 00000004:00010000:1.0:1763334967.921245:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000035f2b1c6 reply state 00000000a951eb3b transno 8589939005 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bae0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334967.921270:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334967.921415:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53057:x1848989694511616:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 75481us (75768us total) trans 8589939005 rc 0/0 00000100:00100000:1.0:1763334967.921425:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4801 00000001:00080000:1.0:1763334967.921467:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589938997 is committed 00000001:00080000:1.0:1763334967.921488:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939005 is committed 00000004:00080000:1.0:1763334967.921494:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 734 committed 00000004:00080000:1.0:1763334967.921501:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 746 committed 00000004:00080000:1.0:1763334967.921514:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 745 committed 00000004:00080000:1.0:1763334967.921516:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 733 committed 00010000:00010000:1.0:1763334967.921565:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bae0 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.921605:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bae0 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.921614:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bae0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.921621:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.921626:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bae0 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.921635:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bae0 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.921654:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:1.0:1763334967.921657:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334967.921663:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bae0 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.921670:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bae0 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334967.922395:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701851648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334967.922470:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334967.922600:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701851520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334967.922634:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334967.922896:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701851648 00000100:00100000:1.0:1763334967.922905:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701851648 00000100:00100000:1.0:1763334967.922959:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701851520 00000100:00100000:1.0:1763334967.922962:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701851520 00000100:00100000:1.0:1763334967.922985:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4863 00000100:00100000:1.0:1763334967.922995:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701851648:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334967.923284:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3289:x1848989701851648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 289us (813us total) trans 21474838402 rc 0/0 00000100:00100000:1.0:1763334967.923293:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4863 00000100:00100000:1.0:1763334967.923312:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4864 00000100:00100000:1.0:1763334967.923319:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+18:3292:x1848989701851520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334967.923439:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3292:x1848989701851520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (804us total) trans 21474838403 rc 0/0 00000100:00100000:1.0:1763334967.923446:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4864 00000004:00080000:1.0:1763334967.923500:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a20a80/2, rc 0, transno 21474838402 00000100:00100000:1.0:1763334967.923507:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701851648:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334967.923528:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a21500/2, rc 0, transno 21474838403 00000100:00100000:1.0:1763334967.923532:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701851520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334967.924261:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763334967.924277:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701851776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.924329:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334967.924413:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701851776 00000100:00100000:3.0:1763334967.924420:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701851776 00000100:00100000:3.0:1763334967.924651:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4865 00000100:00100000:3.0:1763334967.924663:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+74:3289:x1848989701851776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334967.924867:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334967.924871:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb mtime from disk: 1763334968 -> 1763334968 00002000:00010000:3.0:1763334967.924874:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334967.924877:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb ctime from disk: 1763334968 -> 1763334968 00002000:00010000:3.0:1763334967.924879:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334967.924930:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+75:3289:x1848989701851776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 269us (599us total) trans 17179871121 rc 0/0 00000100:00100000:3.0:1763334967.924937:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4865 00000100:00100000:1.0:1763334967.925479:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701851904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334967.925528:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334967.927238:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701851904 00000100:00100000:3.0:1763334967.927256:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701851904 00000100:00100000:3.0:1763334967.927332:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4866 00000100:00100000:3.0:1763334967.927344:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+75:3291:x1848989701851904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334967.927717:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+76:3291:x1848989701851904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 375us (2188us total) trans 17179871122 rc 0/0 00000100:00100000:3.0:1763334967.927728:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4866 00000004:00080000:3.0:1763334967.927804:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d7100/2, rc 0, transno 17179871121 00000100:00100000:3.0:1763334967.927811:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701851776:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334967.928084:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d5500/2, rc 0, transno 17179871122 00000100:00100000:1.0:1763334967.928090:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701851904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334967.929910:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.930614:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694513408 00000100:00100000:1.0:1763334967.930632:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694513408 00000100:00100000:1.0:1763334967.930713:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4806 00000100:00100000:1.0:1763334967.930726:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694513408:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334967.930763:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.930794:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb42 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff72 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.931047:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bb49 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931065:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bb49 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931085:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bb49 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931103:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb50 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931110:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931116:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931216:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bb57 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931224:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bb57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931232:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bb57 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334967.931244:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a6:0x0]: returning size 0 00010000:00010000:1.0:1763334967.931382:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bb49 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931391:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bb49 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931398:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bb49 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931405:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.931410:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bb49 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931419:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bb49 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931435:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334967.931438:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.931443:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bb49 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931450:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bb49 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931465:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb50 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931471:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb50 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931476:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb50 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931481:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.931483:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb50 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931489:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb50 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931496:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fa100) 00010000:00010000:1.0:1763334967.931499:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.931501:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb50 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931507:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb50 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.931560:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb42 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff72 expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.931606:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bb57 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff72 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.931613:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ad28fa000) 00010000:00010000:1.0:1763334967.931615:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334967.931618:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478800, rc 0) 00000100:00100000:0.0:1763334967.931847:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.932218:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694513152 00000100:00100000:3.0:1763334967.932227:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694513152 00000100:00100000:3.0:1763334967.932285:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4807 00000100:00100000:3.0:1763334967.932296:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53057:x1848989694513152:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334967.932314:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.932332:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bb65 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff6b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.932382:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bb65 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff6b expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.932395:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bb65 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff6b expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.932414:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:3.0:1763334967.932417:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334967.932420:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:3.0:1763334967.932461:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53057:x1848989694513152:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 168us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.932469:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4807 00000100:00100000:1.0:1763334967.934018:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52274:x1848989694513408:12345-192.168.201.60@tcp:101:bash.0 Request processed in 3280us (4104us total) trans 8589939010 rc 0/0 00000100:00100000:1.0:1763334967.934031:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4806 00000100:00100000:2.0:1763334967.938877:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334967.938988:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.939062:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694513536 00000100:00100000:0.0:1763334967.939062:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694513792 00000100:00100000:1.0:1763334967.939076:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694513536 00000100:00100000:0.0:1763334967.939076:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694513792 00000100:00100000:1.0:1763334967.939149:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4808 00000100:00100000:0.0:1763334967.939156:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4809 00000100:00100000:1.0:1763334967.939161:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53057:x1848989694513536:12345-192.168.201.60@tcp:101:lfs.0 00000100:00100000:0.0:1763334967.939162:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:52274:x1848989694513792:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1763334967.939188:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.939226:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb6c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff79 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.939239:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334967.939267:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bb57 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff72 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334967.939286:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ad28fa000) 00010000:00010000:0.0:1763334967.939297:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334967.939648:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bb73 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.939665:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bb73 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334967.939676:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bb73 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:0.0:1763334967.939738:0:29627:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939011 00000004:00010000:0.0:1763334967.939767:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000409bbfbc reply state 0000000006533a4a transno 8589939012 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bb73 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334967.939777:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334967.940099:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:52274:x1848989694513792:12345-192.168.201.60@tcp:36:bash.0 Request processed in 933us (1107us total) trans 8589939012 rc 0/0 00000100:00100000:2.0:1763334967.940108:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4809 00000020:00080000:2.0:1763334967.940114:0:29627:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763334967.940239:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb7a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.940262:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.940272:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334967.940302:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a5:0x0]: returning size 5 00000004:00200000:1.0:1763334967.940307:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334967.940322:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334967.940344:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb6c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff79 expref: 194 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.940360:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb7a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff79 expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.940368:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:1.0:1763334967.940370:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763334967.940374:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334967.940414:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53057:x1848989694513536:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1256us (1551us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334967.940421:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4808 00000100:00100000:2.0:1763334967.944842:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334967.945037:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694513920 00000100:00100000:3.0:1763334967.945051:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694513920 00000100:00100000:3.0:1763334967.945131:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4810 00000100:00100000:3.0:1763334967.945146:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52274:x1848989694513920:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334967.945176:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.945224:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bb81 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff80 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.945325:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bb81 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff80 expref: 194 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.945344:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bb81 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff80 expref: 194 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334967.945367:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ac7d60a00) 00010000:00010000:3.0:1763334967.945371:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334967.945376:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:3.0:1763334967.945449:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:52274:x1848989694513920:12345-192.168.201.60@tcp:101:bash.0 Request processed in 306us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.945457:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4810 00000100:00100000:2.0:1763334967.945893:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334967.947338:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bb73 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.947359:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bb73 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.947368:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bb73 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.947375:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334967.947381:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bb73 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.947394:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bb73 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.947414:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ac7d60a00) 00010000:00010000:1.0:1763334967.947417:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334967.947422:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bb73 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.947428:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bb73 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:3.0:1763334967.951355:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694514048 00000100:00100000:3.0:1763334967.951379:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694514048 00000100:00100000:3.0:1763334967.951482:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4867 00000100:00100000:3.0:1763334967.951495:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694514048:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334967.951519:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334967.951549:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bb88 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff87 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334967.951598:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x240:0x0] initial LVB size: 5, mtime: 0x691a5b38, atime: 0x0, ctime: 0x691a5b38, blocks: 0x1 00010000:00010000:3.0:1763334967.951624:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334967.951626:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334967.951639:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bb88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff87 expref: 16 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334967.951665:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bb88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff87 expref: 16 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334967.951682:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:3.0:1763334967.951778:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694514048:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 286us (5886us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334967.951786:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4867 00000100:00100000:3.0:1763334967.953444:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334967.953766:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694514304 00000100:00100000:1.0:1763334967.953777:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694514304 00000100:00100000:1.0:1763334967.953841:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4811 00000100:00100000:1.0:1763334967.953853:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52274:x1848989694514304:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334967.953882:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334967.953886:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334967.953918:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bb81 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff80 expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.953941:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ac7d60a00) 00010000:00010000:1.0:1763334967.953953:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334967.953971:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bb8f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff8e expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334967.954039:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849bb96 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.954054:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849bb96 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334967.954068:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849bb96 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000040:00080000:1.0:1763334967.954614:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1133, 88 off97040 00000004:00080000:1.0:1763334967.954625:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032588052313ns, next at 1032427980316ns, rc = 0 00000040:00080000:1.0:1763334967.954692:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1122, 88 off95952 00000004:00080000:1.0:1763334967.954697:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032588125427ns, next at 1032427929403ns, rc = 0 00000040:00080000:1.0:1763334967.954721:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1123, 88 off96040 00000004:00080000:1.0:1763334967.954725:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032588153152ns, next at 1032427929403ns, rc = 0 00000040:00080000:1.0:1763334967.954740:0:29627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1134, 88 off97128 00000004:00080000:1.0:1763334967.954744:0:29627:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032588172111ns, next at 1032427980316ns, rc = 0 00000001:00080000:0.0:1763334968.011319:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939012 is committed 00000001:00080000:3.0:1763334968.011345:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939013 is committed 00000004:00080000:3.0:1763334968.011354:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 748 committed 00010000:00010000:2.0:1763334968.011459:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849bb96 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff8e expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.011477:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ad28fa100) 00010000:00010000:2.0:1763334968.011481:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334968.011508:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bb8f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff8e expref: 190 pid: 29627 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763334968.011532:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849bb96 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a6:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff8e expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.011624:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ad28fa100) 00010000:00010000:2.0:1763334968.011628:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334968.011631:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:2.0:1763334968.011746:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:52274:x1848989694514304:12345-192.168.201.60@tcp:101:bash.0 Request processed in 57892us (58307us total) trans 8589939013 rc 0/0 00000100:00100000:2.0:1763334968.011757:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4811 00000004:00080000:3.0:1763334968.012990:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 736 committed 00000100:00100000:1.0:1763334968.013779:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1763334968.013814:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701852032:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334968.013838:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 735 committed 00000004:00080000:3.0:1763334968.013843:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 747 committed 00000100:00100000:1.0:1763334968.013909:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334968.013988:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701852416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334968.014013:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334968.014029:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701852032 00000100:00100000:3.0:1763334968.014039:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701852032 00000100:00100000:1.0:1763334968.014055:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701852160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334968.014081:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334968.014099:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763334968.014103:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701852416 00000100:00100000:1.0:1763334968.014104:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701852288:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334968.014106:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701852416 00000100:00100000:1.0:1763334968.014125:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334968.014126:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701852160 00000100:00100000:3.0:1763334968.014128:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701852160 00000100:00100000:1.0:1763334968.014154:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701852288 00000100:00100000:1.0:1763334968.014158:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701852288 00000100:00100000:1.0:1763334968.014189:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4868 00000100:00100000:1.0:1763334968.014209:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+77:3291:x1848989701852032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334968.014406:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4869 00000100:00100000:0.0:1763334968.014416:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3291:x1848989701852416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334968.014630:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3291:x1848989701852416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 214us (614us total) trans 21474838404 rc 0/0 00000100:00100000:0.0:1763334968.014638:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4869 00000100:00100000:0.0:1763334968.014660:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4870 00000100:00100000:0.0:1763334968.014667:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3289:x1848989701852288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334968.014780:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3289:x1848989701852288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (653us total) trans 21474838405 rc 0/0 00000100:00100000:0.0:1763334968.014787:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4870 00000100:00100000:3.0:1763334968.014878:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4871 00000100:00100000:3.0:1763334968.014894:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+78:3289:x1848989701852160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334968.015021:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+79:3289:x1848989701852160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 128us (938us total) trans 17179871124 rc 0/0 00000100:00100000:3.0:1763334968.015028:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4871 00000100:00080000:3.0:1763334968.015049:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1763334968.015054:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1763334968.015389:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+78:3291:x1848989701852032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1190us (1480us total) trans 17179871123 rc 0/0 00000100:00100000:1.0:1763334968.015397:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4868 00000004:00080000:1.0:1763334968.015460:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c9830e00/2, rc 0, transno 21474838405 00000100:00100000:1.0:1763334968.015468:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701852288:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334968.015483:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c7800/2, rc 0, transno 17179871124 00000100:00100000:1.0:1763334968.015488:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701852160:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334968.015542:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c9831880/2, rc 0, transno 21474838404 00000100:00100000:1.0:1763334968.015547:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701852416:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334968.015556:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c5f80/2, rc 0, transno 17179871123 00000100:00100000:1.0:1763334968.015559:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701852032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334968.017754:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.018445:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694514432 00000100:00100000:1.0:1763334968.018461:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694514432 00000100:00100000:1.0:1763334968.018558:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4872 00000100:00100000:1.0:1763334968.018596:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+44:52274:x1848989694514432:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334968.018621:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334968.018651:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb9d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff95 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334968.018684:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x246:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334968.018713:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334968.018715:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334968.018728:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff95 expref: 45 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.018747:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff95 expref: 45 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.018769:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00080000:3.0:1763334968.020506:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1763334968.020682:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+45:52274:x1848989694514432:12345-192.168.201.60@tcp:101:bash.0 Request processed in 2103us (2929us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334968.020698:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4872 00000100:00100000:0.0:1763334968.022863:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.025237:0:21633:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694514560 00000100:00100000:2.0:1763334968.025259:0:21633:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694514560 00000100:00100000:2.0:1763334968.025395:0:21633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1756 00000100:00100000:2.0:1763334968.025408:0:21633:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694514560:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334968.025463:0:21633:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bba4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.025483:0:21633:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334968.025485:0:21633:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334968.025492:0:21633:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bba4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.025513:0:21633:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bba4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.025710:0:21633:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bba4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.025718:0:21633:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bba4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.025726:0:21633:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bba4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.025732:0:21633:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334968.025736:0:21633:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bba4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.025745:0:21633:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bba4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.025764:0:21633:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bba4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.025769:0:21633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bba4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21633 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334968.025852:0:21633:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694514560:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 447us (3003us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763334968.025859:0:21633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1756 00000100:00080000:3.0:1763334968.026343:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763334968.027478:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.028445:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694514688 00000100:00100000:1.0:1763334968.028461:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694514688 00000100:00100000:1.0:1763334968.028536:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4873 00000100:00100000:1.0:1763334968.028548:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+16:52274:x1848989694514688:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334968.028599:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334968.028629:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bbab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833aff9c expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334968.028660:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x242:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334968.028692:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334968.028694:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334968.028706:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bbab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff9c expref: 17 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.028726:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bbab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff9c expref: 17 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.028740:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334968.028819:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+17:52274:x1848989694514688:12345-192.168.201.60@tcp:101:bash.0 Request processed in 273us (1351us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334968.028827:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4873 00000100:00100000:2.0:1763334968.029959:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334968.030238:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694514816 00000100:00100000:3.0:1763334968.030249:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694514816 00000100:00100000:3.0:1763334968.031054:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4812 00000100:00100000:3.0:1763334968.031072:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53057:x1848989694514816:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334968.031104:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334968.031133:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bbb2 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833affa3 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.031179:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bbb9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334968.031210:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334968.031225:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bbb9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334968.031369:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bbb2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affa3 expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.031391:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066800/0xcedf0054f849bbb9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affa3 expref: 187 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.031400:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:3.0:1763334968.031403:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1763334968.031407:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066800, rc 0) 00000100:00100000:3.0:1763334968.031484:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53057:x1848989694514816:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 419us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334968.031495:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4812 00000100:00080000:0.0:1763334968.032423:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1763334968.034544:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.035372:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694514944 00000100:00100000:0.0:1763334968.035387:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694514944 00000100:00100000:0.0:1763334968.035489:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1757 00000100:00100000:0.0:1763334968.035500:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+45:2361:x1848989694514944:12345-192.168.201.60@tcp:4:lfs.0 00002000:00010000:0.0:1763334968.035568:0:14384:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x245:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334968.035611:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849bbc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.035628:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334968.035631:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334968.035638:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849bbc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.035654:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849bbc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334968.037782:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.038338:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.044672:0:21633:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694515200 00000100:00100000:2.0:1763334968.044698:0:21633:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694515200 00002000:00010000:2.0:1763334968.044781:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/578 (0->18446744073709551615) 00002000:00100000:2.0:1763334968.044786:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5501f80 with x1848989694515200 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334968.044803:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac5501f80. 00000100:00100000:2.0:1763334968.044850:0:21633:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694515072 00000100:00100000:2.0:1763334968.044854:0:21633:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694515072 00002000:00010000:2.0:1763334968.044868:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/582 (0->18446744073709551615) 00002000:00100000:2.0:1763334968.044871:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5500380 with x1848989694515072 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334968.044877:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5500380. 00000100:00100000:2.0:1763334968.044917:0:21633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1758 00000100:00100000:2.0:1763334968.044929:0:21633:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2362:x1848989694515200:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334968.045333:0:21633:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x242:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334968.045338:0:21633:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x242:0x0] updating lvb mtime from disk: 0 -> 1763334968 00002000:00010000:2.0:1763334968.045342:0:21633:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x242:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334968.045344:0:21633:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x242:0x0] updating lvb ctime from disk: 0 -> 1763334968 00002000:00010000:2.0:1763334968.045347:0:21633:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x242:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334968.045435:0:21633:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2362:x1848989694515200:12345-192.168.201.60@tcp:10:bash.0 Request processed in 506us (7665us total) trans 21474838406 rc 0/0 00000100:00100000:2.0:1763334968.045444:0:21633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1758 00002000:00010000:2.0:1763334968.045449:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/578 (0->18446744073709551615) 00002000:00100000:2.0:1763334968.045453:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5501f80 with x1848989694515200 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334968.045458:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac5501f80. 00000100:00100000:2.0:1763334968.045482:0:21633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1759 00000100:00100000:2.0:1763334968.045490:0:21633:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+48:2362:x1848989694515072:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:2.0:1763334968.045738:0:21633:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334968.045741:0:21633:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb mtime from disk: 0 -> 1763334968 00002000:00010000:2.0:1763334968.045744:0:21633:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334968.045746:0:21633:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb ctime from disk: 0 -> 1763334968 00002000:00010000:2.0:1763334968.045748:0:21633:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x246:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334968.045773:0:21633:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:f4599faa-cf4a-4df6-8700-d383b4282dac+49:2362:x1848989694515072:12345-192.168.201.60@tcp:10:bash.0 Request processed in 283us (7436us total) trans 17179871126 rc 0/0 00000100:00100000:2.0:1763334968.045780:0:21633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1759 00002000:00010000:2.0:1763334968.045783:0:21633:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/582 (0->18446744073709551615) 00002000:00100000:2.0:1763334968.045785:0:21633:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5500380 with x1848989694515072 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334968.045789:0:21633:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5500380. 00000100:00100000:2.0:1763334968.055963:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.056087:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694515456 00000100:00100000:0.0:1763334968.056101:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694515456 00000100:00100000:0.0:1763334968.056175:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1764 00000100:00100000:0.0:1763334968.056187:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:52274:x1848989694515456:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:0.0:1763334968.056825:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa766d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:52274:x1848989694515456:12345-192.168.201.60@tcp:35:bash.0 Request processed in 638us (874us total) trans 8589939014 rc 0/0 00000100:00100000:0.0:1763334968.056835:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1764 00000100:00100000:2.0:1763334968.087870:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.088615:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694515584 00000100:00100000:1.0:1763334968.088631:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694515584 00000100:00100000:1.0:1763334968.088706:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4813 00000100:00100000:1.0:1763334968.088716:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53060:x1848989694515584:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:1.0:1763334968.088743:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334968.088772:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849bbc7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833affaa expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.088859:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bbce lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.088877:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bbce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.088891:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bbce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.088906:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bbd5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.088913:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.088920:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089260:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bbdc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089270:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bbdc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089281:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bbdc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334968.089340:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a6:0x0]: returning size 5 00000004:00200000:1.0:1763334968.089345:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334968.089370:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bbdc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089385:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bbdc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089393:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bbce lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089400:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bbce lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089407:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bbce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089413:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334968.089418:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bbce lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089426:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bbce lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089440:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334968.089443:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334968.089450:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bbce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089457:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bbce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089472:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bbd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089478:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bbd5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089484:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089490:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334968.089492:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bbd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089498:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bbd5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089506:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28faa00) 00010000:00010000:1.0:1763334968.089509:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334968.089512:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bbd5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089518:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bbd5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.089555:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849bbc7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affaa expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.089607:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bbdc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affaa expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.089615:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ad28fa100) 00010000:00010000:1.0:1763334968.089618:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334968.089621:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478000, rc 0) 00000100:00100000:1.0:1763334968.089708:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa767100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53060:x1848989694515584:12345-192.168.201.60@tcp:101:rm.0 Request processed in 992us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334968.089716:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4813 00000100:00100000:0.0:1763334968.094244:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334968.094549:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694515840 00000100:00100000:3.0:1763334968.094565:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694515840 00000100:00100000:2.0:1763334968.095337:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4814 00000100:00100000:2.0:1763334968.095351:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53060:x1848989694515840:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:2.0:1763334968.095421:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1763334968.095457:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bbdc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a6:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affaa expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.095486:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849bb96 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a6:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff8e expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.095498:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ad28fa100) 00010000:00010000:2.0:1763334968.095513:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334968.095545:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bbe3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.095564:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bbe3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.095609:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bbe3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.095626:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bbea lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.095633:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bbea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.095639:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bbea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.095791:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bbf1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.095799:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bbf1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.095806:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bbf1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:2.0:1763334968.096559:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1135, 64 off97192 00000004:00080000:2.0:1763334968.096596:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032730023520ns, next at 1033730019800ns, rc = 0 00000040:00080000:2.0:1763334968.096662:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1124, 64 off96104 00000004:00080000:2.0:1763334968.096670:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032730098016ns, next at 1033730096497ns, rc = 0 00000040:00080000:2.0:1763334968.096693:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1125, 64 off96168 00000040:00080000:2.0:1763334968.096710:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1136, 64 off97256 00010000:00010000:2.0:1763334968.097637:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bbf8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.097667:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bbf8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.097679:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bbf8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.097688:0:32232:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bbf8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.097695:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bbf8 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.097701:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bbf8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.097729:0:32232:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334968.097759:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bbf1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.097766:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bbf1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.097772:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bbf1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.097777:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334968.097783:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bbf1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.097791:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bbf1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.097802:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:2.0:1763334968.097806:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1763334968.097811:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bbf1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.097818:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bbf1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a6:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.099016:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334968.099032:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bbf8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.099043:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334968.099047:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bbf8 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.099054:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bbf8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.099069:0:5737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a6:0x0].0x0 (ffff9a5ac6cab200) 00010000:00010000:0.0:1763334968.099072:0:5737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763334968.099075:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bbf8 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.099137:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bbf8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.099158:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334968.099160:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334968.099162:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334968.103418:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bbe3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.103444:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bbe3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.103454:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bbe3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.103461:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334968.103466:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bbe3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.103474:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bbe3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.103496:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334968.103500:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334968.103505:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bbe3 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.103511:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bbe3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:2.0:1763334968.103525:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c1dbf7cc reply state 00000000d190481b transno 8589939015 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bbea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334968.103535:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334968.103709:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53060:x1848989694515840:12345-192.168.201.60@tcp:36:rm.0 Request processed in 8353us (9474us total) trans 8589939015 rc 0/0 00000100:00100000:2.0:1763334968.103721:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4814 00010000:00010000:3.0:1763334968.111622:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bbea lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.111643:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bbea lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.111653:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bbea lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.111660:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334968.111666:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bbea lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.111674:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bbea lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.111695:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334968.111698:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334968.111704:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bbea lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.111710:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bbea lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334968.127653:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.127904:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694515968 00000100:00100000:2.0:1763334968.127919:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694515968 00000100:00100000:3.0:1763334968.131433:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4815 00000100:00100000:3.0:1763334968.131460:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53061:x1848989694515968:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334968.131498:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334968.131530:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bbff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833affb1 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.131659:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bc06 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131678:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bc06 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131692:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bc06 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131717:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849bc0d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131730:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849bc0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131741:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849bc0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131825:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bc06 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131834:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bc06 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131841:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bc06 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131847:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334968.131852:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bc06 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131860:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bc06 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131877:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334968.131881:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334968.131886:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bc06 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131893:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bc06 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131906:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849bc0d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131911:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849bc0d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131916:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849bc0d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131922:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334968.131925:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849bc0d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131931:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849bc0d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131938:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5af66dee00) 00010000:00010000:3.0:1763334968.131940:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334968.131943:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849bc0d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131949:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849bc0d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.131990:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bbff lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affb1 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.132003:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:3.0:1763334968.132006:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334968.132010:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bbff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affb1 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.132020:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:3.0:1763334968.132129:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53061:x1848989694515968:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 680us (4489us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334968.132138:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4815 00000100:00100000:1.0:1763334968.145102:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334968.145294:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694516096 00000100:00100000:3.0:1763334968.145309:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694516096 00000100:00100000:3.0:1763334968.145378:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4816 00000100:00100000:3.0:1763334968.145391:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53061:x1848989694516096:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334968.145479:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334968.145510:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bc14 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833affb8 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.145961:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc1b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.145981:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc1b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.145994:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc1b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146011:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc22 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146019:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc22 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146025:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc22 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146111:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc1b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146118:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc1b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146125:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc1b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146132:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334968.146137:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc1b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146146:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc1b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146160:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334968.146163:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334968.146169:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc1b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146176:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc1b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146190:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc22 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146196:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc22 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146211:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc22 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146216:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334968.146219:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc22 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146225:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc22 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146232:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334968.146235:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334968.146237:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc22 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146243:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc22 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.146285:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bc14 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affb8 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.146296:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334968.146299:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334968.146304:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bc14 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affb8 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.146690:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:2.0:1763334968.146784:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53061:x1848989694516096:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1394us (1697us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334968.146794:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4816 00000001:00080000:0.0:1763334968.150090:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871125 is committed 00002000:00010000:1.0:1763334968.150226:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:1.0:1763334968.150232:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb mtime from disk: 0 -> 1763334968 00002000:00010000:1.0:1763334968.150235:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb ctime from disk: 0 -> 1763334968 00002000:00010000:1.0:1763334968.150238:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:1.0:1763334968.150259:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849bbc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.150275:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849bbc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.150287:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849bbc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.150295:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334968.150301:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849bbc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.150312:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849bbc0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.150338:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849bbc0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.150352:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849bbc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334968.150494:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa766300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+46:2361:x1848989694514944:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 114988us (115953us total) trans 17179871125 rc 0/0 00000100:00100000:1.0:1763334968.150508:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1757 00000001:00080000:0.0:1763334968.150612:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871118 is committed 00000001:00080000:0.0:1763334968.150711:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871123 is committed 00000001:00080000:0.0:1763334968.150837:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871124 is committed 00000100:00100000:1.0:1763334968.157773:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.158274:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694516224 00000100:00100000:2.0:1763334968.158293:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694516224 00000100:00100000:2.0:1763334968.158453:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4817 00000100:00100000:2.0:1763334968.158466:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53061:x1848989694516224:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334968.158500:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334968.158534:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833affbf expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.158674:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc30 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.158694:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc30 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.158708:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc30 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334968.158802:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x5c:0x0]: returning size 11776 00000004:00200000:2.0:1763334968.158807:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334968.158836:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc30 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.158867:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affbf expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.158889:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc30 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affbf expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.158900:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334968.158903:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334968.158909:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431600, rc 0) 00000100:00100000:2.0:1763334968.159003:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53061:x1848989694516224:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 539us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334968.159012:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4817 00010000:00010000:1.0:1763334968.166335:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334968.170498:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.170844:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694516352 00000100:00100000:0.0:1763334968.170860:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694516352 00000100:00100000:0.0:1763334968.170952:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4818 00000100:00100000:0.0:1763334968.170966:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53061:x1848989694516352:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334968.170994:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334968.171024:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc37 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833affc6 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.171123:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc3e lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171143:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc3e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171157:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc3e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171173:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc45 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171180:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171186:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171291:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc3e lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171300:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc3e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171309:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc3e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171316:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334968.171321:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc3e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171330:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc3e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171348:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334968.171352:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334968.171360:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc3e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171367:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc3e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171384:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc45 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171391:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc45 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171397:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc45 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171402:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334968.171404:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc45 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171411:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc45 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171418:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60a00) 00010000:00010000:0.0:1763334968.171421:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334968.171424:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc45 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171429:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc45 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.171471:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc37 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affc6 expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.171482:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334968.171485:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334968.171489:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc37 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affc6 expref: 190 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.171498:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334968.171654:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53061:x1848989694516352:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 691us (1171us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334968.171664:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4818 00000100:00100000:1.0:1763334968.184076:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.184257:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694516608 00000100:00100000:2.0:1763334968.184276:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694516608 00000100:00100000:2.0:1763334968.184379:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4819 00000100:00100000:2.0:1763334968.184393:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53057:x1848989694516608:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334968.184485:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334968.184530:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849bb7a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a5:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff79 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.184561:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:2.0:1763334968.184568:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334968.184736:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc4c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.184755:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc4c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.184767:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc4c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00010000:2.0:1763334968.185006:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bf64c331 reply state 00000000ea70c0c7 transno 8589939016 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc4c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334968.185017:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334968.185157:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53057:x1848989694516608:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 766us (1097us total) trans 8589939016 rc 0/0 00000100:00100000:2.0:1763334968.185166:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4819 00000100:00100000:1.0:1763334968.187990:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.188090:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694516864 00000100:00100000:0.0:1763334968.188105:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694516864 00000100:00100000:0.0:1763334968.188187:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4820 00000100:00100000:0.0:1763334968.188208:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53061:x1848989694516864:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334968.188237:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334968.188242:0:29627:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334968.188280:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bc30 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affbf expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.188324:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334968.188331:0:29627:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334968.188351:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc53 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833affcd expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.188555:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc5a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.188604:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc5a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.188617:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc5a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.188636:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc61 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.188643:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc61 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.188650:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc61 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.189259:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849bc68 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.189271:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849bc68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.189278:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849bc68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:0.0:1763334968.189289:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a8:0x0]: returning size 0 00010000:00010000:0.0:1763334968.189323:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc5a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.189331:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc5a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.189339:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc5a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.189346:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334968.189351:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc5a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.189360:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc5a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.189369:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334968.189373:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334968.189377:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc5a lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.189383:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc5a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000004:00010000:0.0:1763334968.189394:0:29627:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ecaee25e reply state 000000004d7328e9 transno 8589939017 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc61 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000100:00100000:0.0:1763334968.189403:0:29627:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763334968.189438:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc53 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affcd expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.189453:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849bc68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affcd expref: 191 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.189467:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5ac7d60c00) 00010000:00010000:0.0:1763334968.189469:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334968.189471:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334968.189610:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53061:x1848989694516864:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1414us (1636us total) trans 8589939017 rc 0/0 00000100:00100000:0.0:1763334968.189620:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4820 00010000:00010000:0.0:1763334968.192064:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc4c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.192089:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc4c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.192098:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc4c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.192106:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334968.192114:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc4c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.192123:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc4c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.192148:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00000100:00100000:1.0:1763334968.192151:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334968.192153:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334968.192162:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc4c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.192168:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bc4c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334968.192221:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694516992 00000100:00100000:2.0:1763334968.192236:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694516992 00000100:00100000:2.0:1763334968.192315:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4874 00000100:00100000:2.0:1763334968.192328:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+20:53057:x1848989694516992:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334968.192355:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334968.192384:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849bc76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833affd4 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334968.192415:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x245:0x0] initial LVB size: 4096, mtime: 0x691a5b38, atime: 0x0, ctime: 0x691a5b38, blocks: 0xb 00010000:00010000:2.0:1763334968.192443:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334968.192446:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334968.192457:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849bc76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affd4 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.192475:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849bc76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affd4 expref: 21 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.192490:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430200, rc 0) 00000100:00100000:2.0:1763334968.192614:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:53057:x1848989694516992:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 288us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334968.192622:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4874 00000100:00100000:1.0:1763334968.195952:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.196300:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694517248 00000100:00100000:0.0:1763334968.196316:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694517248 00000100:00100000:0.0:1763334968.196397:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4821 00000100:00100000:0.0:1763334968.196409:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53061:x1848989694517248:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334968.196444:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334968.196476:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bc7d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833affdb expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.196644:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.196663:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849bc68 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affcd expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.196674:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.196720:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849bc68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affcd expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.196736:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849bc68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affcd expref: 192 pid: 29627 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334968.196755:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9833b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701852544:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334968.196874:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c96ee600 going to sleep for 11 seconds 00010000:00010000:2.0:1763334968.197766:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc61 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.197783:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc61 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.197790:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc61 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.197797:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334968.197803:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc61 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.197811:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc61 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.197831:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60a00) 00010000:00010000:2.0:1763334968.197835:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334968.197841:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc61 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.197848:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bc61 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00000100:00100000:1.0:1763334968.201989:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.202255:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694517376 00000100:00100000:0.0:1763334968.202273:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694517376 00000100:00100000:0.0:1763334968.204734:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4875 00000100:00100000:0.0:1763334968.204760:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+18:53057:x1848989694517376:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334968.204786:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334968.204819:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc8b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833affe2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334968.204854:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x241:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334968.204883:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334968.204886:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334968.204896:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affe2 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.204916:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affe2 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.204931:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00000100:00100000:0.0:1763334968.205024:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:53057:x1848989694517376:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 276us (3052us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334968.205032:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4875 00000100:00100000:1.0:1763334968.205774:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.205846:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9833b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701852544:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334968.205878:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334968.206866:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694517504 00000100:00100000:0.0:1763334968.206882:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694517504 00010000:00010000:0.0:1763334968.206937:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849bc68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affcd expref: 192 pid: 29627 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334968.207815:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2567 00000100:00100000:2.0:1763334968.207836:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2359:x1848989694517504:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334968.207861:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334968.207873:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849bc68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affcd expref: 192 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334968.207891:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849bc68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affcd expref: 192 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334968.207921:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849bc68 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affcd expref: 192 pid: 29627 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334968.207943:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5ac7d60c00) 00010000:00010000:2.0:1763334968.207948:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.207960:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.207968:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334968.207993:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334968.208083:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:2359:x1848989694517504:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 256us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334968.208092:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2567 00010000:00010000:1.0:1763334968.208179:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.208188:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334968.208224:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a8:0x0]: returning size 0 00000004:00080000:1.0:1763334968.208735:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x244:0x0], index 0: 0 00000004:00080000:1.0:1763334968.208746:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x248:0x0], index 1: 0 00000004:00080000:1.0:1763334968.208753:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x249:0x0], index 1: 0 00000004:00080000:1.0:1763334968.208759:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x245:0x0], index 0: 0 00010000:00010000:1.0:1763334968.208960:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.208971:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.208980:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.208986:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334968.208991:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.209000:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.209015:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5ac7d60c00) 00010000:00010000:1.0:1763334968.209018:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334968.209023:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.209029:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bc84 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.209104:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bc7d lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affdb expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.209116:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334968.209118:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334968.209122:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bc7d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affdb expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.209137:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:1.0:1763334968.209213:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53061:x1848989694517248:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 12806us (13275us total) trans 8589939018 rc 301/301 00000100:00100000:1.0:1763334968.209223:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4821 00000100:00100000:3.0:1763334968.214467:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334968.214524:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.214767:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694517632 00000100:00100000:0.0:1763334968.214781:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694517632 00002000:00010000:0.0:1763334968.214842:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/581 (5->18446744073709551615) 00002000:00100000:0.0:1763334968.214847:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bed500 with x1848989694517632 ext(5->18446744073709551615) 00002000:00010000:0.0:1763334968.214864:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6bed500. 00000100:00100000:0.0:1763334968.214889:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694517760 00000100:00100000:0.0:1763334968.214891:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694517760 00002000:00010000:0.0:1763334968.214904:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/577 (0->18446744073709551615) 00002000:00100000:0.0:1763334968.214908:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bed880 with x1848989694517760 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334968.214915:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6bed880. 00000100:00100000:0.0:1763334968.214941:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1760 00000100:00100000:0.0:1763334968.214952:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694517632:12345-192.168.201.60@tcp:10:lfs.0 00000100:00100000:2.0:1763334968.215339:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1761 00000100:00100000:2.0:1763334968.215352:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2361:x1848989694517760:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:2.0:1763334968.215737:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x241:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334968.215742:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x241:0x0] updating lvb mtime from disk: 0 -> 1763334968 00002000:00010000:2.0:1763334968.215745:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x241:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334968.215748:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x241:0x0] updating lvb ctime from disk: 0 -> 1763334968 00002000:00010000:2.0:1763334968.215751:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x241:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334968.215832:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2361:x1848989694517760:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 483us (1305us total) trans 21474838407 rc 0/0 00000100:00100000:2.0:1763334968.215841:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1761 00002000:00010000:2.0:1763334968.215846:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/577 (0->18446744073709551615) 00002000:00100000:2.0:1763334968.215850:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bed880 with x1848989694517760 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334968.215856:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6bed880. 00002000:00010000:0.0:1763334968.216472:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb size from disk: 4096 -> 5 00002000:00010000:0.0:1763334968.216478:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb mtime from disk: 1763334968 -> 1763334968 00002000:00010000:0.0:1763334968.216481:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334968.216484:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb ctime from disk: 1763334968 -> 1763334968 00002000:00010000:0.0:1763334968.216619:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1763334968.218615:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694517632:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 3645us (4145us total) trans 17179871127 rc 0/0 00000100:00100000:1.0:1763334968.218634:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1760 00002000:00010000:1.0:1763334968.218644:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/581 (5->18446744073709551615) 00002000:00100000:1.0:1763334968.218648:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bed500 with x1848989694517632 ext(5->18446744073709551615) 00002000:00010000:1.0:1763334968.218660:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6bed500. 00000100:00100000:3.0:1763334968.218908:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.219229:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694518016 00000100:00100000:1.0:1763334968.219243:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694518016 00000100:00100000:1.0:1763334968.219321:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1765 00000100:00100000:1.0:1763334968.219332:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53061:x1848989694518016:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334968.222695:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53061:x1848989694518016:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 3342us (3766us total) trans 8589939019 rc 0/0 00000100:00100000:1.0:1763334968.222714:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1765 00000100:00100000:2.0:1763334968.222899:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.228392:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694518272 00000100:00100000:0.0:1763334968.228420:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694518272 00000100:00100000:2.0:1763334968.231743:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.231878:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4822 00000100:00100000:0.0:1763334968.231907:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53057:x1848989694518272:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334968.232045:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc99 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.232069:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc99 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.232083:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc99 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00010000:0.0:1763334968.232302:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bafc754e reply state 0000000051b29dc1 transno 8589939020 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc99 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334968.232314:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334968.232454:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53057:x1848989694518272:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 559us (9554us total) trans 8589939020 rc 0/0 00000100:00100000:0.0:1763334968.232464:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4822 00000100:00100000:0.0:1763334968.232540:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694518528 00000100:00100000:0.0:1763334968.232550:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694518528 00000100:00100000:0.0:1763334968.232617:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1766 00000100:00100000:0.0:1763334968.232624:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53061:x1848989694518528:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334968.232738:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53061:x1848989694518528:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 114us (1010us total) trans 8589939021 rc 0/0 00000100:00100000:0.0:1763334968.232744:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1766 00000100:00100000:3.0:1763334968.236095:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.237567:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694518656 00000100:00100000:1.0:1763334968.237601:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694518656 00000100:00100000:1.0:1763334968.237685:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4876 00000100:00100000:1.0:1763334968.237698:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2361:x1848989694518656:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:1.0:1763334968.237969:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763334968.237974:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb mtime from disk: 1763334968 -> 1763334968 00002000:00010000:1.0:1763334968.237978:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb atime from disk: 0 -> 1763334968 00002000:00010000:1.0:1763334968.237981:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb ctime from disk: 1763334968 -> 1763334968 00002000:00010000:1.0:1763334968.237983:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb blocks from disk: 1 -> 1 00010000:00010000:0.0:1763334968.238178:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc99 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.238190:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc99 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.238208:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc99 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.238215:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334968.238220:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc99 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.238229:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc99 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.238249:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:0.0:1763334968.238259:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334968.238264:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc99 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.238271:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bc99 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334968.240723:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694518656:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 3007us (4626us total) trans 21474838408 rc 0/0 00000100:00100000:1.0:1763334968.240743:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4876 00000100:00100000:3.0:1763334968.241935:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.242351:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694518912 00000100:00100000:0.0:1763334968.242367:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694518912 00000100:00100000:0.0:1763334968.242450:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4823 00000100:00100000:0.0:1763334968.242461:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:52274:x1848989694518912:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334968.242495:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334968.242521:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bca0 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833affe9 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.242760:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bca7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.242778:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bca7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.242790:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bca7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.242805:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bcae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.242811:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bcae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.242817:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bcae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.242886:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bcb5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.242893:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.242899:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bcb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:0.0:1763334968.242914:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a8:0x0]: returning size 0 00010000:00010000:0.0:1763334968.243040:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bca7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243048:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bca7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243055:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bca7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243061:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334968.243066:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bca7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243074:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bca7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243087:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:0.0:1763334968.243091:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334968.243097:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bca7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243104:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bca7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243119:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bcae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243124:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bcae lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243130:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bcae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243139:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334968.243142:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bcae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243148:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bcae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243155:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac7d60600) 00010000:00010000:0.0:1763334968.243158:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334968.243161:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bcae lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243166:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bcae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:0.0:1763334968.243235:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bca0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affe9 expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.243260:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bcb5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affe9 expref: 195 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.243270:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334968.243272:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334968.243275:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334968.243368:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:52274:x1848989694518912:12345-192.168.201.60@tcp:101:bash.0 Request processed in 906us (1451us total) trans 8589939022 rc 0/0 00000100:00100000:0.0:1763334968.243376:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4823 00000100:00100000:2.0:1763334968.258835:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.258893:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334968.258985:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694519168 00000100:00100000:3.0:1763334968.259001:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694519168 00000100:00100000:3.0:1763334968.259090:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1767 00000100:00100000:3.0:1763334968.259104:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53057:x1848989694519168:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:3.0:1763334968.259191:0:29630:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x1a5:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849baa1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff3a expref: 195 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.259337:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.259354:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bb65 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff6b expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.259365:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.259413:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bb65 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff6b expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.259429:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bb65 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff6b expref: 195 pid: 30972 timeout: 1132 lvb_type: 0 00000100:00100000:3.0:1763334968.259452:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701852672:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334968.259615:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1600 going to sleep for 11 seconds 00000100:00100000:0.0:1763334968.260034:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694519424 00000100:00100000:0.0:1763334968.260042:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694519424 00000100:00100000:0.0:1763334968.260089:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4824 00000100:00100000:0.0:1763334968.260098:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:52274:x1848989694519424:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:0.0:1763334968.260142:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334968.260162:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bcb5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affe9 expref: 196 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.260184:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334968.260208:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334968.260523:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bcca lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.260537:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bcca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.260548:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bcca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:0.0:1763334968.260637:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939023 00000004:00010000:0.0:1763334968.260659:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fab49e04 reply state 00000000dc24e8bf transno 8589939024 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bcca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334968.260668:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334968.260967:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+198:52274:x1848989694519424:12345-192.168.201.60@tcp:36:bash.0 Request processed in 867us (2069us total) trans 8589939024 rc 0/0 00000100:00100000:0.0:1763334968.260976:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4824 00000020:00080000:0.0:1763334968.260982:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763334968.264432:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701852672:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334968.264479:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334968.264612:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bcca lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.264621:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bcca lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.264633:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bcca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.264640:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334968.264645:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bcca lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.264652:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bcca lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.264671:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5ac7d60e00) 00010000:00010000:0.0:1763334968.264674:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334968.264679:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bcca lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334968.264685:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bcca lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334968.265275:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.265400:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694519552 00000100:00100000:0.0:1763334968.265413:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694519552 00000100:00100000:0.0:1763334968.265486:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4825 00000100:00100000:0.0:1763334968.265499:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:52274:x1848989694519552:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1763334968.265526:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334968.265552:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bcd1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afff0 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.265658:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afff0 expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.265673:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bcd1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afff0 expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.265694:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:0.0:1763334968.265697:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334968.265700:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334968.267346:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+198:52274:x1848989694519552:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1833us (2058us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334968.267445:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4825 00000100:00100000:2.0:1763334968.267828:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.267908:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694519680 00000100:00100000:0.0:1763334968.267925:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694519680 00010000:00010000:0.0:1763334968.267971:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bb65 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff6b expref: 198 pid: 30972 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334968.268011:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2568 00000100:00100000:0.0:1763334968.268021:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+198:2359:x1848989694519680:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334968.268039:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334968.268048:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bb65 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff6b expref: 198 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334968.268064:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bb65 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff6b expref: 198 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334968.268092:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bb65 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff6b expref: 198 pid: 30972 timeout: 1132 lvb_type: 0 00010000:00010000:0.0:1763334968.268111:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:0.0:1763334968.268117:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334968.268226:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334968.268235:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334968.269203:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334968.269913:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694519680:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1882us (2074us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334968.269928:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2568 00010000:00010000:3.0:1763334968.271445:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.271465:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000040:00080000:3.0:1763334968.272024:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1126, 88 off96256 00000004:00080000:3.0:1763334968.272036:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032905463128ns, next at 1033730096497ns, rc = 0 00000040:00080000:3.0:1763334968.272071:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1137, 88 off97344 00000004:00080000:3.0:1763334968.272075:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032905503675ns, next at 1033730019800ns, rc = 0 00000040:00080000:3.0:1763334968.272092:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1138, 88 off97432 00000004:00080000:3.0:1763334968.272096:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032905524241ns, next at 1033730019800ns, rc = 0 00000040:00080000:3.0:1763334968.272110:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1127, 88 off96344 00000004:00080000:3.0:1763334968.272114:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032905541960ns, next at 1033730096497ns, rc = 0 00000100:00100000:2.0:1763334968.272426:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334968.275542:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694519936 00000100:00100000:3.0:1763334968.275563:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694519936 00000100:00100000:3.0:1763334968.275684:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4826 00000100:00100000:3.0:1763334968.275696:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+198:52274:x1848989694519936:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1763334968.275728:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334968.275732:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334968.275776:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bcd1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afff0 expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.275805:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:3.0:1763334968.275824:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334968.275851:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849bcd8 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afff7 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.276206:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.276223:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334968.276239:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:3.0:1763334968.278825:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1128, 88 off96432 00000004:00080000:3.0:1763334968.278843:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032912270774ns, next at 1033730096497ns, rc = 0 00000040:00080000:3.0:1763334968.286643:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1139, 88 off97520 00000004:00080000:3.0:1763334968.286670:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032920097767ns, next at 1033730019800ns, rc = 0 00000040:00080000:3.0:1763334968.286733:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1140, 88 off97608 00000004:00080000:3.0:1763334968.286739:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1032920167049ns, next at 1033730019800ns, rc = 0 00000040:00080000:3.0:1763334968.286781:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1129, 88 off96520 00000004:00080000:3.0:1763334968.286787:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1032920214697ns, next at 1033730096497ns, rc = 0 00000001:00080000:0.0:1763334968.332483:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939024 is committed 00000004:00080000:0.0:1763334968.332535:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 737 committed 00000004:00080000:0.0:1763334968.332546:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 749 committed 00000001:00080000:0.0:1763334968.332558:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939025 is committed 00000004:00080000:0.0:1763334968.332561:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 739 committed 00000004:00080000:0.0:1763334968.332564:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 751 committed 00000004:00080000:0.0:1763334968.332566:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 750 committed 00000004:00080000:0.0:1763334968.332568:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 738 committed 00000100:00100000:0.0:1763334968.332809:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701852800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1763334968.332905:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334968.332954:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763334968.332960:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701853184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334968.332982:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334968.333039:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701852800 00000100:00100000:0.0:1763334968.333049:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701852800 00000100:00100000:0.0:1763334968.333095:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701853184 00000100:00100000:0.0:1763334968.333098:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701853184 00000100:00100000:0.0:1763334968.333118:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4877 00000100:00100000:0.0:1763334968.333128:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3292:x1848989701852800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334968.333158:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:582 count 1 00010000:00010000:0.0:1763334968.333191:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.333238:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff95 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.333247:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334968.333250:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334968.333255:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.333286:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff95 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.333302:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff95 expref: 21 pid: 6517 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334968.333315:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeef9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701853312:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334968.333384:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c96ee600 going to sleep for 11 seconds 00000100:00100000:0.0:1763334968.333401:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4878 00000100:00100000:0.0:1763334968.333408:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+6:3292:x1848989701853184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334968.333653:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:0.0:1763334968.333656:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb mtime from disk: 1763334968 -> 1763334968 00002000:00010000:0.0:1763334968.333660:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334968.333662:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb ctime from disk: 1763334968 -> 1763334968 00002000:00010000:0.0:1763334968.333664:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x245:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1763334968.333714:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3292:x1848989701853184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 306us (729us total) trans 17179871128 rc 0/0 00000100:00100000:0.0:1763334968.333726:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4878 00000100:00100000:0.0:1763334968.333775:0:3292:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871124 gen 2 00000004:00080000:0.0:1763334968.333780:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c6a00, transno 17179871030 00000004:00080000:0.0:1763334968.333789:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c4700, transno 17179871031 00000004:00080000:0.0:1763334968.333792:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c6d80, transno 17179871032 00000004:00080000:0.0:1763334968.333795:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c4a80, transno 17179871033 00000004:00080000:0.0:1763334968.333798:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b5500, transno 17179871035 00000004:00080000:0.0:1763334968.333801:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b7480, transno 17179871036 00000004:00080000:0.0:1763334968.333803:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b4380, transno 17179871037 00000004:00080000:0.0:1763334968.333807:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b4e00, transno 17179871038 00000004:00080000:0.0:1763334968.333810:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b4700, transno 17179871039 00000004:00080000:0.0:1763334968.333812:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b6680, transno 17179871040 00000004:00080000:0.0:1763334968.333815:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b7100, transno 17179871041 00000004:00080000:0.0:1763334968.333817:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b7800, transno 17179871042 00000004:00080000:0.0:1763334968.333820:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6451f80, transno 17179871045 00000004:00080000:0.0:1763334968.333822:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6453100, transno 17179871046 00000004:00080000:0.0:1763334968.333825:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa44ea00, transno 17179871047 00000004:00080000:0.0:1763334968.333828:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa44f800, transno 17179871048 00000004:00080000:0.0:1763334968.333844:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77f800, transno 17179871053 00000004:00080000:0.0:1763334968.333847:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d4a80, transno 17179871054 00000004:00080000:0.0:1763334968.333849:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d4e00, transno 17179871055 00000004:00080000:0.0:1763334968.333852:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d5180, transno 17179871056 00000004:00080000:0.0:1763334968.333854:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca872a00, transno 17179871057 00000004:00080000:0.0:1763334968.333857:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca873800, transno 17179871058 00000004:00080000:0.0:1763334968.333859:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeefe6a00, transno 17179871060 00000004:00080000:0.0:1763334968.333862:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5b01f2c700, transno 17179871061 00000004:00080000:0.0:1763334968.333864:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeefe6680, transno 17179871062 00000004:00080000:0.0:1763334968.333867:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77e300, transno 17179871063 00000004:00080000:0.0:1763334968.333870:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77dc00, transno 17179871064 00000004:00080000:0.0:1763334968.333873:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5b01f2e300, transno 17179871065 00000004:00080000:0.0:1763334968.333876:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa7ef480, transno 17179871067 00000004:00080000:0.0:1763334968.333878:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeefe7800, transno 17179871068 00000004:00080000:0.0:1763334968.333881:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeefe4700, transno 17179871069 00000004:00080000:0.0:1763334968.333883:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeefe4e00, transno 17179871070 00000004:00080000:0.0:1763334968.333885:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f3480, transno 17179871073 00000004:00080000:0.0:1763334968.333888:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f0380, transno 17179871074 00000004:00080000:0.0:1763334968.333891:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4d500, transno 17179871075 00000004:00080000:0.0:1763334968.333894:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4d180, transno 17179871076 00000004:00080000:0.0:1763334968.333897:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeec58380, transno 17179871080 00000004:00080000:0.0:1763334968.333900:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af59faa00, transno 17179871081 00000004:00080000:0.0:1763334968.333902:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f1880, transno 17179871082 00000004:00080000:0.0:1763334968.333905:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af59f9880, transno 17179871083 00000004:00080000:0.0:1763334968.333908:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac721aa00, transno 17179871085 00000004:00080000:0.0:1763334968.333910:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac721ad80, transno 17179871086 00000004:00080000:0.0:1763334968.333913:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5ad880, transno 17179871087 00000004:00080000:0.0:1763334968.333915:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7218e00, transno 17179871088 00000004:00080000:0.0:1763334968.333918:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab35c00, transno 17179871089 00000004:00080000:0.0:1763334968.333921:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7219180, transno 17179871090 00000004:00080000:0.0:1763334968.333923:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7218000, transno 17179871091 00000004:00080000:0.0:1763334968.333926:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7219c00, transno 17179871092 00000004:00080000:0.0:1763334968.333928:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a21180, transno 17179871094 00000004:00080000:0.0:1763334968.333930:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a23b80, transno 17179871095 00000004:00080000:0.0:1763334968.333932:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a22d80, transno 17179871096 00000004:00080000:0.0:1763334968.333935:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a22300, transno 17179871097 00000004:00080000:0.0:1763334968.333937:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f0a80, transno 17179871100 00000004:00080000:0.0:1763334968.333940:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1f0000, transno 17179871101 00000004:00080000:0.0:1763334968.333942:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad809e680, transno 17179871102 00000004:00080000:0.0:1763334968.333945:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad809c380, transno 17179871103 00000004:00080000:0.0:1763334968.333948:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fd180, transno 17179871107 00000004:00080000:0.0:1763334968.333951:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fd880, transno 17179871108 00000004:00080000:0.0:1763334968.333953:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fea00, transno 17179871109 00000004:00080000:0.0:1763334968.333955:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fed80, transno 17179871111 00000004:00080000:0.0:1763334968.333957:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab30a80, transno 17179871112 00000004:00080000:0.0:1763334968.333960:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab31500, transno 17179871113 00000004:00080000:0.0:1763334968.333962:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa3ae300, transno 17179871114 00000004:00080000:0.0:1763334968.333965:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa3aed80, transno 17179871115 00000004:00080000:0.0:1763334968.333967:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa3ad180, transno 17179871116 00000004:00080000:0.0:1763334968.333970:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa3adc00, transno 17179871117 00000004:00080000:0.0:1763334968.333972:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa3ace00, transno 17179871118 00000004:00080000:0.0:1763334968.333975:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa3adf80, transno 17179871119 00000004:00080000:0.0:1763334968.333978:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d7100, transno 17179871121 00000004:00080000:0.0:1763334968.333980:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d5500, transno 17179871122 00000004:00080000:0.0:1763334968.333982:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c5f80, transno 17179871123 00000004:00080000:0.0:1763334968.333985:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c7800, transno 17179871124 00000100:00100000:0.0:1763334968.333992:0:3292:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5ac8419180 x1848989701853184/t17179871128(17179871128) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334984 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763334968.334003:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac8419180/2, rc 0, transno 17179871128 00000100:00100000:0.0:1763334968.334008:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8419180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701853184:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334968.334499:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 2 changes, 4 in progress, 3 in flight, 72 done 00000100:00100000:0.0:1763334968.334944:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeef9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701853440:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1763334968.335002:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334968.335051:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701853440 00000100:00100000:0.0:1763334968.335059:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701853440 00000100:00100000:0.0:1763334968.335105:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4879 00000100:00100000:0.0:1763334968.335113:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+21:3292:x1848989701853440:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334968.335137:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:578 count 1 00010000:00010000:0.0:1763334968.335167:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 3/0,1 mode: --/PW res: [0x240000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.335191:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bbab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff9c expref: 20 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.335215:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334968.335218:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334968.335222:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 4/0,1 mode: --/PW res: [0x240000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.335252:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bbab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff9c expref: 20 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.335266:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bbab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff9c expref: 20 pid: 6517 timeout: 1132 lvb_type: 0 00000100:00100000:0.0:1763334968.335278:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701853568:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334968.335337:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c96ee6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334968.335398:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763334968.335406:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701853952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334968.335431:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334968.335453:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701853952 00000100:00100000:0.0:1763334968.335456:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701853952 00000100:00100000:0.0:1763334968.335482:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4880 00000100:00100000:0.0:1763334968.335489:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3292:x1848989701853952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334968.335715:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x241:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334968.335719:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x241:0x0] updating lvb mtime from disk: 1763334968 -> 1763334968 00002000:00010000:0.0:1763334968.335722:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x241:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334968.335724:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x241:0x0] updating lvb ctime from disk: 1763334968 -> 1763334968 00002000:00010000:0.0:1763334968.335727:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x241:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334968.335782:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3292:x1848989701853952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 293us (349us total) trans 21474838409 rc 0/0 00000100:00100000:0.0:1763334968.335790:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4880 00000004:00080000:0.0:1763334968.335843:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b4e00/2, rc 0, transno 21474838409 00000100:00100000:0.0:1763334968.335850:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701853952:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334968.336139:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701852928:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334968.336178:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334968.336217:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701853696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334968.336239:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334968.336267:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1763334968.336274:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701853056:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334968.336295:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334968.336315:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701853824:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334968.336334:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334968.336368:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701852928 00000100:00100000:1.0:1763334968.336373:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701852928 00000100:00100000:1.0:1763334968.336406:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701853696 00000100:00100000:1.0:1763334968.336410:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701853696 00000100:00100000:1.0:1763334968.336426:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701853056 00000100:00100000:1.0:1763334968.336429:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701853056 00000100:00100000:1.0:1763334968.336438:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701853824 00000100:00100000:1.0:1763334968.336440:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701853824 00000100:00100000:1.0:1763334968.336452:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4881 00000100:00100000:1.0:1763334968.336460:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701852928:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1763334968.336480:0:6517:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:583 count 1 00002000:00010000:1.0:1763334968.336518:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x247:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334968.336526:0:6517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bcf4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.336540:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334968.336542:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334968.336548:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bcf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.336562:0:6517:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bcf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.336602:0:6517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bcf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.336612:0:6517:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bcf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.336634:0:6517:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1763334968.336933:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701852928:12345-0@lo:6:osp-syn-1-0.0 Request processed in 472us (753us total) trans 17179871129 rc 0/0 00000100:00100000:1.0:1763334968.336941:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4881 00000100:00100000:1.0:1763334968.336957:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4882 00000100:00100000:1.0:1763334968.336963:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3289:x1848989701853696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763334968.336975:0:6517:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:579 count 1 00002000:00010000:1.0:1763334968.336991:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x243:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334968.336995:0:6517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bcfb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337004:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334968.337005:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334968.337008:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bcfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337018:0:6517:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bcfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337026:0:6517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bcfb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337033:0:6517:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bcfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337046:0:6517:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:1.0:1763334968.337215:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3289:x1848989701853696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 252us (974us total) trans 21474838410 rc 0/0 00000100:00100000:1.0:1763334968.337221:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4882 00000100:00100000:1.0:1763334968.337232:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4883 00000100:00100000:1.0:1763334968.337237:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701853056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334968.337349:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334968.337352:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb mtime from disk: 1763334968 -> 1763334968 00002000:00010000:1.0:1763334968.337354:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334968.337356:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb ctime from disk: 1763334968 -> 1763334968 00002000:00010000:1.0:1763334968.337358:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x244:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:1.0:1763334968.337380:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701853056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 143us (1085us total) trans 17179871130 rc 0/0 00000100:00100000:1.0:1763334968.337387:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4883 00000100:00100000:1.0:1763334968.337397:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4884 00000100:00100000:1.0:1763334968.337402:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+24:3289:x1848989701853824:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334968.337478:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb size from disk: 5 -> 5 00002000:00010000:1.0:1763334968.337481:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb mtime from disk: 1763334968 -> 1763334968 00002000:00010000:1.0:1763334968.337483:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb atime from disk: 1763334968 -> 1763334968 00002000:00010000:1.0:1763334968.337485:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb ctime from disk: 1763334968 -> 1763334968 00002000:00010000:1.0:1763334968.337487:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x240:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334968.337511:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+25:3289:x1848989701853824:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (1176us total) trans 21474838411 rc 0/0 00000100:00100000:1.0:1763334968.337516:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4884 00010000:00010000:1.0:1763334968.337563:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1763334968.337613:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bcf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337622:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334968.337627:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bcf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337636:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bcf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337656:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bcf4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337664:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bcf4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337681:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334968.337684:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bcfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337690:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334968.337693:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bcfb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337700:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bcfb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337709:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bcfb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337715:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bcfb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x243:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.337726:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334968.337728:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334968.337729:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334968.337736:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1763334968.337793:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841a680/2, rc 0, transno 17179871130 00000100:00100000:1.0:1763334968.337806:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701853056:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334968.337818:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b4380/2, rc 0, transno 21474838411 00000100:00100000:1.0:1763334968.337826:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701853824:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334968.337835:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a81180/2, rc 0, transno 17179871129 00000100:00100000:1.0:1763334968.337838:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701852928:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1763334968.337846:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b7480/2, rc 0, transno 21474838410 00000100:00100000:1.0:1763334968.337849:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701853696:0@lo:6:osp-syn-0-0.0 00000004:00010000:2.0:1763334968.338190:0:29630:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000001a31b92 reply state 00000000185d3a0e transno 8589939025 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:2.0:1763334968.338214:0:29630:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334968.338225:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:2.0:1763334968.338228:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334968.338238:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c3abe800/0xcedf0054f849baa1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff3a expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1763334968.338360:0:29630:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1763334968.338386:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53057:x1848989694519168:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 79286us (79571us total) trans 8589939025 rc 0/0 00000100:00100000:2.0:1763334968.338396:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1767 00010000:00010000:1.0:1763334968.340528:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334968.340549:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334968.340558:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334968.340564:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334968.340626:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334968.340635:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334968.340654:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:1.0:1763334968.340658:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334968.340663:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334968.340671:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bcc3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00000100:00100000:2.0:1763334968.348638:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.348706:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701853568:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334968.348744:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 3/0,1 mode: --/PW res: [0x240000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334968.349251:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694520064 00000100:00100000:2.0:1763334968.349260:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694520064 00000100:00100000:2.0:1763334968.349332:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4827 00000100:00100000:2.0:1763334968.349343:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53057:x1848989694520064:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334968.349374:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334968.349401:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431200/0xcedf0054f849bd02 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833afffe expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.349473:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431200/0xcedf0054f849bd02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afffe expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.349489:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431200/0xcedf0054f849bd02 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afffe expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.349510:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:2.0:1763334968.349513:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334968.349518:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431200, rc 0) 00000100:00100000:2.0:1763334968.351380:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53057:x1848989694520064:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2020us (2736us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334968.351396:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4827 00000100:00100000:0.0:1763334968.351545:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeef9d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701853312:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334968.351595:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334968.351719:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334968.352059:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694520320 00000100:00100000:3.0:1763334968.352069:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694520320 00010000:00010000:3.0:1763334968.352109:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bbab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff9c expref: 21 pid: 6517 timeout: 1132 lvb_type: 0 00000100:00100000:3.0:1763334968.352144:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2569 00000100:00100000:3.0:1763334968.352154:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694520320:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334968.352171:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334968.352176:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bbab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff9c expref: 21 pid: 6517 timeout: 1132 lvb_type: 0 00010000:00010000:3.0:1763334968.352188:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bbab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff9c expref: 21 pid: 6517 timeout: 1132 lvb_type: 0 00010000:00010000:3.0:1763334968.352225:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bbab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x242:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff9c expref: 21 pid: 6517 timeout: 1132 lvb_type: 0 00010000:00010000:3.0:1763334968.352247:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334968.352250:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334968.352255:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.352265:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.352290:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334968.352339:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694520320:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 186us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334968.352345:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2569 00010000:00010000:2.0:1763334968.352770:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.352787:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.352798:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.352807:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.352827:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334968.353212:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+25:3292:x1848989701853440:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18097us (18207us total) trans 21474838412 rc 0/0 00000100:00100000:2.0:1763334968.353220:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4879 00000004:00080000:2.0:1763334968.353273:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeef9ed80/2, rc 0, transno 21474838412 00000100:00100000:2.0:1763334968.353280:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeef9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701853440:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1763334968.353331:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.353350:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694520192 00000100:00100000:2.0:1763334968.353354:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694520192 00010000:00010000:2.0:1763334968.353376:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff95 expref: 22 pid: 6517 timeout: 1132 lvb_type: 0 00000100:00100000:2.0:1763334968.353398:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2570 00000100:00100000:2.0:1763334968.353406:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694520192:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334968.353417:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334968.353420:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb9d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff95 expref: 22 pid: 6517 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334968.353432:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff95 expref: 22 pid: 6517 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334968.353450:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bb9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff95 expref: 22 pid: 6517 timeout: 1132 lvb_type: 0 00010000:00010000:2.0:1763334968.353461:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334968.353463:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334968.353467:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.353475:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.353488:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334968.353506:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694520192:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 102us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334968.353511:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2570 00010000:00010000:2.0:1763334968.353644:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.353653:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.353661:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.353672:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.353687:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1763334968.355077:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763334968.355097:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.355113:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334968.355118:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.355131:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.355155:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 1/0,0 mode: --/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.355163:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bced lrc: 0/0,0 mode: --/PW res: [0x240000400:0x242:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.355204:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334968.355209:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.355216:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334968.355218:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.355226:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.355238:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.355246:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849bce6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.355261:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334968.355264:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334968.355265:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334968.357113:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334968.358602:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334968.360719:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694520576 00000100:00100000:3.0:1763334968.360740:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694520576 00000100:00100000:3.0:1763334968.360820:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1768 00000100:00100000:3.0:1763334968.360834:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac53a0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53057:x1848989694520576:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:3.0:1763334968.361340:0:29630:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x1a5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1763334968.361473:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1130, 64 off96584 00000040:00080000:3.0:1763334968.361516:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1141, 64 off97672 00000040:00080000:3.0:1763334968.361535:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1142, 64 off97736 00000040:00080000:3.0:1763334968.361550:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1131, 64 off96648 00010000:00010000:3.0:1763334968.361745:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bd09 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.361784:0:29630:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bd09 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.361798:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bd09 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.361808:0:29630:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bd09 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.361815:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bd09 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.361822:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bd09 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.361851:0:29630:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334968.362051:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac53a0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53057:x1848989694520576:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1216us (3488us total) trans 8589939027 rc 0/0 00000100:00100000:3.0:1763334968.362061:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1768 00010000:00010000:3.0:1763334968.362139:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334968.362146:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bd09 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.362154:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334968.362159:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bd09 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.362168:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bd09 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.362184:0:5736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a5:0x0].0x0 (ffff9a5ac6cab300) 00010000:00010000:3.0:1763334968.362187:0:5736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763334968.362204:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bd09 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.362211:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bd09 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334968.362221:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334968.362223:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334968.362225:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334968.363857:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701852800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 30715us (30938us total) trans 17179871131 rc 0/0 00000100:00100000:2.0:1763334968.363874:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4877 00000004:00080000:1.0:1763334968.364005:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c9833b80/2, rc 0, transno 17179871131 00000100:00100000:1.0:1763334968.364179:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9833b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701852800:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334968.370015:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.370063:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694520832 00000100:00100000:2.0:1763334968.370077:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694520832 00000100:00100000:2.0:1763334968.370149:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4828 00000100:00100000:2.0:1763334968.370160:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53057:x1848989694520832:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334968.370188:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334968.370226:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bd10 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0005 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.370341:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bd17 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370358:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bd17 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370375:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bd17 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370393:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bd1e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370401:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bd1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370408:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bd1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370609:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd25 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370618:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370624:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334968.370635:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a8:0x0]: returning size 2 00010000:00010000:2.0:1763334968.370756:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd25 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370763:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd25 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370771:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd25 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370778:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334968.370783:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd25 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370790:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd25 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370805:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:2.0:1763334968.370808:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1763334968.370815:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd25 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370825:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd25 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x11/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370845:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bd17 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370850:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bd17 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370855:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bd17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370859:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334968.370862:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bd17 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370867:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bd17 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370873:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334968.370875:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334968.370879:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bd17 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370884:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bd17 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370891:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bd1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370897:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bd1e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370902:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bd1e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370908:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334968.370910:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bd1e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370915:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bd1e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370922:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334968.370924:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334968.370927:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bd1e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370931:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bd1e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334968.370978:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bd10 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0005 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.370990:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334968.370993:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334968.370996:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bd10 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0005 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.371006:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:2.0:1763334968.371081:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53057:x1848989694520832:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 923us (1082us total) trans 8589939028 rc 301/301 00000100:00100000:2.0:1763334968.371089:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4828 00000100:00100000:3.0:1763334968.375938:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.377105:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694520960 00000100:00100000:1.0:1763334968.377122:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694520960 00000100:00100000:1.0:1763334968.377921:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4829 00000100:00100000:1.0:1763334968.377938:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53057:x1848989694520960:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334968.377965:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334968.377992:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bd33 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b000c expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.378121:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bd3a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334968.378136:0:29627:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.378146:0:29627:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bd3a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:1.0:1763334968.378169:0:29627:0:(ldlm_request.c:362:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334968.378181:0:29627:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bd3a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000001:00080000:0.0:1763334968.394662:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939026 is committed 00000004:00080000:0.0:1763334968.394682:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 741 committed 00010000:00010000:2.0:1763334968.395054:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afff7 expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.395080:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:2.0:1763334968.395083:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334968.395088:0:32232:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bd3a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.395098:0:32232:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bd3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.395106:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bd3a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29627 initiator: MDT0 00000004:00080000:0.0:1763334968.395223:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 753 committed 00000004:00080000:0.0:1763334968.395235:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 752 committed 00000004:00080000:0.0:1763334968.395238:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 740 committed 00000100:00100000:1.0:1763334968.395349:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701854080:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334968.395444:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334968.395550:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701854208:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334968.395601:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763334968.396463:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849bcd8 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afff7 expref: 190 pid: 32232 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763334968.396491:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afff7 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.396532:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:2.0:1763334968.396636:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:52274:x1848989694519936:12345-192.168.201.60@tcp:101:bash.0 Request processed in 120942us (124217us total) trans 8589939026 rc 0/0 00000100:00100000:2.0:1763334968.396647:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4826 00000100:00100000:2.0:1763334968.396800:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701854336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334968.396842:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334968.396881:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701854464:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334968.396906:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334968.396940:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701854080 00000100:00100000:2.0:1763334968.396948:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701854080 00000100:00100000:2.0:1763334968.396991:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701854208 00000100:00100000:2.0:1763334968.396995:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701854208 00000100:00100000:2.0:1763334968.397013:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701854336 00000100:00100000:2.0:1763334968.397015:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701854336 00000100:00100000:2.0:1763334968.397034:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701854464 00000100:00100000:2.0:1763334968.397038:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701854464 00000100:00100000:2.0:1763334968.397058:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4885 00000100:00100000:2.0:1763334968.397068:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3292:x1848989701854080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334968.397343:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3292:x1848989701854080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 276us (1899us total) trans 21474838413 rc 0/0 00000100:00100000:2.0:1763334968.397351:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4885 00000100:00100000:2.0:1763334968.397366:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4886 00000100:00100000:2.0:1763334968.397373:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+26:3289:x1848989701854208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334968.397472:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3289:x1848989701854208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (1871us total) trans 21474838414 rc 0/0 00000100:00100000:2.0:1763334968.397478:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4886 00000100:00100000:2.0:1763334968.397488:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4887 00000100:00100000:2.0:1763334968.397493:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3290:x1848989701854336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334968.397644:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3290:x1848989701854336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 150us (802us total) trans 17179871132 rc 0/0 00000100:00100000:2.0:1763334968.397650:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4887 00000100:00100000:2.0:1763334968.397660:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4888 00000100:00100000:2.0:1763334968.397665:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701854464:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334968.397750:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701854464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (843us total) trans 17179871133 rc 0/0 00000100:00100000:2.0:1763334968.397756:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4888 00010000:00010000:3.0:1763334968.399003:0:29627:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bd3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334968.399021:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bd3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:3.0:1763334968.399078:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a8:0x0]: returning size 2 00000004:00200000:3.0:1763334968.399083:0:29627:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334968.399110:0:29627:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bd3a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334968.399160:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bd33 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b000c expref: 189 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.399184:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bd3a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b000c expref: 188 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.399203:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:3.0:1763334968.399206:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1763334968.399212:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:3.0:1763334968.399304:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53057:x1848989694520960:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 21369us (23378us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334968.399314:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4829 00000004:00080000:3.0:1763334968.399863:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa5fb480/2, rc 0, transno 21474838414 00000100:00100000:3.0:1763334968.399891:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701854208:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334968.399932:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa5f9500/2, rc 0, transno 21474838413 00000100:00100000:3.0:1763334968.399937:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701854080:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334968.401011:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa7ec380/2, rc 0, transno 17179871132 00000100:00100000:2.0:1763334968.401330:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701854336:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763334968.401368:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa7ee300/2, rc 0, transno 17179871133 00000100:00100000:2.0:1763334968.401467:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701854464:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334968.413830:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.413979:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694521088 00000100:00100000:2.0:1763334968.413993:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694521088 00000100:00100000:2.0:1763334968.414081:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4889 00000100:00100000:2.0:1763334968.414094:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+20:52274:x1848989694521088:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1763334968.414134:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334968.414169:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bd41 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0013 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334968.414213:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x244:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334968.414242:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334968.414245:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334968.414259:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bd41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0013 expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.414282:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bd41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0013 expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.414297:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:2.0:1763334968.414371:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:52274:x1848989694521088:12345-192.168.201.60@tcp:101:bash.0 Request processed in 280us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334968.414381:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4889 00000100:00100000:3.0:1763334968.414645:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.414974:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694521216 00000100:00100000:2.0:1763334968.414982:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694521216 00000100:00100000:2.0:1763334968.415397:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4890 00000100:00100000:2.0:1763334968.415410:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694521216:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334968.415427:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334968.415447:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bd48 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b001a expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334968.415527:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701854592:192.168.201.60@tcp:106: 00000100:00100000:2.0:1763334968.416851:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c1e48600 going to sleep for 11 seconds 00000100:00100000:3.0:1763334968.417614:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.417782:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694521344 00000100:00100000:1.0:1763334968.417794:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694521344 00000100:00100000:1.0:1763334968.417864:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4891 00000100:00100000:1.0:1763334968.417876:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+21:52274:x1848989694521344:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1763334968.417899:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334968.417929:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bd4f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0021 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334968.417962:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x248:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334968.417986:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334968.417990:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334968.418002:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bd4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0021 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.418025:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bd4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0021 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.418041:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334968.418113:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+22:52274:x1848989694521344:12345-192.168.201.60@tcp:101:bash.0 Request processed in 239us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334968.418121:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4891 00000100:00100000:0.0:1763334968.423014:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.423057:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.423161:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694521472 00000100:00100000:1.0:1763334968.423176:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694521472 00002000:00010000:1.0:1763334968.423239:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/580 (0->18446744073709551615) 00002000:00100000:1.0:1763334968.423245:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b6680 with x1848989694521472 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334968.423262:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac95b6680. 00000100:00100000:1.0:1763334968.423299:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694521600 00000100:00100000:1.0:1763334968.423302:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694521600 00002000:00010000:1.0:1763334968.423316:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334968.423319:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b7100 with x1848989694521600 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334968.423326:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac95b7100. 00000100:00100000:1.0:1763334968.423353:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1762 00000100:00100000:1.0:1763334968.423364:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694521472:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334968.423803:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x244:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334968.423808:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x244:0x0] updating lvb mtime from disk: 0 -> 1763334968 00002000:00010000:1.0:1763334968.423811:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x244:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334968.423814:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x244:0x0] updating lvb ctime from disk: 0 -> 1763334968 00002000:00010000:1.0:1763334968.423817:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x244:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334968.423891:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694521472:12345-192.168.201.60@tcp:10:bash.0 Request processed in 528us (894us total) trans 21474838415 rc 0/0 00000100:00100000:1.0:1763334968.423900:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1762 00002000:00010000:1.0:1763334968.423904:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/580 (0->18446744073709551615) 00002000:00100000:1.0:1763334968.423907:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b6680 with x1848989694521472 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334968.423911:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac95b6680. 00000100:00100000:1.0:1763334968.423933:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1763 00000100:00100000:1.0:1763334968.423940:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694521600:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1763334968.424106:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334968.424109:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x248:0x0] updating lvb mtime from disk: 0 -> 1763334968 00002000:00010000:1.0:1763334968.424111:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x248:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334968.424113:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x248:0x0] updating lvb ctime from disk: 0 -> 1763334968 00002000:00010000:1.0:1763334968.424115:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x248:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334968.424137:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694521600:12345-192.168.201.60@tcp:10:bash.0 Request processed in 198us (1079us total) trans 17179871134 rc 0/0 00000100:00100000:1.0:1763334968.424144:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1763 00002000:00010000:1.0:1763334968.424146:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334968.424149:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b7100 with x1848989694521600 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334968.424153:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac95b7100. 00002000:00010000:3.0:1763334968.428927:0:26564:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x240000400:0x244:0x0] updating lvb atime: 0 -> 1763334968 00000100:00100000:3.0:1763334968.428968:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701854592:192.168.201.60@tcp:106: 00010000:00010000:3.0:1763334968.429014:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bd48 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b001a expref: 23 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334968.429042:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bd48 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b001a expref: 23 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334968.429057:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430c00, rc 0) 00000100:00100000:3.0:1763334968.429955:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694521216:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 14540us (15302us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334968.429970:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4890 00000100:00100000:3.0:1763334968.441540:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.441741:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694521856 00000100:00100000:2.0:1763334968.441754:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694521856 00000100:00100000:2.0:1763334968.442258:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1769 00000100:00100000:2.0:1763334968.442271:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53057:x1848989694521856:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334968.444438:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53057:x1848989694521856:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 2152us (2895us total) trans 8589939029 rc 0/0 00000100:00100000:2.0:1763334968.444458:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1769 00000100:00100000:0.0:1763334968.447153:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.447281:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694522112 00000100:00100000:1.0:1763334968.447295:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694522112 00000100:00100000:1.0:1763334968.448315:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1770 00000100:00100000:1.0:1763334968.448338:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:52274:x1848989694522112:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:1.0:1763334968.448720:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:52274:x1848989694522112:12345-192.168.201.60@tcp:35:bash.0 Request processed in 390us (1582us total) trans 8589939030 rc 0/0 00000100:00100000:1.0:1763334968.448728:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1770 00000100:00100000:0.0:1763334968.451102:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334968.451231:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694522368 00000100:00100000:3.0:1763334968.451246:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694522368 00000100:00100000:3.0:1763334968.451321:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4830 00000100:00100000:3.0:1763334968.451332:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53057:x1848989694522368:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334968.451362:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334968.451390:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bd56 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0028 expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334968.451488:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bd5d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334968.451505:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bd5d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334968.451519:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bd5d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334968.451535:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bd64 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334968.451542:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bd64 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:3.0:1763334968.451548:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bd64 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.452228:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd6b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.452241:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd6b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.452249:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd6b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334968.452263:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a8:0x0]: returning size 2 00010000:00010000:2.0:1763334968.455419:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bd5d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455444:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bd5d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455458:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bd5d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455465:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334968.455470:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bd5d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455480:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bd5d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455500:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:2.0:1763334968.455503:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334968.455510:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bd5d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455517:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849bd5d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455538:0:29627:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bd64 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455544:0:29627:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bd64 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455550:0:29627:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bd64 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455555:0:29627:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334968.455558:0:29627:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bd64 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455564:0:29627:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bd64 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455617:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5af66de000) 00010000:00010000:2.0:1763334968.455620:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334968.455624:0:29627:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bd64 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455630:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849bd64 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.455707:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849bd56 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x5c:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0028 expref: 193 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.455723:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd6b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0028 expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.455731:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:2.0:1763334968.455734:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334968.455736:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334968.455830:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53057:x1848989694522368:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4499us (4740us total) trans 8589939031 rc 0/0 00000100:00100000:2.0:1763334968.455841:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4830 00000100:00100000:2.0:1763334968.471250:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.471339:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694522496 00000100:00100000:1.0:1763334968.471353:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694522496 00000100:00100000:1.0:1763334968.471427:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1771 00000100:00100000:1.0:1763334968.471440:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53057:x1848989694522496:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:1.0:1763334968.471679:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53057:x1848989694522496:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 240us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334968.471688:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1771 00000100:00100000:0.0:1763334968.474157:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.474218:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694522752 00000100:00100000:2.0:1763334968.474231:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694522752 00000100:00100000:2.0:1763334968.474313:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4831 00000100:00100000:2.0:1763334968.474324:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53057:x1848989694522752:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334968.474349:0:29627:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334968.474378:0:29627:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bd79 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b002f expref: -99 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.474509:0:29627:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849bd80 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.474526:0:29627:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849bd80 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29627 initiator: MDT0 00010000:00010000:2.0:1763334968.474538:0:29627:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849bd80 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29627 initiator: MDT0 00000004:00200000:2.0:1763334968.474552:0:29627:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1a8:0x0]: returning size 2 00010000:00010000:2.0:1763334968.474796:0:29627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bd79 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b002f expref: 195 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.474816:0:29627:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849bd80 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b002f expref: 194 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334968.474826:0:29627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:2.0:1763334968.474829:0:29627:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334968.474834:0:29627:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430a00, rc 0) 00000100:00100000:2.0:1763334968.474898:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53057:x1848989694522752:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 576us (754us total) trans 8589939032 rc 0/0 00000100:00100000:2.0:1763334968.474906:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4831 00000100:00100000:0.0:1763334968.487876:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.488004:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694523008 00000100:00100000:1.0:1763334968.488019:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694523008 00000100:00100000:1.0:1763334968.488104:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1772 00000100:00100000:1.0:1763334968.488116:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53057:x1848989694523008:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:1.0:1763334968.488243:0:29631:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1a8:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849bd80 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b002f expref: 194 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.488312:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334968.488329:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afff7 expref: 194 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.488345:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd6b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0028 expref: 194 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.488354:0:29631:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 5/0,1 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334968.488399:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd6b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0028 expref: 194 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.488416:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd6b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0028 expref: 194 pid: 29627 timeout: 1133 lvb_type: 0 00000100:00100000:1.0:1763334968.488435:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5f8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701854720:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334968.488807:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afff7 expref: 194 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334968.488817:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afff7 expref: 194 pid: 32232 timeout: 1133 lvb_type: 0 00000100:00100000:1.0:1763334968.488826:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701854848:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334968.488852:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bf9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334968.493485:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5f8700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701854720:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334968.493507:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701854848:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334968.493543:0:29631:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:0.0:1763334968.495247:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334968.495534:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694523136 00000100:00100000:2.0:1763334968.495548:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694523136 00010000:00010000:2.0:1763334968.495648:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd6b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0028 expref: 195 pid: 29627 timeout: 1133 lvb_type: 0 00000100:00100000:2.0:1763334968.495694:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2571 00000100:00100000:2.0:1763334968.495706:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2359:x1848989694523136:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334968.495727:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334968.495734:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd6b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0028 expref: 195 pid: 29627 timeout: 1133 lvb_type: 0 00010000:00010000:2.0:1763334968.495749:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd6b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0028 expref: 195 pid: 29627 timeout: 1133 lvb_type: 0 00010000:00010000:2.0:1763334968.495779:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bd6b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0028 expref: 195 pid: 29627 timeout: 1133 lvb_type: 0 00010000:00010000:2.0:1763334968.495800:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:2.0:1763334968.495807:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334968.495816:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334968.495823:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334968.495902:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2359:x1848989694523136:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 196us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334968.495910:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2571 00000100:00100000:2.0:1763334968.502334:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.502490:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694523264 00000100:00100000:0.0:1763334968.502503:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694523264 00010000:00010000:0.0:1763334968.502621:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afff7 expref: 194 pid: 32232 timeout: 1133 lvb_type: 0 00000100:00100000:0.0:1763334968.502676:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2572 00000100:00100000:0.0:1763334968.502689:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2359:x1848989694523264:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334968.502708:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334968.502715:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afff7 expref: 194 pid: 32232 timeout: 1133 lvb_type: 0 00010000:00010000:0.0:1763334968.502731:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afff7 expref: 194 pid: 32232 timeout: 1133 lvb_type: 0 00010000:00010000:0.0:1763334968.502759:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849bcdf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833afff7 expref: 194 pid: 32232 timeout: 1133 lvb_type: 0 00010000:00010000:0.0:1763334968.502777:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:0.0:1763334968.502783:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334968.502795:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334968.502802:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334968.502831:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334968.502899:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2359:x1848989694523264:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 211us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334968.502906:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2572 00010000:00010000:1.0:1763334968.503156:0:29631:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334968.503166:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000004:00020000:1.0:1763334968.505723:0:29631:0:(lod_lov.c:1523:lod_parse_striping()) lustre-MDT0000-mdtlov: can not set all stale mirrors for [0x200000404:0x1a8:0x0]: rc = -1 00010000:00010000:1.0:1763334968.505847:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334968.505862:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334968.505870:0:29631:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334968.505877:0:29631:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334968.505883:0:29631:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334968.505892:0:29631:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334968.505913:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:1.0:1763334968.505917:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1763334968.505923:0:29631:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334968.505930:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bd8e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334968.505943:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:1.0:1763334968.505947:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334968.505958:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849bd80 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b002f expref: 192 pid: 29627 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334968.506257:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53057:x1848989694523008:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 18140us (18393us total) trans 8589939033 rc -1/-1 00000100:00100000:1.0:1763334968.506269:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1772 00000100:00100000:2.0:1763334968.508792:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334968.509214:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694523392 00000100:00100000:0.0:1763334968.509230:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694523392 00000100:00100000:0.0:1763334968.509393:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4832 00000100:00100000:0.0:1763334968.509405:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53057:x1848989694523392:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334968.509434:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334968.509463:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bd95 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0036 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.509552:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bd95 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0036 expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.509611:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bd95 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0036 expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334968.509635:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:0.0:1763334968.509639:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334968.509643:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334968.509720:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53057:x1848989694523392:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 317us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334968.509728:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4832 00000100:00100000:0.0:1763334968.517037:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334968.517279:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694523648 00000100:00100000:1.0:1763334968.517429:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694523648 00000100:00100000:1.0:1763334968.518364:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1773 00000100:00100000:1.0:1763334968.518383:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c376ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53057:x1848989694523648:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334968.518773:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c376ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53057:x1848989694523648:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 395us (1753us total) trans 8589939034 rc 0/0 00000100:00100000:1.0:1763334968.518783:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1773 00010000:00010000:0.0:1763334969.190151:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334969.938159:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334969.938222:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334969.938248:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334969.938273:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334969.938303:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694523904 00000100:00100000:0.0:1763334969.938313:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694523904 00000100:00100000:0.0:1763334969.938366:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 141 00000100:00100000:0.0:1763334969.938376:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2359:x1848989694523904:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1763334969.938472:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2359:x1848989694523904:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 97us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334969.938480:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 141 00000100:00100000:0.0:1763334969.938505:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694524032 00000100:00100000:0.0:1763334969.938508:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694524032 00000100:00100000:0.0:1763334969.938531:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694524160 00000100:00100000:0.0:1763334969.938534:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694524160 00000100:00100000:0.0:1763334969.938551:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 476 00000100:00100000:0.0:1763334969.938556:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694524032:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1763334969.938603:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6453100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694524032:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 45us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334969.938609:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 476 00000100:00100000:0.0:1763334969.938620:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 477 00000100:00100000:0.0:1763334969.938626:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694524160:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1763334969.938650:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694524160:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 24us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334969.938657:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 477 00000100:00100000:2.0:1763334969.939990:0:29623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694523776 00000100:00100000:2.0:1763334969.940004:0:29623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694523776 00000100:00100000:2.0:1763334969.940061:0:29623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 138 00000100:00100000:2.0:1763334969.940071:0:29623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01e7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1264d40-158f-4e44-9f7a-49909c525321+9:2359:x1848989694523776:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1763334969.940133:0:29623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01e7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1264d40-158f-4e44-9f7a-49909c525321+9:2359:x1848989694523776:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 65us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334969.940141:0:29623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 138 00000100:00100000:2.0:1763334970.088174:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701855360:0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.088248:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334970.088307:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1763334970.088314:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:53c3ae04-da5d-4a5f-b9b8-469954a64a68:3291:1848989701854976:0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.088352:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334970.088377:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701855488:0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.088400:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334970.088426:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1848989701855232:0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.088453:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334970.088473:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1763334970.088478:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aef0a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1848989701855104:0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.088501:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334970.088514:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1848989701855616:0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.088532:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334970.088559:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701855360 00000100:00100000:2.0:1763334970.088567:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701855360 00000100:00100000:2.0:1763334970.088644:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701855488 00000100:00100000:2.0:1763334970.088648:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701855488 00000100:00100000:2.0:1763334970.088670:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1763334970.088680:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3291:x1848989701855360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.088729:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+27:3291:x1848989701855360:12345-0@lo:400:kworker.0 Request processed in 51us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334970.088736:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1763334970.088752:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1763334970.088759:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701855488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.088787:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701855488:12345-0@lo:400:kworker.0 Request processed in 29us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334970.088792:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:2.0:1763334970.088810:0:29624:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701854976 00000100:00100000:2.0:1763334970.088813:0:29624:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701854976 00000100:00100000:2.0:1763334970.088837:0:29624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1763334970.088844:0:29624:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01e7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:53c3ae04-da5d-4a5f-b9b8-469954a64a68+18:3291:x1848989701854976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.088872:0:29624:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01e7e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:53c3ae04-da5d-4a5f-b9b8-469954a64a68+18:3291:x1848989701854976:12345-0@lo:400:kworker.0 Request processed in 28us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334970.088878:0:29624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1763334970.088909:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701855232 00000100:00100000:2.0:1763334970.088912:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701855232 00000100:00100000:2.0:1763334970.088935:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701855104 00000100:00100000:2.0:1763334970.088938:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701855104 00000100:00100000:2.0:1763334970.088954:0:29627:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701855616 00000100:00100000:2.0:1763334970.088956:0:29627:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701855616 00000100:00100000:2.0:1763334970.088969:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1763334970.088974:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1848989701855232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.089007:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1848989701855232:12345-0@lo:400:kworker.0 Request processed in 33us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334970.089013:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1763334970.089024:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1763334970.089029:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1848989701855104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.089053:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1848989701855104:12345-0@lo:400:kworker.0 Request processed in 24us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334970.089057:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1763334970.089067:0:29627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1763334970.089071:0:29627:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1848989701855616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.089093:0:29627:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1848989701855616:12345-0@lo:400:kworker.0 Request processed in 22us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334970.089098:0:29627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1763334970.089115:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1763334970.089119:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1763334970.089121:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763334970.089162:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1848989701855104:0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.089185:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1848989701855616:0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.089194:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1848989701855232:0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.089224:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aef0a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:53c3ae04-da5d-4a5f-b9b8-469954a64a68:3291:1848989701854976:0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.089234:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701855488:0@lo:400:kworker.0 00000100:00100000:2.0:1763334970.089243:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701855360:0@lo:400:kworker.0 00000004:00080000:1.0:1763334970.089394:0:29653:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1034722821108ns, next at 1035722819118ns, rc = 0 00000004:00080000:3.0:1763334970.092656:0:29651:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1034726081474ns, next at 1035726079237ns, rc = 0 00000100:00100000:3.0:1763334970.092684:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334970.092709:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701855872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1763334970.092801:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334970.092843:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763334970.092853:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701855744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1763334970.092881:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334970.092934:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701855872 00000100:00100000:3.0:1763334970.092944:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701855872 00000100:00100000:3.0:1763334970.093000:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701855744 00000100:00100000:3.0:1763334970.093003:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701855744 00000100:00100000:3.0:1763334970.093021:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1763334970.093030:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aefa5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+27:3292:x1848989701855872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1763334970.093072:0:6520:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 47382528 pending 1703936 free 3856662528 avail 3854565376 00000100:00100000:3.0:1763334970.093123:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aefa5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+27:3292:x1848989701855872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334970.093131:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1763334970.093396:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1763334970.093403:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701855744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1763334970.093422:0:6520:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 59179008 pending 0 free 3856662528 avail 3854565376 00000100:00100000:3.0:1763334970.093452:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701855744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334970.093458:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1763334970.093509:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701855872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1763334970.093541:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701855744:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1763334970.216638:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334971.238767:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334972.263896:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1763334972.754950:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838409 is committed 00000001:00080000:0.0:1763334972.754994:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838415 is committed 00000001:00080000:0.0:1763334972.754999:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838411 is committed 00000001:00080000:0.0:1763334972.755020:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838414 is committed 00000001:00080000:0.0:1763334973.249179:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871128 is committed 00000001:00080000:0.0:1763334973.249209:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871127 is committed 00000001:00080000:0.0:1763334973.249218:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871134 is committed 00000001:00080000:0.0:1763334973.249224:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871130 is committed 00000001:00080000:0.0:1763334973.249231:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871133 is committed 00010000:00010000:0.0:1763334973.286446:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334973.612160:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334973.612254:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694524416 00000100:00100000:1.0:1763334973.612269:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694524416 00000100:00100000:1.0:1763334973.612371:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4833 00000100:00100000:1.0:1763334973.612385:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53480:x1848989694524416:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:1.0:1763334973.612462:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1763334973.612499:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bd95 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1a8:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0036 expref: 194 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.612524:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bd3a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1a8:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b000c expref: 193 pid: 29627 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.612538:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:1.0:1763334973.612553:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334973.612612:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bd9c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.612628:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bd9c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.612641:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bd9c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.612660:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bda3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.612667:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bda3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.612674:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bda3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.612847:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdaa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.612856:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.612864:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00080000:2.0:1763334973.613178:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1763334973.613786:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1132, 64 off96712 00000004:00080000:1.0:1763334973.613798:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1038247225614ns, next at 1039247222883ns, rc = 0 00000040:00080000:1.0:1763334973.613821:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1143, 64 off97800 00000004:00080000:1.0:1763334973.613825:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1038247253053ns, next at 1039247252216ns, rc = 0 00000040:00080000:1.0:1763334973.613837:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1144, 64 off97864 00000040:00080000:1.0:1763334973.613849:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1133, 64 off96776 00010000:00010000:1.0:1763334973.613932:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bdb1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.613945:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bdb1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.613955:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bdb1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.613964:0:30972:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bdb1 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.613970:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bdb1 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.613977:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bdb1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.613995:0:30972:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334973.614022:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.614028:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdaa lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.615170:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdaa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.615180:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334973.615186:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdaa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.615197:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdaa lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.615217:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:1.0:1763334973.615222:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1763334973.615227:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdaa lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.615235:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdaa lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1a8:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.615505:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bd9c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.615514:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bd9c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.615519:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bd9c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.615525:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334973.615528:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bd9c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.615535:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bd9c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.615545:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0x0 (ffff9a5ac511cd00) 00010000:00010000:1.0:1763334973.615548:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334973.615551:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bd9c lrc: 2/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334973.615558:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bd9c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:1.0:1763334973.615590:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b19f9747 reply state 000000002a48b6ea transno 8589939035 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bda3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334973.615603:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334973.615739:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53480:x1848989694524416:12345-192.168.201.60@tcp:36:rm.0 Request processed in 3351us (3586us total) trans 8589939035 rc 0/0 00000100:00100000:1.0:1763334973.615750:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4833 00010000:00010000:2.0:1763334973.617242:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334973.617258:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bdb1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334973.617270:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334973.617274:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bdb1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334973.617285:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bdb1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334973.617310:0:5737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1a8:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:2.0:1763334973.617313:0:5737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763334973.617318:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bdb1 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334973.617323:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bdb1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1a8:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334973.617347:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334973.617349:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334973.617351:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334973.622150:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bda3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334973.622177:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bda3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334973.622186:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bda3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334973.622193:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334973.622201:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bda3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334973.622210:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bda3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334973.622233:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x5c:0x0].0xcca0c426 (ffff9a5ad28fac00) 00010000:00010000:3.0:1763334973.622238:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334973.622244:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bda3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334973.622251:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bda3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x5c:0x0].0xcca0c426 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000001:00080000:0.0:1763334973.712118:0:32263:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939035 is committed 00000004:00080000:0.0:1763334973.712139:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 755 committed 00000004:00080000:0.0:1763334973.712156:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 743 committed 00000004:00080000:0.0:1763334973.712172:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 754 committed 00000004:00080000:0.0:1763334973.712198:0:32263:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 742 committed 00000100:00100000:3.0:1763334973.712642:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeecebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701856000:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334973.712733:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334973.712831:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeeceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701856128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334973.712863:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334973.712881:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763334973.712887:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701856256:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334973.712908:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334973.713047:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701856000 00000100:00100000:1.0:1763334973.713057:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701856000 00000100:00100000:2.0:1763334973.713287:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763334973.713298:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701856640:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334973.713336:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334973.713371:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701856128 00000100:00100000:2.0:1763334973.713375:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701856128 00000100:00100000:2.0:1763334973.713420:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701856256 00000100:00100000:2.0:1763334973.713423:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701856256 00000100:00100000:2.0:1763334973.713440:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701856640 00000100:00100000:2.0:1763334973.713442:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701856640 00000100:00100000:1.0:1763334973.713770:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4892 00000100:00100000:1.0:1763334973.713781:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3289:x1848989701856128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763334973.713816:0:32239:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:577 count 1 00010000:00010000:1.0:1763334973.713850:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.713877:0:32239:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affe2 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.713887:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334973.713889:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334973.713895:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.713927:0:32239:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affe2 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.713944:0:32239:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affe2 expref: 11 pid: 6517 timeout: 1138 lvb_type: 0 00000100:00100000:1.0:1763334973.713958:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeecea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701856768:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334973.714037:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac8393e40 going to sleep for 11 seconds 00000100:00100000:3.0:1763334973.714140:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4893 00000100:00100000:3.0:1763334973.714152:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3289:x1848989701856256:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1763334973.714277:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1763334973.714284:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1763334973.714434:0:32241:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:580 count 1 00010000:00010000:3.0:1763334973.714449:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.714461:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bd41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0013 expref: 11 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.714472:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334973.714474:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334973.714477:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.714495:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bd41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0013 expref: 11 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.714503:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bd41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0013 expref: 11 pid: 26564 timeout: 1138 lvb_type: 0 00000100:00100000:3.0:1763334973.714511:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701856896:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334973.714553:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c96ee600 going to sleep for 11 seconds 00000100:00100000:1.0:1763334973.715539:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4894 00000100:00100000:1.0:1763334973.715557:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3292:x1848989701856000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1763334973.715605:0:6519:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:576 count 1 00010000:00010000:1.0:1763334973.715628:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.715646:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bb88 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff87 expref: 11 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334973.715653:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334973.715655:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334973.715658:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.715686:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bb88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff87 expref: 11 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334973.715697:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bb88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff87 expref: 11 pid: 32241 timeout: 1138 lvb_type: 1 00000100:00100000:1.0:1763334973.715709:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701857024:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334973.715765:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac8393a80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334973.716212:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701856384:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334973.716261:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334973.716482:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763334973.716489:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701856512:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334973.716515:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334973.716986:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701856384 00000100:00100000:2.0:1763334973.716987:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701856512 00000100:00100000:2.0:1763334973.716997:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701856512 00000100:00100000:0.0:1763334973.716998:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701856384 00000100:00100000:0.0:1763334973.717046:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4895 00000100:00100000:2.0:1763334973.717055:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4896 00000100:00100000:0.0:1763334973.717060:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3290:x1848989701856640:12345-0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334973.717068:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3291:x1848989701856384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1763334973.717088:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:584 count 1 00002000:00080000:2.0:1763334973.717089:0:6518:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:580 count 1 00010000:00010000:2.0:1763334973.717128:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334973.717128:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334973.717158:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bd4f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0021 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.717160:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ba46 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff1e expref: 19 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334973.717179:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334973.717182:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334973.717187:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.717193:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334973.717197:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334973.717201:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334973.717224:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bd4f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0021 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.717229:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ba46 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff1e expref: 19 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334973.717242:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bd4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0021 expref: 19 pid: 6518 timeout: 1138 lvb_type: 0 00010000:00010000:2.0:1763334973.717246:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ba46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff1e expref: 19 pid: 32241 timeout: 1138 lvb_type: 0 00000100:00100000:0.0:1763334973.717269:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701857152:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334973.717271:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701857280:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334973.717338:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c9888cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334973.717338:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530300 going to sleep for 11 seconds 00000100:00100000:2.0:1763334973.717362:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4897 00000100:00100000:2.0:1763334973.717369:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+7:3291:x1848989701856512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1763334973.717382:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:581 count 1 00010000:00010000:2.0:1763334973.717394:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.717405:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849bc76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affd4 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.717412:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334973.717414:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334973.717417:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.717438:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849bc76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affd4 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.717447:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849bc76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affd4 expref: 19 pid: 6519 timeout: 1138 lvb_type: 0 00000100:00100000:2.0:1763334973.717455:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701857408:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334973.717475:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c9888c00 going to sleep for 11 seconds 00000100:00100000:0.0:1763334973.724875:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334973.726200:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeecea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701856768:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334973.726231:0:32239:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334973.726922:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694524544 00000100:00100000:2.0:1763334973.726933:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694524544 00010000:00010000:2.0:1763334973.727004:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affe2 expref: 12 pid: 6517 timeout: 1138 lvb_type: 0 00000100:00100000:2.0:1763334973.727047:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2573 00000100:00100000:2.0:1763334973.727059:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2362:x1848989694524544:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334973.727078:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334973.727083:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affe2 expref: 12 pid: 6517 timeout: 1138 lvb_type: 0 00010000:00010000:2.0:1763334973.727097:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affe2 expref: 12 pid: 6517 timeout: 1138 lvb_type: 0 00010000:00010000:2.0:1763334973.727135:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bc8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x241:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affe2 expref: 12 pid: 6517 timeout: 1138 lvb_type: 0 00010000:00010000:2.0:1763334973.727156:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334973.727158:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334973.727162:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.727172:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.727197:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334973.727250:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+11:2362:x1848989694524544:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 193us (2391us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334973.727258:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2573 00010000:00010000:2.0:1763334973.727287:0:32239:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.727295:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.727304:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.727312:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.727332:0:32239:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334973.727703:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701856128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13924us (14838us total) trans 21474838416 rc 0/0 00000100:00100000:2.0:1763334973.727713:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4892 00010000:00010000:2.0:1763334973.727734:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334973.727740:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.727748:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334973.727752:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.727760:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.727774:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.727782:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bdb8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.727798:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334973.727800:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334973.727801:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334973.727829:0:3289:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838414 gen 2 00000004:00080000:2.0:1763334973.727835:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1ff480, transno 21474838387 00000004:00080000:2.0:1763334973.727845:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fe300, transno 21474838388 00000004:00080000:2.0:1763334973.727848:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fc700, transno 21474838389 00000004:00080000:2.0:1763334973.727850:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afb1fdc00, transno 21474838390 00000004:00080000:2.0:1763334973.727852:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa767b80, transno 21474838392 00000004:00080000:2.0:1763334973.727855:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa766680, transno 21474838393 00000004:00080000:2.0:1763334973.727859:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8eb100, transno 21474838394 00000004:00080000:2.0:1763334973.727861:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b4000, transno 21474838395 00000004:00080000:2.0:1763334973.727864:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca871880, transno 21474838396 00000004:00080000:2.0:1763334973.727866:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af68cfb80, transno 21474838397 00000004:00080000:2.0:1763334973.727868:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8e8000, transno 21474838398 00000004:00080000:2.0:1763334973.727871:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afc8ead80, transno 21474838399 00000004:00080000:2.0:1763334973.727873:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a20a80, transno 21474838402 00000004:00080000:2.0:1763334973.727876:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a21500, transno 21474838403 00000004:00080000:2.0:1763334973.727878:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9831880, transno 21474838404 00000004:00080000:2.0:1763334973.727881:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9830e00, transno 21474838405 00000004:00080000:2.0:1763334973.727883:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b4e00, transno 21474838409 00000004:00080000:2.0:1763334973.727885:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b7480, transno 21474838410 00000004:00080000:2.0:1763334973.727888:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b4380, transno 21474838411 00000004:00080000:2.0:1763334973.727890:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeef9ed80, transno 21474838412 00000004:00080000:2.0:1763334973.727892:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5f9500, transno 21474838413 00000004:00080000:2.0:1763334973.727894:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5fb480, transno 21474838414 00000100:00100000:2.0:1763334973.727902:0:3289:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5aeeceb100 x1848989701856128/t21474838416(21474838416) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763334989 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763334973.727913:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeeceb100/2, rc 0, transno 21474838416 00000100:00100000:2.0:1763334973.727918:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeeceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701856128:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1763334973.728134:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 1 changes, 3 in progress, 2 in flight, 22 done 00000100:00100000:1.0:1763334973.728706:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334973.728752:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334973.728810:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701857024:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334973.728833:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00080000:1.0:1763334973.728944:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763334973.729134:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ec000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701856896:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334973.729150:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334973.729231:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334973.729287:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334973.729304:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334973.729328:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694524672 00000100:00100000:1.0:1763334973.729334:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694524672 00010000:00010000:1.0:1763334973.729365:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bd41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0013 expref: 11 pid: 26564 timeout: 1138 lvb_type: 0 00000100:00100000:1.0:1763334973.729384:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694524800 00000100:00100000:1.0:1763334973.729387:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694524800 00010000:00010000:1.0:1763334973.729399:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bb88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff87 expref: 12 pid: 32241 timeout: 1138 lvb_type: 1 00000100:00100000:1.0:1763334973.729409:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694524928 00000100:00100000:1.0:1763334973.729412:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694524928 00010000:00010000:1.0:1763334973.729435:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bd4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0021 expref: 20 pid: 6518 timeout: 1138 lvb_type: 0 00000100:00100000:1.0:1763334973.729445:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694525184 00000100:00100000:1.0:1763334973.729448:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694525184 00010000:00010000:1.0:1763334973.729458:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849bc76 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affd4 expref: 21 pid: 6519 timeout: 1138 lvb_type: 0 00000100:00100000:1.0:1763334973.729468:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694525056 00000100:00100000:1.0:1763334973.729471:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694525056 00010000:00010000:1.0:1763334973.729482:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ba46 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff1e expref: 22 pid: 32241 timeout: 1138 lvb_type: 0 00000100:00100000:1.0:1763334973.729495:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2574 00000100:00100000:1.0:1763334973.729503:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2362:x1848989694524672:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334973.729515:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334973.729520:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bd41 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0013 expref: 12 pid: 26564 timeout: 1138 lvb_type: 0 00010000:00010000:1.0:1763334973.729530:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bd41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0013 expref: 12 pid: 26564 timeout: 1138 lvb_type: 0 00010000:00010000:1.0:1763334973.729549:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849bd41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x244:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0013 expref: 12 pid: 26564 timeout: 1138 lvb_type: 0 00010000:00010000:1.0:1763334973.729562:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334973.729563:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334973.729568:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.729598:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.729617:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334973.729654:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+11:2362:x1848989694524672:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 151us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334973.729661:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2574 00000100:00100000:1.0:1763334973.729680:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2575 00000100:00100000:1.0:1763334973.729686:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+10:2360:x1848989694524800:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334973.729694:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334973.729698:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bb88 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff87 expref: 10 pid: 32241 timeout: 1138 lvb_type: 1 00010000:00010000:1.0:1763334973.729706:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bb88 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff87 expref: 10 pid: 32241 timeout: 1138 lvb_type: 1 00010000:00010000:1.0:1763334973.729718:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849bb88 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x240:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff87 expref: 10 pid: 32241 timeout: 1138 lvb_type: 1 00010000:00010000:1.0:1763334973.729726:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334973.729727:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334973.729730:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.729737:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.729752:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334973.729770:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+9:2360:x1848989694524800:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 85us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334973.729776:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2575 00000100:00100000:1.0:1763334973.729790:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2576 00000100:00100000:1.0:1763334973.729796:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694524928:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334973.729805:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334973.729810:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bd4f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0021 expref: 22 pid: 6518 timeout: 1138 lvb_type: 0 00010000:00010000:1.0:1763334973.729825:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bd4f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0021 expref: 22 pid: 6518 timeout: 1138 lvb_type: 0 00010000:00010000:1.0:1763334973.729839:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334973.729841:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334973.729844:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.729852:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.729864:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334973.729892:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701857408:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334973.729912:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334973.729926:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2577 00000100:00100000:3.0:1763334973.729938:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694525184:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763334973.729944:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2578 00010000:00010000:3.0:1763334973.729952:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1763334973.729959:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694525056:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334973.729960:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849bc76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affd4 expref: 22 pid: 6519 timeout: 1138 lvb_type: 0 00010000:00010000:2.0:1763334973.729973:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334973.729975:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849bc76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affd4 expref: 22 pid: 6519 timeout: 1138 lvb_type: 0 00010000:00010000:2.0:1763334973.729983:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ba46 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff1e expref: 22 pid: 32241 timeout: 1138 lvb_type: 0 00010000:00010000:3.0:1763334973.729994:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849bc76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833affd4 expref: 22 pid: 6519 timeout: 1138 lvb_type: 0 00010000:00010000:2.0:1763334973.730000:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ba46 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff1e expref: 22 pid: 32241 timeout: 1138 lvb_type: 0 00010000:00010000:3.0:1763334973.730007:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334973.730010:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334973.730014:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.730019:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334973.730022:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.730024:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334973.730029:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.730039:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.730045:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334973.730057:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334973.731440:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694524928:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1637us (2201us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334973.731451:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2576 00010000:00010000:1.0:1763334973.731524:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.731535:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.731544:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.731551:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334973.731656:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694525184:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1721us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334973.731663:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2577 00010000:00010000:3.0:1763334973.731688:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.731695:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.731708:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.731714:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334973.731760:0:6519:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:2.0:1763334973.731815:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694525056:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1858us (2506us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334973.731825:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2578 00010000:00010000:2.0:1763334973.731854:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.731863:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.731872:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.731887:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334973.731963:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bd4f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0021 expref: 18 pid: 6518 timeout: 1138 lvb_type: 0 00000100:00100000:0.0:1763334973.731978:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701857152:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334973.731994:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334973.732001:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334973.732007:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334973.732013:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334973.732020:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334973.733430:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3292:x1848989701856000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 17876us (20692us total) trans 21474838417 rc 0/0 00000100:00100000:1.0:1763334973.733441:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4894 00000100:00080000:1.0:1763334973.733474:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1763334973.733608:0:32241:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1763334973.733773:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00000100:00100000:3.0:1763334973.733807:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701856256:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19657us (20895us total) trans 21474838418 rc 0/0 00000100:00100000:3.0:1763334973.733815:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4893 00010000:00010000:3.0:1763334973.733841:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1763334973.733850:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.733860:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334973.733866:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.733875:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.733898:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.733907:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bdc6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.733931:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1763334973.733935:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.733941:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334973.733944:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.733952:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.733961:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.733969:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.733981:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1763334973.733985:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.733992:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334973.733994:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.734001:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.734012:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.734018:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849bddb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.734031:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334973.734035:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.734041:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334973.734044:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.734051:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.734059:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334973.734066:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334973.734068:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334973.734070:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334973.734119:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeecebb80/2, rc 0, transno 21474838417 00000100:00100000:3.0:1763334973.734133:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeecebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701856000:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1763334973.734201:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334973.734215:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701856512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16844us (17697us total) trans 17179871135 rc 0/0 00000100:00100000:2.0:1763334973.734222:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4897 00010000:00010000:2.0:1763334973.734731:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334973.734735:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1763334973.734743:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849bdcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000004:00080000:2.0:1763334973.734758:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeece9c00/2, rc 0, transno 21474838418 00000100:00100000:2.0:1763334973.734766:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701856256:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1763334973.734811:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ba46 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833aff1e expref: 17 pid: 32241 timeout: 1138 lvb_type: 0 00000100:00100000:2.0:1763334973.734825:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701857280:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334973.734843:0:6518:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.734853:0:6518:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.734860:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.734868:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.734882:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.734897:0:6518:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334973.734975:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb346c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3290:x1848989701856640:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17918us (21636us total) trans 17179871136 rc 0/0 00000100:00100000:0.0:1763334973.734983:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4895 00000100:00100000:2.0:1763334973.735089:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701856384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18024us (18826us total) trans 17179871137 rc 0/0 00000100:00100000:2.0:1763334973.735097:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4896 00010000:00010000:2.0:1763334973.735132:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334973.735138:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.735145:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334973.735149:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.735156:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.735169:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.735175:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bdd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x244:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334973.735188:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334973.735190:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334973.735192:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334973.735250:0:3291:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871133 gen 2 00000004:00080000:3.0:1763334973.735257:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac8419180, transno 17179871128 00000004:00080000:3.0:1763334973.735273:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a81180, transno 17179871129 00000004:00080000:3.0:1763334973.735277:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841a680, transno 17179871130 00000004:00080000:3.0:1763334973.735282:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9833b80, transno 17179871131 00000004:00080000:3.0:1763334973.735286:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa7ec380, transno 17179871132 00000004:00080000:3.0:1763334973.735289:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa7ee300, transno 17179871133 00000100:00100000:3.0:1763334973.735296:0:3291:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5afa5af800 x1848989701856512/t17179871135(17179871135) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763334989 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763334973.735312:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa5af800/2, rc 0, transno 17179871135 00000004:00080000:2.0:1763334973.735315:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ae8d4f800/2, rc 0, transno 17179871136 00000100:00100000:3.0:1763334973.735318:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701856512:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1763334973.735324:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701856640:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1763334973.735341:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa5adc00/2, rc 0, transno 17179871137 00000100:00100000:3.0:1763334973.735347:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701856384:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1763334973.735400:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334973.735562:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 3 in progress, 0 in flight, 6 done 00010000:00010000:1.0:1763334974.309767:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334975.061262:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.061307:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.061338:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.061365:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.061396:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694525696 00000100:00100000:1.0:1763334975.061406:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694525696 00000100:00100000:1.0:1763334975.061462:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694525568 00000100:00100000:1.0:1763334975.061466:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694525568 00000100:00100000:1.0:1763334975.061491:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 480 00000100:00100000:1.0:1763334975.061503:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2361:x1848989694525696:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1763334975.061606:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2361:x1848989694525696:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 106us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334975.061615:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 480 00000100:00100000:1.0:1763334975.061634:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 481 00000100:00100000:1.0:1763334975.061641:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+9:2361:x1848989694525568:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1763334975.061679:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+9:2361:x1848989694525568:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 38us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334975.061689:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 481 00000100:00100000:1.0:1763334975.061709:0:29623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694525312 00000100:00100000:1.0:1763334975.061713:0:29623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694525312 00000100:00100000:1.0:1763334975.061739:0:29623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 140 00000100:00100000:1.0:1763334975.061746:0:29623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1264d40-158f-4e44-9f7a-49909c525321+9:2361:x1848989694525312:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1763334975.061771:0:29623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9bfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1264d40-158f-4e44-9f7a-49909c525321+9:2361:x1848989694525312:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 25us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334975.061778:0:29623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 140 00000100:00080000:1.0:1763334975.061805:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1763334975.061809:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763334975.064170:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694525440 00000100:00100000:3.0:1763334975.064186:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694525440 00000100:00100000:3.0:1763334975.064263:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 145 00000100:00100000:3.0:1763334975.064274:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2361:x1848989694525440:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1763334975.064369:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2361:x1848989694525440:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 97us (3115us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334975.064377:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 145 00000100:00080000:3.0:1763334975.064399:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1763334975.205912:0:29651:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1039839337243ns, next at 1040839334561ns, rc = 0 00000100:00100000:0.0:1763334975.205935:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763334975.205960:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701857536:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1763334975.206030:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763334975.206582:0:29653:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1039839995752ns, next at 1040839994511ns, rc = 0 00000100:00100000:1.0:1763334975.206614:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeeceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701857664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1763334975.206644:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334975.206687:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701857536 00000100:00100000:1.0:1763334975.206694:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701857536 00000100:00100000:1.0:1763334975.206738:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701857664 00000100:00100000:1.0:1763334975.206741:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701857664 00000100:00100000:1.0:1763334975.206759:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1763334975.206767:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701857536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1763334975.206800:0:6520:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 45678592 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1763334975.206844:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701857536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334975.206851:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1763334975.206866:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1763334975.206872:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701857664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1763334975.206893:0:6520:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 59179008 pending 0 free 3856662528 avail 3854565376 00000100:00100000:1.0:1763334975.206921:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701857664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334975.206927:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00080000:1.0:1763334975.206944:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1763334975.206948:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1763334975.206979:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeeceb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701857664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1763334975.207118:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:53c3ae04-da5d-4a5f-b9b8-469954a64a68:3292:1848989701857792:0@lo:400:kworker.0 00000100:00100000:2.0:1763334975.207151:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334975.207187:0:29624:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701857792 00000100:00100000:2.0:1763334975.207191:0:29624:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701857792 00000100:00100000:2.0:1763334975.207217:0:29624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1763334975.207223:0:29624:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:53c3ae04-da5d-4a5f-b9b8-469954a64a68+18:3292:x1848989701857792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334975.207254:0:29624:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9bffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:53c3ae04-da5d-4a5f-b9b8-469954a64a68+18:3292:x1848989701857792:12345-0@lo:400:kworker.0 Request processed in 31us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334975.207260:0:29624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1763334975.207308:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:53c3ae04-da5d-4a5f-b9b8-469954a64a68:3292:1848989701857792:0@lo:400:kworker.0 00000100:00100000:2.0:1763334975.207335:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763334975.207342:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1848989701857920:0@lo:400:kworker.0 00000100:00100000:2.0:1763334975.207370:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334975.207395:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701857920 00000100:00100000:2.0:1763334975.207399:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701857920 00000100:00100000:2.0:1763334975.207438:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1763334975.207445:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1848989701857920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334975.207479:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1848989701857920:12345-0@lo:400:kworker.0 Request processed in 35us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334975.207486:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1763334975.207502:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1763334975.207518:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1848989701857920:0@lo:400:kworker.0 00000100:00100000:2.0:1763334975.207547:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1848989701858048:0@lo:400:kworker.0 00000100:00100000:2.0:1763334975.207568:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334975.207608:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701858048 00000100:00100000:2.0:1763334975.207612:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701858048 00000100:00100000:2.0:1763334975.207636:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1763334975.207641:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1848989701858048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334975.207675:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1848989701858048:12345-0@lo:400:kworker.0 Request processed in 33us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334975.207680:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1763334975.207694:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1763334975.207711:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3290:1848989701858048:0@lo:400:kworker.0 00000100:00100000:2.0:1763334975.207736:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763334975.207741:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae8d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1848989701858176:0@lo:400:kworker.0 00000100:00100000:2.0:1763334975.207763:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334975.207782:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701858176 00000100:00100000:2.0:1763334975.207785:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701858176 00000100:00100000:2.0:1763334975.207806:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1763334975.207811:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1848989701858176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334975.207840:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1848989701858176:12345-0@lo:400:kworker.0 Request processed in 29us (77us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334975.207846:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1763334975.207868:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae8d4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1848989701858176:0@lo:400:kworker.0 00000100:00100000:0.0:1763334975.208305:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701857536:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1763334975.334752:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1763334975.346212:0:32471:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-flr test 70a: flr mode fsx test ================ 18:16:14 (1763334974) 00000100:00100000:0.0:1763334975.451513:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.452206:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694525824 00000100:00100000:2.0:1763334975.452226:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694525824 00000100:00100000:2.0:1763334975.452314:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4834 00000100:00100000:2.0:1763334975.452328:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2359:x1848989694525824:12345-192.168.201.60@tcp:41:mkdir.0 00000004:00000024:2.0:1763334975.452419:0:30972:0:(mdt_handler.c:543:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2259681280 avail 2257584128 00000100:00100000:2.0:1763334975.452544:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+184:2359:x1848989694525824:12345-192.168.201.60@tcp:41:mkdir.0 Request processed in 219us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334975.452552:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4834 00000100:00100000:3.0:1763334975.456733:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.456888:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694526080 00000100:00100000:0.0:1763334975.456900:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694526080 00000100:00100000:0.0:1763334975.456965:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4835 00000100:00100000:0.0:1763334975.456975:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53638:x1848989694526080:12345-192.168.201.60@tcp:36:mkdir.0 00010000:00010000:0.0:1763334975.457049:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334975.457099:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac0031200/0xcedf0054f8484ecb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833a8b4a expref: 184 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334975.457124:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a5ac71b4b00) 00010000:00010000:0.0:1763334975.457135:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334975.457283:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bde2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.457301:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bde2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.457310:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bde2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.457326:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bde9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.457333:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bde9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.457339:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bde9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334975.458449:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1aa:0x0]: returning size 512 00010000:00010000:0.0:1763334975.458479:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bde2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.458503:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bde2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.458510:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bde2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.458516:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334975.458520:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bde2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.458537:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bde2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.458552:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334975.458567:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334975.458636:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bde2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.458643:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849bde2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:0.0:1763334975.458681:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008b271fc8 reply state 0000000065c3575e transno 8589939036 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bde9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334975.458701:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334975.458866:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53638:x1848989694526080:12345-192.168.201.60@tcp:36:mkdir.0 Request processed in 1888us (2145us total) trans 8589939036 rc 0/0 00000100:00100000:0.0:1763334975.458876:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4835 00010000:00010000:0.0:1763334975.463357:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bde9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.463374:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bde9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.463382:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bde9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.463387:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334975.463392:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bde9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.463398:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bde9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.463413:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff9a5ac7d60900) 00010000:00010000:0.0:1763334975.463415:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334975.463419:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bde9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.463424:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849bde9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334975.513919:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.514035:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694526208 00000100:00100000:2.0:1763334975.514051:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694526208 00000100:00100000:2.0:1763334975.514143:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4836 00000100:00100000:2.0:1763334975.514156:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+184:53642:x1848989694526208:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334975.514189:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334975.514222:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bdf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b003d expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.514307:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431800/0xcedf0054f849bdf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.514324:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431800/0xcedf0054f849bdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.514338:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431800/0xcedf0054f849bdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334975.514418:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:2.0:1763334975.514422:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 31 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334975.514452:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431800/0xcedf0054f849bdf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.514480:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bdf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b003d expref: 186 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.514501:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431800/0xcedf0054f849bdf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b003d expref: 185 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.514512:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a5ac6cab600) 00010000:00010000:2.0:1763334975.514516:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334975.514520:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431800, rc 0) 00000100:00100000:2.0:1763334975.514622:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53642:x1848989694526208:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 469us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334975.514630:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4836 00000100:00100000:2.0:1763334975.520796:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334975.520886:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694526336 00000100:00100000:3.0:1763334975.520900:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694526336 00000100:00100000:3.0:1763334975.521122:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4837 00000100:00100000:3.0:1763334975.521136:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+185:53642:x1848989694526336:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334975.521165:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334975.521194:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0044 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334975.521380:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521399:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521412:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521431:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521439:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521445:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521758:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849be13 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521767:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849be13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521774:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849be13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334975.521810:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1aa:0x0]: returning size 512 00000004:00200000:3.0:1763334975.521814:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334975.521837:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849be13 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521851:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521858:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be05 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521866:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521871:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334975.521875:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521882:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521895:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9a5ac6cab600) 00010000:00010000:3.0:1763334975.521898:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334975.521903:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521908:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521917:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521923:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521927:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521936:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334975.521938:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521944:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521949:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x85409d3b (ffff9a5af66de800) 00010000:00010000:3.0:1763334975.521951:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334975.521953:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521957:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x85409d3b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334975.521987:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849bdfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0044 expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334975.522000:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066e00/0xcedf0054f849be13 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0044 expref: 186 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334975.522006:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:3.0:1763334975.522008:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1763334975.522010:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066e00, rc 0) 00000100:00100000:3.0:1763334975.522496:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53642:x1848989694526336:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1358us (1708us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334975.522507:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4837 00000100:00100000:3.0:1763334975.527149:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.527330:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694526464 00000100:00100000:1.0:1763334975.527343:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694526464 00000100:00100000:1.0:1763334975.527411:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4838 00000100:00100000:1.0:1763334975.527422:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53642:x1848989694526464:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334975.527446:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334975.527470:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849be1a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b004b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334975.527551:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be21 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527567:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be21 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527605:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be21 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527622:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be28 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527629:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527640:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527728:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be21 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527736:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be21 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527743:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be21 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527751:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334975.527756:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be21 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527764:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be21 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527778:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:1.0:1763334975.527782:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334975.527787:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be21 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527794:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be21 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527805:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be28 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527811:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be28 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527821:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527826:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334975.527829:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be28 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527835:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be28 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527842:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ad28fae00) 00010000:00010000:1.0:1763334975.527845:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334975.527847:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be28 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527853:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be28 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.527891:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849be1a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b004b expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334975.527902:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:1.0:1763334975.527905:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334975.527908:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849be1a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b004b expref: 187 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334975.527919:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334975.527997:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53642:x1848989694526464:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 577us (859us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334975.528006:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4838 00000100:00100000:1.0:1763334975.531313:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.532344:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694526592 00000100:00100000:2.0:1763334975.532363:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694526592 00000100:00100000:2.0:1763334975.532776:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4839 00000100:00100000:2.0:1763334975.532791:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53642:x1848989694526592:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334975.532817:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334975.533033:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849be2f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0052 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.533193:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849be36 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533212:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849be36 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533226:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849be36 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533244:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849be3d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533251:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849be3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533263:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849be3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533345:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849be36 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533813:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849be36 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533824:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849be36 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533831:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334975.533836:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849be36 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533844:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849be36 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533859:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334975.533863:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334975.533868:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849be36 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533874:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849be36 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533891:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849be3d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533897:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849be3d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533908:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849be3d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533913:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334975.533916:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849be3d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533921:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849be3d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533928:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac6cabe00) 00010000:00010000:2.0:1763334975.533931:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334975.533934:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849be3d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533940:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849be3d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.533992:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849be2f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0052 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.534004:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334975.534006:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334975.534010:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849be2f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0052 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.534019:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431000, rc 0) 00000100:00100000:2.0:1763334975.535061:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53642:x1848989694526592:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2264us (3753us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334975.535081:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4839 00000100:00100000:1.0:1763334975.546628:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.546731:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694526720 00000100:00100000:2.0:1763334975.546744:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694526720 00000100:00100000:2.0:1763334975.546808:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4840 00000100:00100000:2.0:1763334975.546820:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+186:53642:x1848989694526720:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334975.546849:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334975.546879:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849be44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0059 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.546980:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849be4b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.546997:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849be4b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.547010:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849be4b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334975.547098:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1aa:0x0]: returning size 512 00000004:00200000:2.0:1763334975.547103:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334975.547142:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849be4b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.547177:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849be44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0059 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.547197:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849be4b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0059 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.547207:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334975.547211:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1763334975.547215:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430600, rc 0) 00000100:00100000:2.0:1763334975.547298:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53642:x1848989694526720:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 479us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334975.547306:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4840 00000100:00100000:2.0:1763334975.550278:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.550418:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694526848 00000100:00100000:1.0:1763334975.550432:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694526848 00000100:00100000:1.0:1763334975.550498:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4841 00000100:00100000:1.0:1763334975.550511:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53642:x1848989694526848:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334975.550536:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334975.550561:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849be52 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0060 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334975.550672:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be59 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550690:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be59 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550702:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be59 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550717:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be60 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550723:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550728:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550800:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be59 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550806:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be59 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550817:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be59 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550823:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334975.550828:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be59 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550835:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be59 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550849:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:1.0:1763334975.550851:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334975.550856:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be59 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550862:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849be59 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550872:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be60 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550878:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be60 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550884:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550888:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334975.550890:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be60 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550895:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be60 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550902:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ad28fae00) 00010000:00010000:1.0:1763334975.550904:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334975.550907:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be60 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550912:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849be60 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.550948:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849be52 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0060 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334975.550960:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:1.0:1763334975.550962:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334975.550966:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849be52 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0060 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334975.550976:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334975.551057:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53642:x1848989694526848:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 550us (794us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334975.551064:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4841 00000100:00100000:2.0:1763334975.559345:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334975.559508:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694527104 00000100:00100000:3.0:1763334975.559523:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694527104 00000100:00100000:3.0:1763334975.559615:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4842 00000100:00100000:3.0:1763334975.559629:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53642:x1848989694527104:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334975.559657:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334975.559662:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1763334975.559699:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849be4b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0059 expref: 187 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334975.559720:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:3.0:1763334975.559726:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334975.559744:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849be67 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0067 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334975.559912:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be6e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.559929:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be6e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.559940:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be6e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.559954:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be75 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.559961:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be75 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.559966:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be75 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.561987:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849be7c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.562008:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849be7c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.562020:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849be7c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334975.562034:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 0 00010000:00010000:3.0:1763334975.562081:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be6e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.562089:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be6e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.562095:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be6e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.562102:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334975.562108:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be6e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.562116:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be6e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.562129:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:3.0:1763334975.562132:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334975.562138:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be6e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.562144:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849be6e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:3.0:1763334975.562156:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007acc2288 reply state 000000000b578c2f transno 8589939037 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be75 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334975.562171:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763334975.562217:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849be67 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0067 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334975.562231:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849be7c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0067 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334975.562239:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66dea00) 00010000:00010000:3.0:1763334975.562259:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334975.562263:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:3.0:1763334975.562366:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53642:x1848989694527104:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2740us (3037us total) trans 8589939037 rc 0/0 00000100:00100000:3.0:1763334975.562377:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4842 00000100:00100000:3.0:1763334975.569913:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334975.569957:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be75 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.569973:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be75 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.569982:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be75 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.569989:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334975.569995:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be75 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.570005:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be75 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.570032:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5af66de800) 00010000:00010000:3.0:1763334975.570037:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334975.570042:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be75 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.570049:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849be75 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334975.570108:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694527360 00000100:00100000:3.0:1763334975.570121:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694527360 00000100:00100000:3.0:1763334975.570258:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4843 00000100:00100000:3.0:1763334975.570269:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53642:x1848989694527360:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334975.570302:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334975.570328:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849be8a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b006e expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334975.570720:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.570740:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849be7c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0067 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334975.570752:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.570798:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849be7c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0067 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334975.570815:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849be7c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0067 expref: 189 pid: 32232 timeout: 1140 lvb_type: 0 00000100:00100000:3.0:1763334975.570839:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701858304:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334975.571758:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c96ee600 going to sleep for 11 seconds 00000100:00100000:3.0:1763334975.575986:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701858304:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334975.576031:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334975.586116:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.587384:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694527488 00000100:00100000:0.0:1763334975.587405:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694527488 00010000:00010000:0.0:1763334975.587475:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849be7c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0067 expref: 190 pid: 32232 timeout: 1140 lvb_type: 0 00000100:00100000:0.0:1763334975.587545:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2579 00000100:00100000:0.0:1763334975.587559:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:2360:x1848989694527488:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334975.587609:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334975.587618:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849be7c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0067 expref: 190 pid: 32232 timeout: 1140 lvb_type: 0 00010000:00010000:0.0:1763334975.587634:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849be7c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0067 expref: 190 pid: 32232 timeout: 1140 lvb_type: 0 00010000:00010000:0.0:1763334975.587666:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849be7c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0067 expref: 190 pid: 32232 timeout: 1140 lvb_type: 0 00010000:00010000:0.0:1763334975.587690:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66dea00) 00010000:00010000:0.0:1763334975.587696:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.587708:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.587716:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.587747:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334975.587841:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa766d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:2360:x1848989694527488:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 284us (1744us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334975.587853:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2579 00010000:00010000:3.0:1763334975.589730:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.589756:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334975.589790:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 0 00000004:00080000:3.0:1763334975.590259:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24a:0x0], index 1: 0 00000004:00080000:3.0:1763334975.590270:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x246:0x0], index 0: 0 00010000:00010000:3.0:1763334975.590462:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.590472:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.590481:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.590488:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334975.590493:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.590501:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.590526:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66dea00) 00010000:00010000:3.0:1763334975.590530:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334975.590535:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.590542:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849be91 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.590651:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849be8a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b006e expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334975.590665:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:3.0:1763334975.590667:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1763334975.590672:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849be8a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b006e expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334975.590684:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:3.0:1763334975.590790:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53642:x1848989694527360:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 20520us (20893us total) trans 8589939038 rc 301/301 00000100:00100000:3.0:1763334975.590801:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4843 00000100:00100000:3.0:1763334975.598996:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.599053:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694527744 00000100:00100000:0.0:1763334975.599078:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694527744 00000100:00100000:0.0:1763334975.599160:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1774 00000100:00100000:0.0:1763334975.599174:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53642:x1848989694527744:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334975.599792:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53642:x1848989694527744:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 616us (802us total) trans 8589939039 rc 0/0 00000100:00100000:0.0:1763334975.599804:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1774 00000100:00100000:3.0:1763334975.610934:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.610996:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694528000 00000100:00100000:1.0:1763334975.611011:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694528000 00000100:00100000:1.0:1763334975.611098:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1775 00000100:00100000:1.0:1763334975.611113:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53642:x1848989694528000:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334975.611487:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53642:x1848989694528000:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 374us (564us total) trans 8589939040 rc 0/0 00000100:00100000:0.0:1763334975.611497:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1775 00000100:00100000:2.0:1763334975.661861:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334975.661943:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694528256 00000100:00100000:3.0:1763334975.661958:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694528256 00000100:00100000:3.0:1763334975.662136:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4844 00000100:00100000:3.0:1763334975.662149:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694528256:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334975.662188:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334975.662218:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849be9f lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0075 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.662791:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849bea6 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.662810:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849bea6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.662823:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849bea6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.662840:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849bead lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.662847:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849bead lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.662854:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849bead lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.662943:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849beb4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.662951:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849beb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.662959:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849beb4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334975.662974:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 0 00010000:00010000:2.0:1763334975.663123:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849bea6 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663130:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849bea6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663137:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849bea6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663143:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334975.663149:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849bea6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663156:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849bea6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663169:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334975.663173:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334975.663179:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849bea6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663186:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849bea6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663200:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849bead lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663206:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849bead lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663212:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849bead lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663220:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334975.663223:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849bead lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663228:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849bead lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663233:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac6cabc00) 00010000:00010000:2.0:1763334975.663235:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334975.663238:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849bead lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663242:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849bead lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.663316:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849be9f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0075 expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.663331:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849beb4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0075 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.663338:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:2.0:1763334975.663340:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334975.663342:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430200, rc 0) 00000100:00100000:2.0:1763334975.663420:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa767b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53644:x1848989694528256:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 1274us (1578us total) trans 8589939041 rc 0/0 00000100:00100000:2.0:1763334975.663429:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4844 00000100:00100000:3.0:1763334975.667089:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.667700:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694528512 00000100:00100000:1.0:1763334975.667716:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694528512 00000100:00100000:1.0:1763334975.667795:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4845 00000100:00100000:1.0:1763334975.667808:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53644:x1848989694528512:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:1.0:1763334975.667889:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334975.667927:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849beb4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0075 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334975.667950:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:1.0:1763334975.667965:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334975.668297:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bec2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.668314:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bec2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.668325:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bec2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:0.0:1763334975.673232:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939042 00000004:00010000:0.0:1763334975.673365:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dd11b5b3 reply state 00000000dd8cf1eb transno 8589939043 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bec2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334975.673382:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334975.673965:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53644:x1848989694528512:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 6150us (6890us total) trans 8589939043 rc 0/0 00000100:00100000:0.0:1763334975.673977:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4845 00000020:00080000:0.0:1763334975.673986:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763334975.679843:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.680199:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694528640 00000100:00100000:1.0:1763334975.680213:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694528640 00000100:00100000:1.0:1763334975.680287:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4846 00010000:00010000:0.0:1763334975.680288:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bec2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334975.680298:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53644:x1848989694528640:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334975.680302:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bec2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.680310:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bec2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.680321:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334975.680326:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bec2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.680329:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334975.680335:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bec2 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.680353:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bec9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b007c expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334975.680354:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:0.0:1763334975.680358:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334975.680364:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bec2 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.680369:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bec2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.680425:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bec9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b007c expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334975.680439:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bec9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b007c expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334975.680460:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:1.0:1763334975.680464:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334975.680466:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334975.680555:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53644:x1848989694528640:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 258us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334975.680563:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4846 00000100:00100000:2.0:1763334975.682786:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.682910:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694528768 00000100:00100000:0.0:1763334975.682923:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694528768 00000100:00100000:0.0:1763334975.682993:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4898 00000100:00100000:0.0:1763334975.683004:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+17:53644:x1848989694528768:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334975.683026:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334975.683057:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849bed0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0083 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334975.683096:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334975.683125:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334975.683127:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334975.683138:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849bed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0083 expref: 18 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334975.683158:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849bed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0083 expref: 18 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334975.683172:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334975.683240:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa766680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+18:53644:x1848989694528768:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 238us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334975.683247:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4898 00000100:00100000:3.0:1763334975.685338:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.686460:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694528896 00000100:00100000:2.0:1763334975.686478:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694528896 00000100:00100000:2.0:1763334975.686799:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4899 00000100:00100000:2.0:1763334975.686813:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+9:53644:x1848989694528896:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334975.686837:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334975.686867:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849bed7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b008a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334975.686898:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x246:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334975.686927:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334975.686930:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334975.686942:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849bed7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b008a expref: 10 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.686963:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430000/0xcedf0054f849bed7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x246:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b008a expref: 10 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.686979:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430000, rc 0) 00000100:00100000:2.0:1763334975.687076:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+10:53644:x1848989694528896:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 257us (1740us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334975.687085:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4899 00000100:00100000:3.0:1763334975.689994:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334975.690320:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.691104:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694529024 00000100:00100000:0.0:1763334975.691121:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694529024 00002000:00010000:0.0:1763334975.691183:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.691189:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9833b80 with x1848989694529024 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.691205:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9833b80. 00000100:00100000:2.0:1763334975.691269:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694529152 00000100:00100000:2.0:1763334975.691274:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694529152 00002000:00010000:2.0:1763334975.691294:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:2.0:1763334975.691299:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9830a80 with x1848989694529152 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334975.691306:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9830a80. 00000100:00100000:0.0:1763334975.691348:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1764 00000100:00100000:0.0:1763334975.691360:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694529024:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:3.0:1763334975.691628:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1765 00000100:00100000:3.0:1763334975.691639:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+10:2359:x1848989694529152:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334975.691933:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334975.691937:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 0 -> 1763334976 00002000:00010000:3.0:1763334975.691939:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334975.691942:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 0 -> 1763334976 00002000:00010000:3.0:1763334975.691944:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1763334975.692423:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.692427:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 0 -> 1763334976 00002000:00010000:0.0:1763334975.692429:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.692431:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 0 -> 1763334976 00002000:00010000:0.0:1763334975.692433:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334975.692688:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+11:2359:x1848989694529152:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 1046us (2364us total) trans 21474838419 rc 0/0 00000100:00100000:3.0:1763334975.692699:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1765 00002000:00010000:3.0:1763334975.692704:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:3.0:1763334975.692707:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9830a80 with x1848989694529152 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334975.692715:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9830a80. 00000100:00100000:0.0:1763334975.692774:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694529024:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 1416us (2795us total) trans 17179871138 rc 0/0 00000100:00100000:0.0:1763334975.692782:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1764 00002000:00010000:0.0:1763334975.692784:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.692787:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9833b80 with x1848989694529024 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.692791:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9833b80. 00000100:00100000:3.0:1763334975.696916:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.697075:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694529408 00000100:00100000:2.0:1763334975.697089:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694529408 00000100:00100000:2.0:1763334975.697170:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4847 00000100:00100000:2.0:1763334975.697185:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53644:x1848989694529408:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334975.697211:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334975.697241:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849bede lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0091 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.697423:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bee5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.697441:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bee5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.697455:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bee5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.697473:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849beec lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1aa:0x0].0xe8098f29 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.697481:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849beec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.697489:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849beec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00080000:2.0:1763334975.698044:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24b:0x0], index 1: 0 00010000:00010000:2.0:1763334975.698268:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849bef3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ad:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.698280:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849bef3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.698289:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849bef3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.698332:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bee5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.698341:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bee5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.698348:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bee5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.698355:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334975.698360:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bee5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.698368:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bee5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.698382:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334975.698385:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334975.698391:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bee5 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.698397:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bee5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000004:00010000:2.0:1763334975.698412:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005db56a04 reply state 000000009dcf2f3b transno 8589939044 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849beec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334975.698422:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334975.698459:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849bede lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0091 expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.698475:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430a00/0xcedf0054f849bef3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ad:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0091 expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.698482:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ad:0x0].0x0 (ffff9a5ac6cab400) 00010000:00010000:2.0:1763334975.698485:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334975.698488:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430a00, rc 0) 00000100:00100000:2.0:1763334975.698647:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53644:x1848989694529408:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 1464us (1748us total) trans 8589939044 rc 0/0 00000100:00100000:2.0:1763334975.698656:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4847 00000100:00100000:1.0:1763334975.707877:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334975.707995:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849beec lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.708010:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849beec lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.708019:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849beec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.708026:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334975.708032:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849beec lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.708040:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849beec lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1aa:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.708062:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xe8098f29 (ffff9a5ac6cabe00) 00010000:00010000:2.0:1763334975.708074:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334975.708082:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849beec lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1aa:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.708088:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849beec lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1aa:0x0].0xe8098f29 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334975.708180:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694529664 00000100:00100000:0.0:1763334975.708195:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694529664 00000100:00100000:0.0:1763334975.708279:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4848 00000100:00100000:0.0:1763334975.708291:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53644:x1848989694529664:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334975.708321:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334975.708344:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bf01 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0098 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334975.708537:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf08 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.708701:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf08 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.708712:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf08 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.708728:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bf0f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1aa:0x0].0x9645bb7c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.708734:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bf0f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1aa:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.708740:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bf0f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1aa:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00080000:0.0:1763334975.709195:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x247:0x0], index 0: 0 00010000:00010000:0.0:1763334975.709426:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bf16 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ae:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.709437:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bf16 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.709445:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bf16 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.709495:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf08 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.709503:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf08 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.709509:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf08 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.709515:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334975.709519:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf08 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.709527:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf08 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.709536:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:0.0:1763334975.710324:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334975.710335:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf08 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334975.710347:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf08 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334975.710367:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000002de1601c reply state 000000005c6ae7c7 transno 8589939045 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bf0f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1aa:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334975.710378:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763334975.710436:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849bf01 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0098 expref: 199 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334975.710453:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793e00/0xcedf0054f849bf16 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ae:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0098 expref: 198 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334975.710462:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ae:0x0].0x0 (ffff9a5ac7d60100) 00010000:00010000:0.0:1763334975.710465:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334975.710468:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793e00, rc 0) 00010000:00080000:0.0:1763334975.719911:0:30972:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763334975.719957:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53644:x1848989694529664:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 11656us (12083us total) trans 8589939045 rc 0/0 00000100:00100000:0.0:1763334975.719971:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4848 00010000:00010000:1.0:1763334975.724125:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bf0f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1aa:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.724152:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bf0f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1aa:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.724161:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bf0f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1aa:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.724168:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334975.724174:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bf0f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1aa:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.724183:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bf0f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1aa:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.724207:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x9645bb7c (ffff9a5ac7d60f00) 00010000:00010000:1.0:1763334975.724210:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334975.724216:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bf0f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1aa:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.724222:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849bf0f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1aa:0x0].0x9645bb7c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334975.725359:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.725414:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694529920 00000100:00100000:0.0:1763334975.725428:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694529920 00000100:00100000:2.0:1763334975.727662:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4849 00000100:00100000:2.0:1763334975.727701:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53644:x1848989694529920:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334975.728154:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bf24 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.728179:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bf24 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.728194:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bf24 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:2.0:1763334975.728260:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939046 00000004:00010000:2.0:1763334975.728290:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000816c206e reply state 000000008f94dc55 transno 8589939047 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bf24 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334975.728301:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334975.728457:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53644:x1848989694529920:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 777us (3107us total) trans 8589939047 rc 0/0 00000100:00100000:2.0:1763334975.728465:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4849 00000020:00080000:2.0:1763334975.728472:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763334975.738877:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bf24 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334975.738890:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334975.738898:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bf24 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.738908:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bf24 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.738916:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334975.738921:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bf24 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334975.738928:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334975.738930:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bf24 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.738952:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:3.0:1763334975.738956:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334975.738963:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bf24 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.738970:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849bf24 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334975.738984:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694530048 00000100:00100000:1.0:1763334975.738999:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694530048 00000100:00100000:0.0:1763334975.739042:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694530176 00000100:00100000:0.0:1763334975.739048:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694530176 00002000:00010000:1.0:1763334975.739059:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.739075:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afc8eb100 with x1848989694530048 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.739080:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.739086:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afc8e8000 with x1848989694530176 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.739092:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afc8eb100. 00002000:00010000:0.0:1763334975.739095:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afc8e8000. 00000100:00100000:1.0:1763334975.739136:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1766 00000100:00100000:0.0:1763334975.739149:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1767 00000100:00100000:1.0:1763334975.739151:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694530048:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:0.0:1763334975.739166:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+11:2360:x1848989694530176:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334975.739506:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.739507:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334975.739514:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.739514:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.739522:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.739523:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334975.739528:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.739529:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.739532:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1763334975.739534:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334975.739627:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694530048:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 480us (745us total) trans 17179871139 rc 0/0 00000100:00100000:1.0:1763334975.739637:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1766 00002000:00010000:1.0:1763334975.739641:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.739644:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afc8eb100 with x1848989694530048 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.739650:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afc8eb100. 00000100:00100000:0.0:1763334975.739882:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2360:x1848989694530176:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 722us (950us total) trans 21474838420 rc 0/0 00000100:00100000:0.0:1763334975.739890:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1767 00002000:00010000:0.0:1763334975.739893:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.739897:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afc8e8000 with x1848989694530176 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.739902:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afc8e8000. 00000100:00100000:3.0:1763334975.755443:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.755758:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694530432 00000100:00100000:1.0:1763334975.755774:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694530432 00000100:00100000:1.0:1763334975.755865:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4850 00000100:00100000:1.0:1763334975.755878:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53644:x1848989694530432:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:1.0:1763334975.756355:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849bf2b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.756378:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849bf2b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.756392:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849bf2b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:1.0:1763334975.756453:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939048 00000004:00010000:1.0:1763334975.756477:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b7480c88 reply state 00000000cdc7be77 transno 8589939049 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849bf2b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334975.756486:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334975.756643:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694530432:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 766us (1216us total) trans 8589939049 rc 0/0 00000100:00100000:1.0:1763334975.756651:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4850 00000020:00080000:1.0:1763334975.756659:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763334975.763534:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849bf2b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.763558:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849bf2b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.763567:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849bf2b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.763626:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334975.763633:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849bf2b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.763642:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849bf2b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.763664:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:1.0:1763334975.763668:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334975.763674:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849bf2b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.763681:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849bf2b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334975.763995:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.764087:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694530560 00000100:00100000:2.0:1763334975.764101:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694530560 00002000:00010000:2.0:1763334975.764168:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (100000->18446744073709551615) 00002000:00100000:2.0:1763334975.764173:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece8e00 with x1848989694530560 ext(100000->18446744073709551615) 00002000:00010000:2.0:1763334975.764187:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece8e00. 00000100:00100000:2.0:1763334975.764223:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1768 00000100:00100000:2.0:1763334975.764233:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694530560:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334975.764540:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 0 -> 100000 00002000:00010000:2.0:1763334975.764544:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334975.764548:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334975.764550:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334975.764553:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334975.764656:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694530560:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 423us (669us total) trans 17179871140 rc 0/0 00000100:00100000:2.0:1763334975.764666:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1768 00002000:00010000:2.0:1763334975.764671:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (100000->18446744073709551615) 00002000:00100000:2.0:1763334975.764674:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece8e00 with x1848989694530560 ext(100000->18446744073709551615) 00002000:00010000:2.0:1763334975.764680:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece8e00. 00000100:00100000:2.0:1763334975.779730:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.779853:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694530688 00000100:00100000:0.0:1763334975.779867:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694530688 00000100:00100000:0.0:1763334975.779950:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4851 00000100:00100000:0.0:1763334975.779962:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53644:x1848989694530688:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334975.779995:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334975.780026:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf32 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b009f expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334975.780159:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849bf39 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.780177:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849bf39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.780191:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849bf39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334975.780223:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 100000 00000004:00200000:0.0:1763334975.780229:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334975.780251:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849bf39 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.780284:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf32 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b009f expref: 204 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334975.780304:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849bf39 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b009f expref: 203 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334975.780313:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:0.0:1763334975.780317:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334975.780322:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334975.780508:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694530688:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 548us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334975.780516:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4851 00000100:00100000:0.0:1763334975.783755:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.784506:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694530944 00000100:00100000:2.0:1763334975.784521:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694530944 00000100:00100000:2.0:1763334975.784627:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4852 00000100:00100000:2.0:1763334975.784639:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694530944:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334975.784710:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334975.784746:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849bf39 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b009f expref: 203 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.784768:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:2.0:1763334975.784773:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334975.785049:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf40 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.785076:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.785088:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:2.0:1763334975.785432:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939050 00000004:00010000:2.0:1763334975.785463:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d241fd43 reply state 000000004d1ec2c5 transno 8589939051 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334975.785473:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334975.785614:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694530944:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 976us (1871us total) trans 8589939051 rc 0/0 00000100:00100000:2.0:1763334975.785624:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4852 00000020:00080000:2.0:1763334975.785630:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763334975.789775:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.789816:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334975.789934:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.789951:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf40 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.789961:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf40 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.789967:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334975.789973:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf40 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.789982:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf40 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.790003:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:3.0:1763334975.790007:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334975.790013:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf40 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.790020:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf40 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334975.790074:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694531072 00000100:00100000:0.0:1763334975.790088:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694531072 00000100:00100000:1.0:1763334975.790112:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694531200 00000100:00100000:1.0:1763334975.790117:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694531200 00002000:00010000:1.0:1763334975.790156:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.790162:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a3b80 with x1848989694531200 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.790178:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aef0a3b80. 00002000:00010000:0.0:1763334975.790193:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.790197:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a2d80 with x1848989694531072 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.790205:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aef0a2d80. 00000100:00100000:1.0:1763334975.790221:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1769 00000100:00100000:0.0:1763334975.790228:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1770 00000100:00100000:1.0:1763334975.790232:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+12:2362:x1848989694531200:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:0.0:1763334975.790234:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2362:x1848989694531072:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334975.790505:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.790505:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 100000 -> 0 00002000:00010000:1.0:1763334975.790510:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.790510:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.790513:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.790513:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334975.790516:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.790516:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.790520:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1763334975.790520:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334975.790616:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2362:x1848989694531200:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 384us (797us total) trans 21474838421 rc 0/0 00000100:00100000:1.0:1763334975.790625:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1769 00002000:00010000:1.0:1763334975.790629:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.790632:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a3b80 with x1848989694531200 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.790636:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aef0a3b80. 00000100:00100000:0.0:1763334975.792516:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694531072:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 2266us (2741us total) trans 17179871141 rc 0/0 00000100:00100000:0.0:1763334975.792532:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1770 00002000:00010000:0.0:1763334975.792540:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.792544:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aef0a2d80 with x1848989694531072 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.792556:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aef0a2d80. 00000100:00100000:2.0:1763334975.803764:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.807987:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694531456 00000100:00100000:0.0:1763334975.808012:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694531456 00000100:00100000:0.0:1763334975.808170:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4853 00000100:00100000:0.0:1763334975.808185:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53644:x1848989694531456:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334975.808223:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334975.808228:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1763334975.808267:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bec9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b007c expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334975.808293:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:0.0:1763334975.808307:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334975.808330:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf47 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b00a6 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334975.808395:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bf4e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.808409:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bf4e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.808419:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bf4e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00080000:1.0:1763334975.808779:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x248:0x0], index 0: 0 00000004:00080000:1.0:1763334975.808789:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24c:0x0], index 1: 0 00010000:00010000:1.0:1763334975.808960:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bf4e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00a6 expref: 206 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334975.808971:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334975.808974:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334975.808985:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849bf47 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00a6 expref: 206 pid: 32232 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763334975.809001:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bf4e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00a6 expref: 205 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334975.809024:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334975.809027:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334975.809029:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:1.0:1763334975.809207:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694531456:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 1025us (5455us total) trans 8589939052 rc 0/0 00000100:00100000:1.0:1763334975.809216:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4853 00000100:00100000:1.0:1763334975.813722:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.814253:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694531584 00000100:00100000:2.0:1763334975.814267:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694531584 00000100:00100000:2.0:1763334975.814359:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4900 00000100:00100000:2.0:1763334975.814373:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+13:53644:x1848989694531584:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334975.814402:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334975.814433:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bf55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b00ad expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334975.814467:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x248:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334975.814496:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334975.814499:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334975.814510:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bf55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00ad expref: 14 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.814529:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bf55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00ad expref: 14 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.814549:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430400, rc 0) 00000100:00100000:2.0:1763334975.814656:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+14:53644:x1848989694531584:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 285us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334975.814665:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4900 00000100:00100000:1.0:1763334975.825484:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.825546:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.825673:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694531712 00000100:00100000:0.0:1763334975.825688:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694531712 00000100:00100000:0.0:1763334975.825780:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694531840 00000100:00100000:0.0:1763334975.825784:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694531840 00000100:00100000:0.0:1763334975.826017:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1771 00000100:00100000:0.0:1763334975.826031:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694531712:12345-192.168.201.60@tcp:22:fsx.0 00000100:00100000:0.0:1763334975.826235:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694531712:12345-192.168.201.60@tcp:22:fsx.0 Request processed in 207us (766us total) trans 0 rc -95/-95 00000100:00100000:0.0:1763334975.826246:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1771 00000100:00100000:0.0:1763334975.826271:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1772 00000100:00100000:0.0:1763334975.826279:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694531840:12345-192.168.201.60@tcp:22:fsx.0 00000100:00100000:0.0:1763334975.826352:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694531840:12345-192.168.201.60@tcp:22:fsx.0 Request processed in 73us (805us total) trans 0 rc -95/-95 00000100:00100000:0.0:1763334975.826359:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1772 00000100:00100000:1.0:1763334975.831204:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.831293:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694532096 00000100:00100000:2.0:1763334975.831306:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694532096 00000100:00100000:2.0:1763334975.831377:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4854 00000100:00100000:2.0:1763334975.831391:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694532096:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334975.831470:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334975.831508:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849bf4e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00a6 expref: 205 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.831533:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334975.831545:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334975.831895:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf5c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.831914:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf5c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.831924:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf5c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:2.0:1763334975.831991:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939053 00000004:00010000:2.0:1763334975.832020:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006de21609 reply state 00000000aacf52b4 transno 8589939054 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf5c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334975.832030:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334975.832176:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+207:53644:x1848989694532096:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 788us (985us total) trans 8589939054 rc 0/0 00000100:00100000:2.0:1763334975.832184:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4854 00000020:00080000:2.0:1763334975.832190:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1763334975.836221:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf5c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.836245:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf5c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.836254:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf5c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.836261:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334975.836266:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf5c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.836275:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf5c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.836296:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334975.836300:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334975.836305:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf5c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.836311:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849bf5c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334975.839211:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.839310:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694532224 00000100:00100000:2.0:1763334975.839324:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694532224 00000100:00100000:2.0:1763334975.839399:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4855 00000100:00100000:2.0:1763334975.839410:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+206:53644:x1848989694532224:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334975.839445:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334975.839477:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bf63 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b00b4 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.839561:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bf63 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00b4 expref: 207 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.839615:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bf63 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00b4 expref: 207 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.839640:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334975.839644:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334975.839648:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334975.840541:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+207:53644:x1848989694532224:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 1123us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334975.840553:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4855 00000100:00100000:1.0:1763334975.848969:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.849071:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694532352 00000100:00100000:2.0:1763334975.849086:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694532352 00000100:00100000:2.0:1763334975.849166:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4901 00000100:00100000:2.0:1763334975.849179:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+22:53644:x1848989694532352:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334975.849206:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334975.849238:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bf6a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b00bb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334975.849269:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334975.849299:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334975.849301:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334975.849311:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bf6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00bb expref: 23 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.849330:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bf6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00bb expref: 23 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.849344:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430e00, rc 0) 00000100:00100000:2.0:1763334975.849425:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+23:53644:x1848989694532352:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 249us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334975.849433:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4901 00000100:00100000:3.0:1763334975.855691:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.856300:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694532480 00000100:00100000:1.0:1763334975.856315:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694532480 00002000:00010000:1.0:1763334975.856374:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.856379:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9830e00 with x1848989694532480 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.856395:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9830e00. 00000100:00100000:1.0:1763334975.856442:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1773 00000100:00100000:1.0:1763334975.856453:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694532480:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334975.856779:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334975.856785:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.856788:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334975.856791:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.856793:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334975.856869:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694532480:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 417us (1192us total) trans 17179871142 rc 0/0 00000100:00100000:1.0:1763334975.856878:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1773 00002000:00010000:1.0:1763334975.856882:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.856885:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9830e00 with x1848989694532480 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.856889:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9830e00. 00000100:00100000:1.0:1763334975.861510:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.863393:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.864444:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.872510:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694532736 00000100:00100000:0.0:1763334975.872535:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694532736 00002000:00010000:0.0:1763334975.872628:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.872637:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b4e00 with x1848989694532736 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.872655:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac95b4e00. 00000100:00100000:0.0:1763334975.872704:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694532608 00000100:00100000:0.0:1763334975.872708:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694532608 00002000:00010000:0.0:1763334975.872720:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.872723:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b7480 with x1848989694532608 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.872729:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac95b7480. 00000100:00100000:0.0:1763334975.872760:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1774 00000100:00100000:0.0:1763334975.872771:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694532736:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334975.873193:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.873198:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 0 -> 1763334976 00002000:00010000:0.0:1763334975.873201:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.873203:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 0 -> 1763334976 00002000:00010000:0.0:1763334975.873206:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334975.873304:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694532736:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 534us (11811us total) trans 21474838422 rc 0/0 00000100:00100000:0.0:1763334975.873313:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1774 00002000:00010000:0.0:1763334975.873319:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.873322:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b4e00 with x1848989694532736 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.873327:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac95b4e00. 00000100:00100000:0.0:1763334975.873351:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1775 00000100:00100000:0.0:1763334975.873359:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694532608:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334975.873456:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.873459:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.873462:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.873465:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.873467:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334975.873492:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694532608:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 134us (10113us total) trans 21474838423 rc 0/0 00000100:00100000:0.0:1763334975.873500:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1775 00002000:00010000:0.0:1763334975.873503:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.873505:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b7480 with x1848989694532608 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.873509:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac95b7480. 00000100:00100000:0.0:1763334975.874501:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694532864 00000100:00100000:0.0:1763334975.874514:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694532864 00002000:00010000:0.0:1763334975.874549:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.874554:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b4380 with x1848989694532864 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.874562:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac95b4380. 00000100:00100000:0.0:1763334975.874626:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1776 00000100:00100000:0.0:1763334975.874635:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694532864:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334975.874920:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.874924:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 0 -> 1763334976 00002000:00010000:0.0:1763334975.874926:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.874928:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 0 -> 1763334976 00002000:00010000:0.0:1763334975.874931:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334975.874997:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694532864:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 363us (10559us total) trans 17179871143 rc 0/0 00000100:00100000:0.0:1763334975.875005:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1776 00002000:00010000:0.0:1763334975.875009:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.875012:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b4380 with x1848989694532864 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.875017:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac95b4380. 00000100:00100000:0.0:1763334975.881834:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.882746:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334975.882774:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694532992 00000100:00100000:3.0:1763334975.882788:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694532992 00000100:00100000:1.0:1763334975.883438:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1777 00000100:00100000:1.0:1763334975.883457:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694532992:12345-192.168.201.60@tcp:22:fsx.0 00000100:00100000:1.0:1763334975.883679:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694532992:12345-192.168.201.60@tcp:22:fsx.0 Request processed in 227us (1861us total) trans 0 rc -95/-95 00000100:00100000:1.0:1763334975.883688:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1777 00000100:00100000:3.0:1763334975.884664:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694533120 00000100:00100000:3.0:1763334975.884677:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694533120 00000100:00100000:1.0:1763334975.885497:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1778 00000100:00100000:1.0:1763334975.885514:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694533120:12345-192.168.201.60@tcp:22:fsx.0 00000100:00100000:1.0:1763334975.886360:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694533120:12345-192.168.201.60@tcp:22:fsx.0 Request processed in 845us (3612us total) trans 0 rc -95/-95 00000100:00100000:1.0:1763334975.886372:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1778 00000100:00100000:2.0:1763334975.889146:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.889269:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694533376 00000100:00100000:1.0:1763334975.889285:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694533376 00000100:00100000:1.0:1763334975.889368:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4856 00000100:00100000:1.0:1763334975.889381:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aef0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+207:53644:x1848989694533376:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:1.0:1763334975.889804:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bf71 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334975.889827:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bf71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334975.889841:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bf71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:1.0:1763334975.889902:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939055 00000004:00010000:1.0:1763334975.889931:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000033573b36 reply state 00000000d12258e7 transno 8589939056 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bf71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334975.889941:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334975.890048:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aef0a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+210:53644:x1848989694533376:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 668us (917us total) trans 8589939056 rc 0/0 00000100:00100000:1.0:1763334975.890056:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4856 00000020:00080000:1.0:1763334975.890062:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763334975.893878:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.893915:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.893948:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.893974:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.894061:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694533504 00000100:00100000:0.0:1763334975.894086:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694533504 00002000:00010000:0.0:1763334975.894143:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.894149:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac721b800 with x1848989694533504 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.894166:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac721b800. 00000100:00100000:0.0:1763334975.894200:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694533632 00000100:00100000:0.0:1763334975.894203:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694533632 00002000:00010000:0.0:1763334975.894217:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.894221:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac721aa00 with x1848989694533632 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.894229:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac721aa00. 00000100:00100000:0.0:1763334975.894241:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694533760 00000100:00100000:0.0:1763334975.894244:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694533760 00002000:00010000:0.0:1763334975.894253:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.894256:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac721ad80 with x1848989694533760 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.894262:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac721ad80. 00000100:00100000:0.0:1763334975.894273:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694533888 00000100:00100000:0.0:1763334975.894276:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694533888 00002000:00010000:0.0:1763334975.894286:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.894288:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7218e00 with x1848989694533888 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.894294:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac7218e00. 00000100:00100000:0.0:1763334975.894316:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1779 00000100:00100000:0.0:1763334975.894327:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694533504:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334975.894642:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.894646:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.894649:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.894653:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.894656:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334975.894721:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694533504:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 395us (858us total) trans 17179871144 rc 0/0 00000100:00100000:0.0:1763334975.894729:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1779 00002000:00010000:0.0:1763334975.894734:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.894737:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac721b800 with x1848989694533504 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.894741:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac721b800. 00000100:00100000:0.0:1763334975.894759:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1780 00000100:00100000:0.0:1763334975.894765:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694533632:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334975.894889:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.894892:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.894894:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.894896:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.894899:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334975.894921:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694533632:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 157us (1006us total) trans 21474838424 rc 0/0 00000100:00100000:0.0:1763334975.894928:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1780 00002000:00010000:0.0:1763334975.894932:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.894934:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac721aa00 with x1848989694533632 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.894938:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac721aa00. 00000100:00100000:0.0:1763334975.894952:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1781 00000100:00100000:0.0:1763334975.894958:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac721ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694533760:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334975.895045:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.895048:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.895051:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.895053:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.895055:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334975.895092:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac721ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694533760:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 134us (1143us total) trans 21474838425 rc 0/0 00000100:00100000:0.0:1763334975.895099:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1781 00002000:00010000:0.0:1763334975.895102:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.895105:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac721ad80 with x1848989694533760 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.895109:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac721ad80. 00000100:00100000:0.0:1763334975.895122:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1782 00000100:00100000:0.0:1763334975.895129:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694533888:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334975.895216:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.895218:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.895221:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.895223:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.895225:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334975.895248:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694533888:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 120us (1274us total) trans 17179871145 rc 0/0 00000100:00100000:0.0:1763334975.895255:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1782 00002000:00010000:0.0:1763334975.895257:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.895260:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7218e00 with x1848989694533888 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.895264:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac7218e00. 00010000:00010000:3.0:1763334975.895456:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bf71 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.895468:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bf71 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.895477:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bf71 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.895483:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334975.895489:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bf71 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.895498:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bf71 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.895518:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:3.0:1763334975.895522:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334975.895527:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bf71 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334975.895533:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849bf71 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334975.898841:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.899627:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694534016 00000100:00100000:2.0:1763334975.899642:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694534016 00000100:00100000:2.0:1763334975.899720:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1783 00000100:00100000:2.0:1763334975.899730:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694534016:12345-192.168.201.60@tcp:22:fsx.0 00000100:00100000:2.0:1763334975.902057:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694534016:12345-192.168.201.60@tcp:22:fsx.0 Request processed in 2311us (3214us total) trans 0 rc -95/-95 00000100:00100000:2.0:1763334975.902086:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1783 00000100:00100000:1.0:1763334975.902502:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334975.902993:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694534144 00000100:00100000:3.0:1763334975.903007:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694534144 00000100:00100000:3.0:1763334975.903089:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1784 00000100:00100000:3.0:1763334975.903102:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694534144:12345-192.168.201.60@tcp:22:fsx.0 00000100:00100000:3.0:1763334975.903277:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694534144:12345-192.168.201.60@tcp:22:fsx.0 Request processed in 177us (776us total) trans 0 rc -95/-95 00000100:00100000:3.0:1763334975.903285:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1784 00000100:00100000:1.0:1763334975.909831:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.910043:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694534400 00000100:00100000:2.0:1763334975.910058:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694534400 00000100:00100000:2.0:1763334975.910186:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4857 00000100:00100000:2.0:1763334975.910200:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+209:53644:x1848989694534400:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334975.910621:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bf78 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334975.910644:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bf78 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334975.910660:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bf78 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:2.0:1763334975.910736:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939057 00000004:00010000:2.0:1763334975.910769:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000dab84aa8 reply state 0000000039eab0d2 transno 8589939058 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bf78 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334975.910778:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334975.910903:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+212:53644:x1848989694534400:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 704us (1089us total) trans 8589939058 rc 0/0 00000100:00100000:2.0:1763334975.910912:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4857 00000020:00080000:2.0:1763334975.910918:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763334975.917944:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bf78 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.917967:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bf78 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.917975:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bf78 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.917981:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334975.917988:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bf78 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.917996:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bf78 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.918018:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:1.0:1763334975.918022:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334975.918027:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bf78 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334975.918033:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bf78 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334975.919048:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.919094:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.919123:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.919149:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.919183:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694534528 00000100:00100000:1.0:1763334975.919195:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694534528 00002000:00010000:1.0:1763334975.919249:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.919255:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5f8000 with x1848989694534528 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.919272:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa5f8000. 00000100:00100000:1.0:1763334975.919295:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694534656 00000100:00100000:1.0:1763334975.919298:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694534656 00002000:00010000:1.0:1763334975.919310:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.919313:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5f9f80 with x1848989694534656 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.919320:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa5f9f80. 00000100:00100000:1.0:1763334975.919331:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694534784 00000100:00100000:1.0:1763334975.919333:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694534784 00002000:00010000:1.0:1763334975.919341:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.919344:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5f8380 with x1848989694534784 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.919350:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa5f8380. 00000100:00100000:1.0:1763334975.919359:0:6522:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694534912 00000100:00100000:1.0:1763334975.919362:0:6522:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694534912 00002000:00010000:1.0:1763334975.919371:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.919374:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5f9880 with x1848989694534912 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.919379:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa5f9880. 00000100:00100000:1.0:1763334975.919397:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1785 00000100:00100000:1.0:1763334975.919407:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694534528:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334975.919762:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334975.919766:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.919769:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334975.919771:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.919773:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334975.919851:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694534528:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 441us (808us total) trans 17179871146 rc 0/0 00000100:00100000:1.0:1763334975.919859:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1785 00002000:00010000:1.0:1763334975.919863:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.919866:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5f8000 with x1848989694534528 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.919870:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa5f8000. 00000100:00100000:1.0:1763334975.919893:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1786 00000100:00100000:1.0:1763334975.919900:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694534656:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334975.920024:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334975.920027:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.920030:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334975.920033:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.920035:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334975.920059:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694534656:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 159us (964us total) trans 21474838426 rc 0/0 00000100:00100000:1.0:1763334975.920079:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1786 00002000:00010000:1.0:1763334975.920082:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.920084:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5f9f80 with x1848989694534656 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.920089:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa5f9f80. 00000100:00100000:1.0:1763334975.920102:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1787 00000100:00100000:1.0:1763334975.920108:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694534784:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334975.920202:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334975.920205:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.920207:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334975.920208:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.920211:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334975.920234:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694534784:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 126us (1110us total) trans 21474838427 rc 0/0 00000100:00100000:1.0:1763334975.920240:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1787 00002000:00010000:1.0:1763334975.920243:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.920245:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5f8380 with x1848989694534784 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.920249:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa5f8380. 00000100:00100000:1.0:1763334975.920262:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1788 00000100:00100000:1.0:1763334975.920268:0:6522:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694534912:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334975.920352:0:6522:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334975.920356:0:6522:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.920359:0:6522:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334975.920361:0:6522:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334975.920363:0:6522:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334975.920387:0:6522:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694534912:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 118us (1237us total) trans 17179871147 rc 0/0 00000100:00100000:1.0:1763334975.920393:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1788 00002000:00010000:1.0:1763334975.920396:0:6522:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763334975.920398:0:6522:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5f9880 with x1848989694534912 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334975.920403:0:6522:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa5f9880. 00000100:00100000:2.0:1763334975.923756:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.923885:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694535040 00000100:00100000:0.0:1763334975.923899:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694535040 00000100:00100000:0.0:1763334975.923999:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1789 00000100:00100000:0.0:1763334975.924013:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694535040:12345-192.168.201.60@tcp:22:fsx.0 00000100:00100000:0.0:1763334975.924223:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694535040:12345-192.168.201.60@tcp:22:fsx.0 Request processed in 213us (485us total) trans 0 rc -95/-95 00000100:00100000:0.0:1763334975.924232:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1789 00000100:00100000:0.0:1763334975.928211:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.929498:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694535168 00000100:00100000:2.0:1763334975.929518:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694535168 00000100:00100000:2.0:1763334975.929631:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1790 00000100:00100000:2.0:1763334975.929645:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694535168:12345-192.168.201.60@tcp:22:fsx.0 00000100:00100000:2.0:1763334975.929836:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694535168:12345-192.168.201.60@tcp:22:fsx.0 Request processed in 194us (1641us total) trans 0 rc -95/-95 00000100:00100000:2.0:1763334975.929846:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1790 00000100:00100000:1.0:1763334975.934757:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.934902:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694535424 00000100:00100000:2.0:1763334975.934917:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694535424 00000100:00100000:2.0:1763334975.935001:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4858 00000100:00100000:2.0:1763334975.935013:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+211:53644:x1848989694535424:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334975.935429:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf7f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.935451:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf7f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.935466:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf7f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:2.0:1763334975.935529:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939059 00000004:00010000:2.0:1763334975.935556:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000044746874 reply state 00000000ecc7a07a transno 8589939060 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf7f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334975.935566:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334975.935731:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+214:53644:x1848989694535424:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 718us (986us total) trans 8589939060 rc 0/0 00000100:00100000:2.0:1763334975.935739:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4858 00000020:00080000:2.0:1763334975.935748:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763334975.940768:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.940966:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694535552 00000100:00100000:0.0:1763334975.940984:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694535552 00002000:00010000:0.0:1763334975.941048:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.941055:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9833480 with x1848989694535552 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.941083:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9833480. 00000100:00100000:0.0:1763334975.941140:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1791 00000100:00100000:0.0:1763334975.941155:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694535552:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334975.941538:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.941542:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.941545:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.941548:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.941550:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334975.941678:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694535552:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 526us (929us total) trans 17179871148 rc 0/0 00000100:00100000:0.0:1763334975.941687:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1791 00002000:00010000:0.0:1763334975.941692:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.941695:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9833480 with x1848989694535552 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.941700:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9833480. 00010000:00010000:2.0:1763334975.941817:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf7f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.941830:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf7f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.941840:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf7f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.941852:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334975.941858:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf7f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.941866:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf7f lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.941886:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334975.941891:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334975.941896:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf7f lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334975.941901:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf7f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334975.943943:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334975.943989:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334975.944032:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.944129:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694535680 00000100:00100000:0.0:1763334975.944142:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694535680 00002000:00010000:0.0:1763334975.944201:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.944207:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9832680 with x1848989694535680 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.944222:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9832680. 00000100:00100000:0.0:1763334975.944256:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694535936 00000100:00100000:0.0:1763334975.944260:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694535936 00002000:00010000:0.0:1763334975.944274:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.944277:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9830380 with x1848989694535936 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.944283:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9830380. 00000100:00100000:0.0:1763334975.944300:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694535808 00000100:00100000:0.0:1763334975.944303:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694535808 00002000:00010000:0.0:1763334975.944313:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.944316:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeef9ca80 with x1848989694535808 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.944322:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeef9ca80. 00000100:00100000:0.0:1763334975.944342:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1792 00000100:00100000:0.0:1763334975.944353:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694535680:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334975.944648:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.944653:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.944656:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.944658:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.944660:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334975.944730:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694535680:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 376us (799us total) trans 21474838428 rc 0/0 00000100:00100000:0.0:1763334975.944740:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1792 00002000:00010000:0.0:1763334975.944746:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/582 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.944749:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9832680 with x1848989694535680 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.944754:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9832680. 00000100:00100000:0.0:1763334975.944777:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1793 00000100:00100000:0.0:1763334975.944785:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694535936:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334975.944912:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.944915:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.944917:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.944919:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.944921:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334975.944945:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2359:x1848989694535936:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 162us (957us total) trans 17179871149 rc 0/0 00000100:00100000:0.0:1763334975.944953:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1793 00002000:00010000:0.0:1763334975.944957:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.944959:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9830380 with x1848989694535936 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.944964:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9830380. 00000100:00100000:0.0:1763334975.944980:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1794 00000100:00100000:0.0:1763334975.944988:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694535808:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334975.945104:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334975.945107:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.945109:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334975.945111:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334975.945113:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334975.945135:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694535808:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 148us (1103us total) trans 21474838429 rc 0/0 00000100:00100000:0.0:1763334975.945141:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1794 00002000:00010000:0.0:1763334975.945143:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334975.945146:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeef9ca80 with x1848989694535808 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334975.945150:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeef9ca80. 00000100:00100000:1.0:1763334975.950875:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.951733:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694536064 00000100:00100000:2.0:1763334975.951750:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694536064 00000100:00100000:2.0:1763334975.951876:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4859 00000100:00100000:2.0:1763334975.951888:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+213:53644:x1848989694536064:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334975.951919:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334975.951948:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf86 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b00c2 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.952074:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849bf8d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334975.952092:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849bf8d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334975.952106:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849bf8d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334975.952148:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 0 00000004:00200000:2.0:1763334975.952153:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334975.952178:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849bf8d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334975.952212:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf86 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00c2 expref: 215 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.952233:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849bf8d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00c2 expref: 214 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334975.952243:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334975.952246:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334975.952250:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430600, rc 0) 00000100:00100000:2.0:1763334975.952691:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+214:53644:x1848989694536064:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 803us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334975.952699:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4859 00000100:00100000:3.0:1763334975.958693:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.959816:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694536192 00000100:00100000:0.0:1763334975.959833:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694536192 00000100:00100000:2.0:1763334975.960548:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4902 00000100:00100000:2.0:1763334975.960564:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694536192:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334975.960623:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334975.960654:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf94 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b00c9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334975.960686:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x247:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334975.960709:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334975.960711:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334975.960720:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00c9 expref: 23 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334975.960738:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x247:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00c9 expref: 23 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334975.960753:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430c00, rc 0) 00000100:00100000:2.0:1763334975.960818:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694536192:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 258us (2139us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334975.960825:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4902 00000100:00100000:3.0:1763334975.967716:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.967830:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694536448 00000100:00100000:2.0:1763334975.967845:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694536448 00000100:00100000:1.0:1763334975.968486:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4860 00000100:00100000:1.0:1763334975.968504:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+214:53644:x1848989694536448:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:1.0:1763334975.968616:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334975.968654:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849bf8d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00c2 expref: 214 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334975.968679:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:1.0:1763334975.968686:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334975.968993:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bf9b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334975.969010:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bf9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334975.969022:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bf9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:1.0:1763334975.969096:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939061 00000004:00010000:1.0:1763334975.969127:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000017f5e79c reply state 000000005e46f5cd transno 8589939062 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bf9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334975.969137:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334975.969264:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+216:53644:x1848989694536448:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 766us (1562us total) trans 8589939062 rc 0/0 00000100:00100000:1.0:1763334975.969274:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4860 00000020:00080000:1.0:1763334975.969281:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763334975.974387:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.974433:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334975.974466:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334975.974557:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bf9b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.974600:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bf9b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.974611:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bf9b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.974617:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334975.974623:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bf9b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.974632:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bf9b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.974653:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:0.0:1763334975.974657:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334975.974661:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bf9b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334975.974668:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849bf9b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334975.974749:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694536576 00000100:00100000:2.0:1763334975.974763:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694536576 00002000:00010000:2.0:1763334975.974813:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (118641->18446744073709551615) 00002000:00100000:2.0:1763334975.974817:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5fb480 with x1848989694536576 ext(118641->18446744073709551615) 00002000:00010000:2.0:1763334975.974831:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa5fb480. 00000100:00100000:2.0:1763334975.974859:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694536832 00000100:00100000:2.0:1763334975.974862:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694536832 00002000:00010000:2.0:1763334975.974870:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:2.0:1763334975.974873:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5f8700 with x1848989694536832 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334975.974894:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa5f8700. 00000100:00100000:2.0:1763334975.974904:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694536704 00000100:00100000:2.0:1763334975.974907:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694536704 00002000:00010000:2.0:1763334975.974918:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:2.0:1763334975.974920:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e4e00 with x1848989694536704 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334975.974927:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c39e4e00. 00000100:00100000:2.0:1763334975.974941:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1795 00000100:00100000:2.0:1763334975.974950:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2359:x1848989694536576:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334975.975241:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 0 -> 118641 00002000:00010000:2.0:1763334975.975245:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334975.975247:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334975.975250:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334975.975265:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334975.975344:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2359:x1848989694536576:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 394us (974us total) trans 17179871150 rc 0/0 00000100:00100000:2.0:1763334975.975353:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1795 00002000:00010000:2.0:1763334975.975356:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (118641->18446744073709551615) 00002000:00100000:2.0:1763334975.975359:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5fb480 with x1848989694536576 ext(118641->18446744073709551615) 00002000:00010000:2.0:1763334975.975364:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa5fb480. 00000100:00100000:2.0:1763334975.975386:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1796 00000100:00100000:2.0:1763334975.975393:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2359:x1848989694536832:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334975.975482:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334975.975485:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334975.975487:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334975.975489:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334975.975491:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334975.975512:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2359:x1848989694536832:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 120us (1078us total) trans 17179871151 rc 0/0 00000100:00100000:2.0:1763334975.975518:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1796 00002000:00010000:2.0:1763334975.975521:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:2.0:1763334975.975523:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa5f8700 with x1848989694536832 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334975.975527:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa5f8700. 00000100:00100000:2.0:1763334975.975540:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1797 00000100:00100000:2.0:1763334975.975546:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694536704:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334975.975702:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334975.975705:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334975.975707:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334975.975709:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334975.975711:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334975.975730:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694536704:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 184us (1263us total) trans 21474838430 rc 0/0 00000100:00100000:2.0:1763334975.975735:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1797 00002000:00010000:2.0:1763334975.975738:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:2.0:1763334975.975740:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e4e00 with x1848989694536704 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334975.975744:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c39e4e00. 00000100:00100000:3.0:1763334975.980649:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.980796:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694536960 00000100:00100000:0.0:1763334975.980812:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694536960 00002000:00100000:0.0:1763334975.980887:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (98304->102399) req@ffff9a5aeef9c700 x1848989694536960/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:21/0 lens 488/0 e 0 to 0 dl 1763334986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1763334975.980902:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeef9c700 with x1848989694536960 ext(98304->102399) 00002000:00010000:0.0:1763334975.980912:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeef9c700 00000100:00100000:0.0:1763334975.980961:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1798 00000100:00100000:0.0:1763334975.980974:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2362:x1848989694536960:12345-192.168.201.60@tcp:3:kworker.0 00000100:00100000:0.0:1763334975.981302:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2362:x1848989694536960:12345-192.168.201.60@tcp:3:kworker.0 Request processed in 330us (671us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334975.981312:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1798 00002000:00100000:0.0:1763334975.981321:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (98304->102399) req@ffff9a5aeef9c700 x1848989694536960/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:21/0 lens 488/4536 e 0 to 0 dl 1763334986 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1763334975.981329:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeef9c700 with x1848989694536960 ext(98304->102399) 00002000:00010000:0.0:1763334975.981332:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeef9c700 00000100:00100000:3.0:1763334975.986507:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334975.986640:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694537088 00000100:00100000:0.0:1763334975.986655:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694537088 00002000:00100000:0.0:1763334975.986732:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (102400->106495) req@ffff9a5aeef9d500 x1848989694537088/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:21/0 lens 488/0 e 0 to 0 dl 1763334986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1763334975.986747:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeef9d500 with x1848989694537088 ext(102400->106495) 00002000:00010000:0.0:1763334975.986755:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeef9d500 00000100:00100000:0.0:1763334975.986801:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1799 00000100:00100000:0.0:1763334975.986812:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeef9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2359:x1848989694537088:12345-192.168.201.60@tcp:3:kworker.0 00000100:00100000:0.0:1763334975.987443:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeef9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2359:x1848989694537088:12345-192.168.201.60@tcp:3:kworker.0 Request processed in 620us (940us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334975.987459:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1799 00002000:00100000:0.0:1763334975.987471:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (102400->106495) req@ffff9a5aeef9d500 x1848989694537088/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:21/0 lens 488/4536 e 0 to 0 dl 1763334986 ref 1 fl Complete:/600/0 rc 4096/4096 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1763334975.987490:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeef9d500 with x1848989694537088 ext(102400->106495) 00002000:00010000:0.0:1763334975.987496:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeef9d500 00000100:00100000:1.0:1763334975.993079:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334975.994120:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694537216 00000100:00100000:2.0:1763334975.994136:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694537216 00002000:00100000:2.0:1763334975.994295:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (77824->118783) req@ffff9a59c39e7b80 x1848989694537216/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:21/0 lens 504/0 e 0 to 0 dl 1763334986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1763334975.994310:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e7b80 with x1848989694537216 ext(77824->118783) 00002000:00010000:2.0:1763334975.994320:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c39e7b80 00000100:00100000:2.0:1763334975.994369:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1800 00000100:00100000:2.0:1763334975.994383:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2362:x1848989694537216:12345-192.168.201.60@tcp:3:kworker.0 00000100:00100000:2.0:1763334976.001116:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2362:x1848989694537216:12345-192.168.201.60@tcp:3:kworker.0 Request processed in 6718us (8045us total) trans 0 rc 32768/32768 00000100:00100000:2.0:1763334976.001134:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1800 00002000:00100000:2.0:1763334976.001151:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (77824->118783) req@ffff9a59c39e7b80 x1848989694537216/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:21/0 lens 504/440 e 0 to 0 dl 1763334986 ref 1 fl Complete:/600/0 rc 32768/32768 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1763334976.001164:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e7b80 with x1848989694537216 ext(77824->118783) 00002000:00010000:2.0:1763334976.001173:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c39e7b80 00000100:00100000:2.0:1763334976.005397:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.006753:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694537344 00000100:00100000:0.0:1763334976.006773:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694537344 00002000:00100000:0.0:1763334976.006861:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (98304->118640) req@ffff9a5ac7218000 x1848989694537344/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:22/0 lens 488/0 e 0 to 0 dl 1763334987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1763334976.006874:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7218000 with x1848989694537344 ext(98304->118640) 00002000:00010000:0.0:1763334976.006882:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac7218000 00000100:00100000:0.0:1763334976.006932:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1801 00000100:00100000:0.0:1763334976.006944:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2362:x1848989694537344:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:0.0:1763334976.011800:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7218000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+35:2362:x1848989694537344:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 4842us (6403us total) trans 17179871152 rc 0/0 00000100:00100000:0.0:1763334976.011818:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1801 00002000:00100000:0.0:1763334976.011834:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (98304->118640) req@ffff9a5ac7218000 x1848989694537344/t17179871152(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:22/0 lens 488/448 e 0 to 0 dl 1763334987 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:0.0:1763334976.011847:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7218000 with x1848989694537344 ext(98304->118640) 00002000:00010000:0.0:1763334976.011855:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac7218000 00000100:00100000:1.0:1763334976.015964:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.016692:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694537472 00000100:00100000:0.0:1763334976.016708:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694537472 00000100:00100000:0.0:1763334976.016793:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4903 00000100:00100000:0.0:1763334976.016805:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+35:2361:x1848989694537472:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:0.0:1763334976.079389:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871152 is committed 00000001:00080000:0.0:1763334976.079448:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871136 is committed 00000001:00080000:0.0:1763334976.079510:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871137 is committed 00000100:00100000:2.0:1763334976.079900:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2361:x1848989694537472:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 63087us (63942us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.079915:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4903 00000100:00100000:2.0:1763334976.085369:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.085977:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694537600 00000100:00100000:1.0:1763334976.085994:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694537600 00000100:00100000:1.0:1763334976.086087:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4861 00000100:00100000:1.0:1763334976.086101:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+215:53644:x1848989694537600:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334976.086134:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334976.086165:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849bfa2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b00d0 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.086282:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bfa9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.086300:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bfa9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.086313:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bfa9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334976.086347:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 118641 00000004:00200000:1.0:1763334976.086352:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334976.086372:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bfa9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.086403:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849bfa2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00d0 expref: 217 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.086424:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bfa9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00d0 expref: 216 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.086434:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:1.0:1763334976.086438:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334976.086442:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334976.086529:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+216:53644:x1848989694537600:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 431us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.086537:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4861 00000100:00100000:1.0:1763334976.101316:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.101452:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694537728 00000100:00100000:2.0:1763334976.101468:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694537728 00002000:00100000:2.0:1763334976.101546:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (28672->77823) req@ffff9a59c39e4700 x1848989694537728/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:22/0 lens 488/0 e 0 to 0 dl 1763334987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1763334976.101560:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e4700 with x1848989694537728 ext(28672->77823) 00002000:00010000:2.0:1763334976.101568:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c39e4700 00000100:00100000:2.0:1763334976.101648:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1802 00000100:00100000:2.0:1763334976.101660:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694537728:12345-192.168.201.60@tcp:3:kworker.0 00000100:00100000:2.0:1763334976.107603:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694537728:12345-192.168.201.60@tcp:3:kworker.0 Request processed in 5898us (6257us total) trans 0 rc 49152/49152 00000100:00100000:2.0:1763334976.107623:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1802 00002000:00100000:2.0:1763334976.107643:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (28672->77823) req@ffff9a59c39e4700 x1848989694537728/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:22/0 lens 488/440 e 0 to 0 dl 1763334987 ref 1 fl Complete:/600/0 rc 49152/49152 job:'kworker.0' uid:4294967295 gid:4294967295 projid:0 00002000:00100000:2.0:1763334976.107655:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e4700 with x1848989694537728 ext(28672->77823) 00002000:00010000:2.0:1763334976.107663:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c39e4700 00000100:00100000:1.0:1763334976.119172:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.119306:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694537984 00000100:00100000:2.0:1763334976.119324:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694537984 00000100:00100000:2.0:1763334976.119401:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4862 00000100:00100000:2.0:1763334976.119412:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+216:53644:x1848989694537984:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334976.119491:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334976.119537:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849bfa9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00d0 expref: 216 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.119566:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334976.119634:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334976.119957:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bfb0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.119975:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bfb0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.119986:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bfb0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:2.0:1763334976.120052:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939063 00000004:00010000:2.0:1763334976.120099:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bdc4e7bc reply state 0000000080f53104 transno 8589939064 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bfb0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334976.120110:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334976.120239:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+218:53644:x1848989694537984:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 827us (1082us total) trans 8589939064 rc 0/0 00000100:00100000:2.0:1763334976.120247:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4862 00000020:00080000:2.0:1763334976.120254:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763334976.125559:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.125613:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.125643:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.125766:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694538240 00000100:00100000:0.0:1763334976.125781:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694538240 00002000:00010000:0.0:1763334976.125845:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334976.125852:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e5f80 with x1848989694538240 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334976.125868:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c39e5f80. 00000100:00100000:0.0:1763334976.125907:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694538112 00000100:00100000:0.0:1763334976.125911:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694538112 00002000:00010000:0.0:1763334976.125925:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (73013->18446744073709551615) 00002000:00100000:0.0:1763334976.125930:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e4380 with x1848989694538112 ext(73013->18446744073709551615) 00002000:00010000:0.0:1763334976.125937:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c39e4380. 00000100:00100000:0.0:1763334976.125948:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694538368 00000100:00100000:0.0:1763334976.125951:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694538368 00002000:00010000:0.0:1763334976.125962:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334976.125965:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e7800 with x1848989694538368 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334976.125970:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c39e7800. 00000100:00100000:0.0:1763334976.125989:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1803 00000100:00100000:0.0:1763334976.125999:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694538240:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:3.0:1763334976.126416:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1804 00000100:00100000:3.0:1763334976.126429:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2361:x1848989694538112:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334976.126823:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 118641 -> 73013 00002000:00010000:3.0:1763334976.126828:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334976.126831:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334976.126833:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334976.126836:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 1 -> 47 00000100:00100000:3.0:1763334976.126928:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694538112:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 501us (1313us total) trans 17179871153 rc 0/0 00000100:00100000:3.0:1763334976.126937:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1804 00002000:00010000:3.0:1763334976.126944:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (73013->18446744073709551615) 00002000:00100000:3.0:1763334976.126947:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e4380 with x1848989694538112 ext(73013->18446744073709551615) 00002000:00010000:3.0:1763334976.126952:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c39e4380. 00000100:00100000:3.0:1763334976.126974:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1805 00000100:00100000:3.0:1763334976.126981:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2361:x1848989694538368:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334976.127105:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334976.127109:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334976.127112:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334976.127113:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334976.127116:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:3.0:1763334976.127139:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694538368:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 158us (1495us total) trans 17179871154 rc 0/0 00000100:00100000:3.0:1763334976.127146:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1805 00002000:00010000:3.0:1763334976.127149:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:3.0:1763334976.127152:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e7800 with x1848989694538368 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334976.127157:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c39e7800. 00010000:00010000:2.0:1763334976.127707:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bfb0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.127721:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bfb0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.127732:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bfb0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.127738:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334976.127744:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bfb0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.127754:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bfb0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.127775:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334976.127778:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334976.127785:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bfb0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.127791:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849bfb0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00002000:00010000:0.0:1763334976.131329:0:21630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334976.131341:0:21630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334976.131344:0:21630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334976.131346:0:21630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334976.131349:0:21630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334976.131456:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2361:x1848989694538240:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 5449us (5906us total) trans 21474838431 rc 0/0 00000100:00100000:0.0:1763334976.131471:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1803 00002000:00010000:0.0:1763334976.131478:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334976.131483:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c39e5f80 with x1848989694538240 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334976.131493:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c39e5f80. 00000100:00100000:3.0:1763334976.136556:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.136754:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694538496 00000100:00100000:1.0:1763334976.136769:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694538496 00000100:00100000:1.0:1763334976.136840:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4863 00000100:00100000:1.0:1763334976.136850:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+217:53644:x1848989694538496:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334976.136881:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334976.136909:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bfb7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b00d7 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.137031:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bfbe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.137049:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bfbe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.137076:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bfbe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334976.137114:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 73013 00000004:00200000:1.0:1763334976.137120:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334976.137145:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bfbe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.137181:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849bfb7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00d7 expref: 219 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.137203:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bfbe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00d7 expref: 218 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.137213:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:1.0:1763334976.137217:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334976.137221:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334976.137554:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+218:53644:x1848989694538496:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 704us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.137563:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4863 00000100:00100000:3.0:1763334976.145943:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.146092:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694538624 00000100:00100000:0.0:1763334976.146107:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694538624 00002000:00100000:0.0:1763334976.146181:0:21630:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x24a:0x0] (40960->73012) req@ffff9a5af6beea00 x1848989694538624/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:22/0 lens 488/0 e 0 to 0 dl 1763334987 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334976.146194:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6beea00 with x1848989694538624 ext(40960->73012) 00002000:00010000:0.0:1763334976.146203:0:21630:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6beea00 00000100:00100000:0.0:1763334976.146328:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1806 00000100:00100000:0.0:1763334976.146340:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694538624:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:0.0:1763334976.150521:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694538624:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 4164us (4574us total) trans 17179871155 rc 0/0 00000100:00100000:0.0:1763334976.150541:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1806 00002000:00100000:0.0:1763334976.150558:0:21630:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x24a:0x0] (40960->73012) req@ffff9a5af6beea00 x1848989694538624/t17179871155(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:22/0 lens 488/448 e 0 to 0 dl 1763334987 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334976.150614:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6beea00 with x1848989694538624 ext(40960->73012) 00002000:00010000:0.0:1763334976.150622:0:21630:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6beea00 00000100:00100000:3.0:1763334976.153279:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.153411:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694538752 00000100:00100000:2.0:1763334976.153426:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694538752 00000100:00100000:2.0:1763334976.153511:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4904 00000100:00100000:2.0:1763334976.153524:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694538752:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:3.0:1763334976.207875:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871155 is committed 00000100:00100000:0.0:1763334976.208106:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694538752:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 54576us (54833us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334976.208120:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4904 00000100:00100000:3.0:1763334976.213462:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.213558:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694539008 00000100:00100000:0.0:1763334976.213617:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694539008 00000100:00100000:0.0:1763334976.213699:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1776 00000100:00100000:0.0:1763334976.213711:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+218:53644:x1848989694539008:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:0.0:1763334976.214196:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+219:53644:x1848989694539008:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 486us (946us total) trans 8589939065 rc 0/0 00000100:00100000:0.0:1763334976.214207:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1776 00000100:00100000:3.0:1763334976.248864:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.250524:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694539264 00000100:00100000:1.0:1763334976.250544:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694539264 00000100:00100000:1.0:1763334976.250661:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4864 00000100:00100000:1.0:1763334976.250673:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+219:53645:x1848989694539264:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334976.250709:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334976.250739:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bfc5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b00de expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.250840:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bfcc lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.250858:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bfcc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.250871:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bfcc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.250888:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bfd3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.250896:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bfd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.250902:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bfd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251083:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bfda lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251094:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bfda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251102:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bfda lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334976.251115:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 73013 00010000:00010000:1.0:1763334976.251243:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bfcc lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251256:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bfcc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251263:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bfcc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251269:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334976.251274:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bfcc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251282:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bfcc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251296:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:1.0:1763334976.251299:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334976.251305:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bfcc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251311:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849bfcc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251325:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bfd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251331:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bfd3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251337:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bfd3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251342:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334976.251344:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bfd3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251353:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bfd3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251360:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ad28fa500) 00010000:00010000:1.0:1763334976.251363:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334976.251366:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bfd3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251371:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849bfd3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334976.251423:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849bfc5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00de expref: 222 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.251439:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bfda lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00de expref: 221 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.251446:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:1.0:1763334976.251448:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334976.251451:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334976.251550:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+221:53645:x1848989694539264:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 878us (2701us total) trans 8589939066 rc 0/0 00000100:00100000:1.0:1763334976.251559:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4864 00000100:00100000:1.0:1763334976.261844:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.261922:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694539392 00000100:00100000:0.0:1763334976.261935:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694539392 00000100:00100000:1.0:1763334976.261947:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.262013:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694539648 00000100:00100000:2.0:1763334976.262017:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694539648 00000100:00100000:2.0:1763334976.262083:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4865 00000100:00100000:2.0:1763334976.262097:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+222:53645:x1848989694539648:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334976.262129:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334976.262157:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849bfe8 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b00e5 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.263036:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bfef lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.263054:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bfef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.263079:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bfef lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334976.263091:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1af:0x0]: returning size 0 00010000:00010000:2.0:1763334976.263151:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849bfe8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00e5 expref: 225 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.263172:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bfef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00e5 expref: 224 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.263182:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1af:0x0].0x0 (ffff9a5b021c4a00) 00010000:00010000:2.0:1763334976.263185:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334976.263189:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431000, rc 0) 00000100:00100000:2.0:1763334976.263276:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+224:53645:x1848989694539648:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1182us (1327us total) trans 8589939067 rc 0/0 00000100:00100000:2.0:1763334976.263285:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4865 00000100:00100000:0.0:1763334976.263851:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 395 00000100:00100000:0.0:1763334976.263868:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+223:2360:x1848989694539392:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334976.263884:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334976.263904:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849bfda lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00de expref: 223 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.263917:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:0.0:1763334976.263922:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334976.263951:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+222:2360:x1848989694539392:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 90us (2121us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334976.263957:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 395 00000100:00100000:3.0:1763334976.279690:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.280182:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694539904 00000100:00100000:2.0:1763334976.280196:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694539904 00000100:00100000:2.0:1763334976.280277:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4866 00000100:00100000:2.0:1763334976.280289:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+222:53645:x1848989694539904:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334976.280315:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334976.280342:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849bffd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b00ec expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.280508:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.280526:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bfef lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00e5 expref: 223 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.280535:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.280608:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bfef lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00e5 expref: 223 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.280624:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bfef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00e5 expref: 223 pid: 30972 timeout: 1140 lvb_type: 0 00000100:00100000:2.0:1763334976.280642:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701858432:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334976.280834:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e7c240 going to sleep for 11 seconds 00000100:00100000:3.0:1763334976.286869:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.286960:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694540032 00000100:00100000:0.0:1763334976.286974:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694540032 00010000:00010000:0.0:1763334976.287028:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bfef lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00e5 expref: 224 pid: 30972 timeout: 1140 lvb_type: 0 00000100:00100000:0.0:1763334976.287092:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2580 00000100:00100000:0.0:1763334976.287104:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+224:2360:x1848989694540032:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334976.287126:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334976.287133:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bfef lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00e5 expref: 224 pid: 30972 timeout: 1140 lvb_type: 0 00010000:00010000:0.0:1763334976.287148:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bfef lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00e5 expref: 224 pid: 30972 timeout: 1140 lvb_type: 0 00010000:00010000:0.0:1763334976.287178:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1af:0x0].0x0 (ffff9a5b021c4a00) 00010000:00010000:0.0:1763334976.287184:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334976.287195:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334976.287203:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334976.287226:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334976.287296:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+224:2360:x1848989694540032:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 193us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334976.287304:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2580 00010000:00010000:2.0:1763334976.287659:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849bfef lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00e5 expref: 223 pid: 30972 timeout: 1140 lvb_type: 0 00000100:00100000:2.0:1763334976.287680:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701858432:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334976.287707:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.287717:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.287725:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334976.287753:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1af:0x0]: returning size 0 00000004:00080000:2.0:1763334976.288003:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24d:0x0], index 1: 0 00000004:00080000:2.0:1763334976.288011:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x249:0x0], index 0: 0 00010000:00010000:2.0:1763334976.288246:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.288255:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.288262:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.288268:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334976.288274:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.288282:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.288294:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1af:0x0].0x0 (ffff9a5b021c4a00) 00010000:00010000:2.0:1763334976.288297:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334976.288302:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.288308:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c004 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.288380:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849bffd lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00ec expref: 223 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.288392:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334976.288395:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334976.288399:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849bffd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00ec expref: 223 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.288409:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430600, rc 0) 00000100:00100000:2.0:1763334976.288481:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6453100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+222:53645:x1848989694539904:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 8194us (8805us total) trans 8589939068 rc 301/301 00000100:00100000:2.0:1763334976.288491:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4866 00000100:00100000:3.0:1763334976.290292:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.291419:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694540288 00000100:00100000:0.0:1763334976.291440:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694540288 00000100:00100000:0.0:1763334976.291531:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1777 00000100:00100000:0.0:1763334976.291543:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+222:53645:x1848989694540288:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334976.292055:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6452a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+223:53645:x1848989694540288:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 511us (1772us total) trans 8589939069 rc 0/0 00000100:00100000:0.0:1763334976.292076:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1777 00000100:00100000:3.0:1763334976.296750:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.298116:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694540416 00000100:00100000:2.0:1763334976.298137:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694540416 00000100:00100000:2.0:1763334976.298227:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4867 00000100:00100000:2.0:1763334976.298238:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+223:53645:x1848989694540416:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334976.298451:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334976.298488:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c012 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b00f3 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.299445:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c019 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.299469:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c019 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.299484:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c019 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334976.299532:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1af:0x0]: returning size 0 00000004:00200000:2.0:1763334976.299537:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334976.299558:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c019 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.299624:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c012 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00f3 expref: 225 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.299648:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c019 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00f3 expref: 224 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.299657:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1af:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:2.0:1763334976.299660:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763334976.299665:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431a00, rc 0) 00000100:00100000:2.0:1763334976.299757:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6453800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+224:53645:x1848989694540416:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1520us (3019us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.299767:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4867 00000100:00100000:1.0:1763334976.308166:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.308254:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694540544 00000100:00100000:0.0:1763334976.308269:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694540544 00000100:00100000:1.0:1763334976.308290:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.308339:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694540672 00000100:00100000:0.0:1763334976.308343:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694540672 00000100:00100000:0.0:1763334976.308388:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4905 00000100:00100000:0.0:1763334976.308400:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694540544:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334976.308429:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334976.308463:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c020 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b00fa expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334976.308496:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334976.308521:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.308524:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.308537:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c020 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00fa expref: 20 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334976.308557:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c020 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00fa expref: 20 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334976.308603:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334976.308677:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694540544:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 280us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334976.308685:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4905 00000100:00100000:0.0:1763334976.308709:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4906 00000100:00100000:0.0:1763334976.308717:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694540672:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334976.308726:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334976.308740:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c027 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0101 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334976.308759:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x249:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334976.308770:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.308772:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.308778:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c027 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0101 expref: 26 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334976.308791:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c027 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0101 expref: 26 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334976.308800:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334976.308827:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694540672:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 110us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334976.308834:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4906 00000100:00100000:3.0:1763334976.314781:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.321823:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694540928 00000100:00100000:2.0:1763334976.321846:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694540928 00000100:00100000:2.0:1763334976.321952:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4868 00000100:00100000:2.0:1763334976.321966:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+224:53645:x1848989694540928:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334976.321994:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334976.322027:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c02e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0108 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.322172:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c035 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.322191:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c035 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.322205:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c035 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334976.322221:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 73013 00010000:00010000:2.0:1763334976.322397:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c02e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0108 expref: 227 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.322422:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c035 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0108 expref: 226 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.322432:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334976.322435:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334976.322440:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431000, rc 0) 00000100:00100000:2.0:1763334976.322541:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6452300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+226:53645:x1848989694540928:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 577us (7776us total) trans 8589939070 rc 0/0 00000100:00100000:2.0:1763334976.322549:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4868 00000100:00100000:2.0:1763334976.337820:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334976.338717:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694541056 00000100:00100000:3.0:1763334976.338735:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694541056 00000100:00100000:2.0:1763334976.338933:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.340914:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.341752:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694541312 00000100:00100000:1.0:1763334976.341769:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694541312 00000100:00100000:1.0:1763334976.341853:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4907 00000100:00100000:1.0:1763334976.341866:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694541056:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334976.341933:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.341957:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849bed0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0083 expref: 21 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.341966:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334976.341969:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334976.341973:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.342017:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849bed0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000080000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0083 expref: 21 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.342034:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849bed0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0083 expref: 21 pid: 26216 timeout: 1140 lvb_type: 0 00000100:00100000:1.0:1763334976.342050:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701858560:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334976.342176:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334976.342214:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4908 00000100:00100000:1.0:1763334976.342222:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694541312:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334976.342245:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.342257:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bf6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00bb expref: 21 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.342264:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334976.342266:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334976.342268:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.342291:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bf6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00bb expref: 21 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.342300:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bf6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00bb expref: 21 pid: 6518 timeout: 1140 lvb_type: 0 00000100:00100000:1.0:1763334976.342310:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701858688:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334976.342335:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1763334976.343342:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694541184 00000100:00100000:0.0:1763334976.343356:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694541184 00000100:00100000:0.0:1763334976.343410:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4909 00000100:00100000:0.0:1763334976.343419:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694541184:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:0.0:1763334976.343457:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.343474:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bf55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00ad expref: 26 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.343482:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334976.343485:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334976.343487:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.343519:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bf55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00ad expref: 26 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.343530:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bf55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00ad expref: 26 pid: 6518 timeout: 1140 lvb_type: 0 00000100:00100000:0.0:1763334976.343545:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca873480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701858816:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334976.343636:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac382bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334976.353564:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.353649:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.353699:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694541440 00000100:00100000:1.0:1763334976.353712:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694541440 00010000:00010000:1.0:1763334976.353761:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849bed0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0083 expref: 22 pid: 26216 timeout: 1140 lvb_type: 0 00000100:00100000:1.0:1763334976.353799:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694541568 00000100:00100000:1.0:1763334976.353803:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694541568 00010000:00010000:1.0:1763334976.353816:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bf6a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00bb expref: 23 pid: 6518 timeout: 1140 lvb_type: 0 00000100:00100000:1.0:1763334976.353841:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2581 00000100:00100000:1.0:1763334976.353854:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694541440:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334976.353874:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763334976.353900:0:6532:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 47 -> 71 00010000:00010000:1.0:1763334976.353907:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849bed0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0083 expref: 23 pid: 26216 timeout: 1140 lvb_type: 0 00010000:00010000:1.0:1763334976.353920:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849bed0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0083 expref: 23 pid: 26216 timeout: 1140 lvb_type: 0 00010000:00010000:1.0:1763334976.353953:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.353956:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.353962:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.353973:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354000:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334976.354084:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694541440:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 231us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.354092:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2581 00000100:00100000:1.0:1763334976.354116:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2582 00000100:00100000:1.0:1763334976.354123:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694541568:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334976.354131:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334976.354143:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bf6a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00bb expref: 22 pid: 6518 timeout: 1140 lvb_type: 0 00010000:00010000:1.0:1763334976.354158:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bf6a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00bb expref: 22 pid: 6518 timeout: 1140 lvb_type: 0 00010000:00010000:1.0:1763334976.354170:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.354172:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.354176:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354184:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354195:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334976.354214:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694541568:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 92us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.354221:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2582 00000100:00100000:1.0:1763334976.354376:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.354395:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694541696 00000100:00100000:1.0:1763334976.354399:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694541696 00010000:00010000:1.0:1763334976.354417:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bf55 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00ad expref: 27 pid: 6518 timeout: 1140 lvb_type: 0 00000100:00100000:1.0:1763334976.354439:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2583 00000100:00100000:1.0:1763334976.354446:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694541696:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334976.354455:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334976.354471:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bf55 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00ad expref: 27 pid: 6518 timeout: 1140 lvb_type: 0 00010000:00010000:1.0:1763334976.354487:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bf55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00ad expref: 27 pid: 6518 timeout: 1140 lvb_type: 0 00010000:00010000:1.0:1763334976.354503:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.354505:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.354508:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354516:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354527:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334976.354546:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694541696:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 101us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.354552:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2583 00010000:00010000:1.0:1763334976.354629:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849bf55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00ad expref: 26 pid: 6518 timeout: 1140 lvb_type: 0 00000100:00100000:1.0:1763334976.354647:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca873480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701858816:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334976.354670:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354681:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354688:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354715:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354725:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354733:0:26216:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354740:0:26216:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334976.354745:0:26216:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354754:0:26216:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354766:0:26216:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.354774:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c051 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334976.354821:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694541184:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 11403us (13919us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.354829:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4909 00010000:00010000:2.0:1763334976.355468:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849bf6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00bb expref: 21 pid: 6518 timeout: 1140 lvb_type: 0 00000100:00100000:2.0:1763334976.355485:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a21180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701858688:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334976.355500:0:6518:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.355507:0:6518:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.355514:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.355541:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.355549:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.355555:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.355561:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334976.355563:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.355621:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.355634:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.355641:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c04a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334976.355713:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694541312:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 13490us (16783us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.355722:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4908 00010000:00010000:0.0:1763334976.355870:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849bed0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801480000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0083 expref: 19 pid: 26216 timeout: 1140 lvb_type: 0 00000100:00100000:0.0:1763334976.355882:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a21500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701858560:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334976.355896:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.355905:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.355912:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.355931:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.355940:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.355948:0:21625:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.355954:0:21625:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334976.355959:0:21625:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.355967:0:21625:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.355978:0:21625:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.355987:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c043 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334976.356023:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694541056:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 14161us (18221us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334976.356031:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4907 00010000:00010000:2.0:1763334976.359941:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334976.360794:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.361052:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694541824 00000100:00100000:0.0:1763334976.361076:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694541824 00000100:00100000:0.0:1763334976.361151:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4910 00000100:00100000:0.0:1763334976.361163:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2362:x1848989694541824:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334976.361188:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334976.361216:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c058 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b010f expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334976.361248:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 73013, mtime: 0x691a5b40, atime: 0x0, ctime: 0x691a5b40, blocks: 0x47 00010000:00010000:0.0:1763334976.361279:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.361282:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.361294:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b010f expref: 19 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334976.361321:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b010f expref: 19 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334976.361337:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334976.361427:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694541824:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 265us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334976.361435:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4910 00000100:00100000:3.0:1763334976.361529:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334976.361730:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.362129:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694541952 00000100:00100000:2.0:1763334976.362137:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694541952 00000100:00100000:2.0:1763334976.362177:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694542080 00000100:00100000:2.0:1763334976.362180:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694542080 00000100:00100000:2.0:1763334976.362203:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4911 00000100:00100000:2.0:1763334976.362211:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2362:x1848989694541952:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334976.362223:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334976.362240:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c05f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0116 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334976.362264:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x248:0x0] initial LVB size: 0, mtime: 0x691a5b40, atime: 0x0, ctime: 0x691a5b40, blocks: 0x1 00010000:00010000:2.0:1763334976.362277:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.362280:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.362287:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c05f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0116 expref: 26 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334976.362301:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c05f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0116 expref: 26 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334976.362313:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430e00, rc 0) 00000100:00100000:2.0:1763334976.362350:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6451f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694541952:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 140us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.362357:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4911 00000100:00100000:2.0:1763334976.362374:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4912 00000100:00100000:2.0:1763334976.362381:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694542080:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334976.362389:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334976.362401:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c066 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b011d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334976.362419:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x691a5b40, atime: 0x0, ctime: 0x691a5b40, blocks: 0x3 00010000:00010000:2.0:1763334976.362428:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.362430:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.362435:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c066 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b011d expref: 20 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334976.362446:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c066 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b011d expref: 20 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334976.362454:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431c00, rc 0) 00000100:00100000:2.0:1763334976.362473:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694542080:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 93us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.362479:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4912 00000100:00100000:3.0:1763334976.407821:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.408081:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694542208 00000100:00100000:0.0:1763334976.408095:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694542208 00000100:00100000:0.0:1763334976.412514:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1807 00000100:00100000:0.0:1763334976.412551:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694542208:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334976.412625:0:21630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c06d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.412648:0:21630:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.412651:0:21630:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.412658:0:21630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c06d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.412679:0:21630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c06d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.421557:0:21630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c06d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.421617:0:21630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c06d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.421633:0:21630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c06d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.421641:0:21630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334976.421647:0:21630:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c06d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.421659:0:21630:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c06d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.421685:0:21630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c06d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.421694:0:21630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c06d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334976.421810:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694542208:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 9269us (13998us total) trans 0 rc 73013/73013 00000100:00100000:0.0:1763334976.421823:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1807 00000100:00100000:2.0:1763334976.427226:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.428109:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694542336 00000100:00100000:0.0:1763334976.428128:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694542336 00000100:00100000:0.0:1763334976.428240:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1808 00000100:00100000:0.0:1763334976.428253:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694542336:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:0.0:1763334976.428304:0:21630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.428328:0:21630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c020 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00fa expref: 20 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334976.428339:0:21630:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.428342:0:21630:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.428348:0:21630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.428396:0:21630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c020 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00fa expref: 20 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334976.428413:0:21630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c020 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00fa expref: 20 pid: 26216 timeout: 1141 lvb_type: 1 00000100:00100000:0.0:1763334976.428432:0:21630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:21630:1848989701858944:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334976.428550:0:21630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac382bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1763334976.437717:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334976.437812:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694542464 00000100:00100000:3.0:1763334976.437827:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694542464 00010000:00010000:3.0:1763334976.437885:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c020 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00fa expref: 21 pid: 26216 timeout: 1141 lvb_type: 1 00000100:00100000:3.0:1763334976.437926:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2584 00000100:00100000:3.0:1763334976.437935:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694542464:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334976.437952:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334976.437978:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c020 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00fa expref: 21 pid: 26216 timeout: 1141 lvb_type: 1 00010000:00010000:3.0:1763334976.437992:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c020 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00fa expref: 21 pid: 26216 timeout: 1141 lvb_type: 1 00010000:00010000:3.0:1763334976.438024:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334976.438027:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334976.438033:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.438045:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.438082:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334976.438162:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694542464:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 226us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334976.438172:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2584 00010000:00010000:2.0:1763334976.439950:0:21630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c020 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00fa expref: 20 pid: 26216 timeout: 1141 lvb_type: 1 00000100:00100000:2.0:1763334976.439982:0:21630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871880 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:21630:1848989701858944:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334976.440018:0:21630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.440031:0:21630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.440039:0:21630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763334976.505718:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871156 is committed 00002000:00010000:2.0:1763334976.506002:0:21630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb size from disk: 0 -> 73013 00002000:00010000:2.0:1763334976.506009:0:21630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb mtime from disk: 0 -> 1763334977 00002000:00010000:2.0:1763334976.506012:0:21630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb ctime from disk: 0 -> 1763334977 00002000:00010000:2.0:1763334976.506015:0:21630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb blocks from disk: 1 -> 259 00010000:00010000:2.0:1763334976.506034:0:21630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.506050:0:21630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.506072:0:21630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.506080:0:21630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334976.506086:0:21630:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.506096:0:21630:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.506121:0:21630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.506129:0:21630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c074 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334976.506358:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694542336:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 78100us (79142us total) trans 17179871156 rc 0/0 00000100:00100000:2.0:1763334976.506375:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1808 00000100:00100000:0.0:1763334976.511021:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.511326:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694542592 00000100:00100000:1.0:1763334976.511341:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694542592 00000100:00100000:1.0:1763334976.511419:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4869 00000100:00100000:1.0:1763334976.511431:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+226:53645:x1848989694542592:12345-192.168.201.60@tcp:44:lfs.0 00000001:00080000:3.0:1763334976.581975:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939069 is committed 00000004:00080000:3.0:1763334976.582042:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 756 committed 00000001:00080000:3.0:1763334976.582064:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939070 is committed 00000004:00080000:3.0:1763334976.582115:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 744 committed 00000100:00100000:3.0:1763334976.582213:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701859072:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1763334976.582294:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334976.582608:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53645:x1848989694542592:12345-192.168.201.60@tcp:44:lfs.0 Request processed in 71175us (71597us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.582620:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4869 00000100:00100000:0.0:1763334976.583168:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701859072 00000100:00100000:0.0:1763334976.583177:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701859072 00000100:00100000:0.0:1763334976.583231:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4913 00000100:00100000:0.0:1763334976.583241:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3292:x1848989701859072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1763334976.583273:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:581 count 1 00002000:00010000:0.0:1763334976.583317:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x245:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334976.583327:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c07b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.583345:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.583348:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.583354:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c07b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.583371:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c07b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.583382:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c07b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.583389:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c07b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.583412:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334976.583813:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701859072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 573us (1518us total) trans 21474838432 rc 0/0 00000100:00100000:0.0:1763334976.583821:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4913 00010000:00010000:0.0:1763334976.583845:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334976.583853:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c07b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.583862:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334976.583867:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c07b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.583877:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c07b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.583897:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c07b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.583905:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c07b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x245:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.583921:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334976.583923:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334976.583924:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1763334976.583962:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac8418380/2, rc 0, transno 21474838432 00000100:00100000:0.0:1763334976.583969:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701859072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334976.585262:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763334976.585291:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701859200:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1763334976.585365:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334976.586422:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701859200 00000100:00100000:3.0:1763334976.586439:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701859200 00000100:00100000:3.0:1763334976.586608:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4914 00000100:00100000:3.0:1763334976.586620:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3290:x1848989701859200:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334976.586661:0:26216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:585 count 1 00002000:00010000:3.0:1763334976.586708:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x249:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334976.586718:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849c082 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.586737:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334976.586740:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334976.586747:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849c082 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.586763:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849c082 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.586774:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849c082 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.586787:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849c082 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.586806:0:26216:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1763334976.587356:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334976.587366:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849c082 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.587375:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334976.587380:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849c082 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.587390:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849c082 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.587410:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849c082 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.587417:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849c082 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.587439:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334976.587441:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334976.587443:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334976.589077:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+6:3290:x1848989701859200:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2449us (3701us total) trans 17179871157 rc 0/0 00000100:00100000:3.0:1763334976.589095:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4914 00000100:00100000:1.0:1763334976.589255:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.589358:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.589459:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694542720 00000100:00100000:0.0:1763334976.589471:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694542720 00000100:00100000:0.0:1763334976.589517:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694542848 00000100:00100000:0.0:1763334976.589520:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694542848 00000100:00100000:0.0:1763334976.589548:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4915 00000100:00100000:0.0:1763334976.589558:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694542720:12345-192.168.201.60@tcp:16:lfs.0 00000100:00100000:0.0:1763334976.589696:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694542720:12345-192.168.201.60@tcp:16:lfs.0 Request processed in 139us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334976.589704:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4915 00000100:00100000:0.0:1763334976.589720:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4916 00000100:00100000:0.0:1763334976.589728:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694542848:12345-192.168.201.60@tcp:16:lfs.0 00000100:00100000:0.0:1763334976.589776:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694542848:12345-192.168.201.60@tcp:16:lfs.0 Request processed in 49us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334976.589782:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4916 00000100:00100000:2.0:1763334976.590041:0:3290:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871137 gen 2 00000004:00080000:2.0:1763334976.590049:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5af800, transno 17179871135 00000004:00080000:2.0:1763334976.590079:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ae8d4f800, transno 17179871136 00000004:00080000:2.0:1763334976.590083:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa5adc00, transno 17179871137 00000100:00100000:2.0:1763334976.590094:0:3290:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a59ca872300 x1848989701859200/t17179871157(17179871157) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1763334992 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763334976.590109:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca872300/2, rc 0, transno 17179871157 00000100:00100000:2.0:1763334976.590116:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca872300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701859200:0@lo:6:osp-syn-1-0.0 00000004:00080000:1.0:1763334976.590438:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 1 in progress, 0 in flight, 3 done 00000100:00100000:1.0:1763334976.609045:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334976.609177:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694542976 00000100:00100000:3.0:1763334976.609192:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694542976 00000100:00100000:3.0:1763334976.609267:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4917 00000100:00100000:3.0:1763334976.609280:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2361:x1848989694542976:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:3.0:1763334976.609347:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c089 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.609367:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334976.609369:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334976.609376:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c089 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.609393:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c089 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.609433:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c089 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.609443:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c089 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.609458:0:26216:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c089 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.609466:0:26216:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334976.609470:0:26216:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c089 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.609480:0:26216:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c089 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.609497:0:26216:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c089 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.609504:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c089 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334976.611924:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2361:x1848989694542976:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 2629us (2878us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.611942:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4917 00000100:00100000:0.0:1763334976.614411:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.614481:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.614885:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694543104 00000100:00100000:2.0:1763334976.614899:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694543104 00000100:00100000:2.0:1763334976.615425:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694543232 00000100:00100000:2.0:1763334976.615430:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694543232 00000100:00100000:3.0:1763334976.615470:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4918 00000100:00100000:3.0:1763334976.615483:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694543104:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:3.0:1763334976.615538:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c090 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615556:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334976.615559:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334976.615564:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c090 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615601:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c090 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615640:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c090 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615648:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c090 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615656:0:32241:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c090 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615663:0:32241:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334976.615667:0:32241:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c090 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615675:0:32241:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c090 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615689:0:32241:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c090 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615695:0:32241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c090 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334976.615789:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694543104:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 309us (1389us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334976.615798:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4918 00000100:00100000:3.0:1763334976.615821:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4919 00000100:00100000:3.0:1763334976.615828:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694543232:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:3.0:1763334976.615847:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c097 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615856:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334976.615857:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334976.615860:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c097 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615870:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c097 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615888:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c097 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615895:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c097 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615901:0:32241:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615906:0:32241:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334976.615909:0:32241:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c097 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615921:0:32241:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c097 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615929:0:32241:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c097 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.615935:0:32241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c097 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334976.615963:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694543232:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 136us (1481us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334976.615969:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4919 00000100:00100000:2.0:1763334976.622342:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.622446:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694543488 00000100:00100000:1.0:1763334976.622462:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694543488 00000100:00100000:1.0:1763334976.622542:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4870 00000100:00100000:1.0:1763334976.622553:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53645:x1848989694543488:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334976.622663:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334976.622702:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c019 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1af:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00f3 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.622725:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1af:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:1.0:1763334976.622738:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334976.622800:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c09e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.622816:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c09e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.622827:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c09e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00010000:1.0:1763334976.623163:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005a3c7b52 reply state 00000000aa3e4c1c transno 8589939071 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c09e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334976.623174:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334976.623316:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53645:x1848989694543488:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 763us (989us total) trans 8589939071 rc 0/0 00000100:00100000:1.0:1763334976.623325:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4870 00000100:00100000:0.0:1763334976.630954:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334976.631080:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694543616 00000100:00100000:3.0:1763334976.631094:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694543616 00000100:00100000:3.0:1763334976.631171:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4871 00000100:00100000:3.0:1763334976.631182:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53645:x1848989694543616:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334976.631216:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334976.631245:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c0a5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0124 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.631334:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0124 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.631352:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0124 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.631378:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1af:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:3.0:1763334976.631382:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334976.631387:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:3.0:1763334976.631462:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53645:x1848989694543616:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 281us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334976.631470:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4871 00010000:00010000:1.0:1763334976.631756:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c09e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.631768:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c09e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.631776:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c09e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.631784:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334976.631789:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c09e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.631799:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c09e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.631814:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1af:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:1.0:1763334976.631816:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334976.631820:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c09e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.631827:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c09e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334976.635457:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.636444:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694543744 00000100:00100000:1.0:1763334976.636460:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694543744 00000100:00100000:2.0:1763334976.637162:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4920 00000100:00100000:2.0:1763334976.637180:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+19:53645:x1848989694543744:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334976.637205:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334976.637235:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c0ac lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b012b expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334976.637274:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24d:0x0] initial LVB size: 73013, mtime: 0x691a5b41, atime: 0x0, ctime: 0x691a5b41, blocks: 0x103 00010000:00010000:2.0:1763334976.637306:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.637309:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.637319:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c0ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b012b expref: 20 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.637338:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c0ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b012b expref: 20 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.637353:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430200, rc 0) 00000100:00100000:2.0:1763334976.637672:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+20:53645:x1848989694543744:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 496us (2235us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.637680:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4920 00000100:00100000:3.0:1763334976.640501:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.640677:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694543872 00000100:00100000:1.0:1763334976.640693:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694543872 00000100:00100000:1.0:1763334976.640767:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4921 00000100:00100000:1.0:1763334976.640779:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+26:53645:x1848989694543872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334976.640803:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334976.640830:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c0b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0132 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.640879:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c027 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0101 expref: 27 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334976.640888:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.640891:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.640896:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c0b3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0132 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.640942:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c027 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0101 expref: 27 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334976.640957:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c027 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0101 expref: 27 pid: 26216 timeout: 1141 lvb_type: 1 00000100:00100000:1.0:1763334976.640975:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701859328:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334976.641110:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334976.644556:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701859328:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334976.644632:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c0b3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0132 expref: 27 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.644661:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:1.0:1763334976.644789:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+27:53645:x1848989694543872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4011us (4300us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.644801:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4921 00000100:00100000:3.0:1763334976.647444:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.647716:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694544000 00000100:00100000:1.0:1763334976.647734:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694544000 00010000:00010000:1.0:1763334976.647791:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c027 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0101 expref: 27 pid: 26216 timeout: 1141 lvb_type: 1 00000100:00100000:1.0:1763334976.647843:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2585 00000100:00100000:1.0:1763334976.647854:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694544000:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334976.647875:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334976.647903:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c027 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0101 expref: 27 pid: 26216 timeout: 1141 lvb_type: 1 00010000:00010000:1.0:1763334976.647918:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c027 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0101 expref: 27 pid: 26216 timeout: 1141 lvb_type: 1 00010000:00010000:1.0:1763334976.647949:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c027 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0101 expref: 27 pid: 26216 timeout: 1141 lvb_type: 1 00010000:00010000:1.0:1763334976.647972:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.647974:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.647980:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c0b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0132 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.647990:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c0b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0132 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.648036:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c0b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0132 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334976.648070:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701859456:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334976.648196:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334976.651505:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334976.651548:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.651741:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701859456:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334976.651775:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334976.651842:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694544000:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 3989us (4415us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.651856:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2585 00000100:00100000:2.0:1763334976.651964:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694544128 00000100:00100000:2.0:1763334976.651974:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694544128 00000100:00100000:2.0:1763334976.652032:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4922 00000100:00100000:2.0:1763334976.652043:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694544128:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334976.652358:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb size from disk: 73013 -> 73013 00002000:00010000:2.0:1763334976.652363:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb mtime from disk: 1763334977 -> 1763334976 00002000:00010000:2.0:1763334976.652366:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb atime from disk: 0 -> 1763334976 00002000:00010000:2.0:1763334976.652369:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:2.0:1763334976.652371:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:2.0:1763334976.652406:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694544128:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 364us (915us total) trans 17179871158 rc 0/0 00000100:00100000:2.0:1763334976.652414:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4922 00000100:00100000:2.0:1763334976.652430:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694544256 00000100:00100000:2.0:1763334976.652433:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694544256 00000100:00100000:2.0:1763334976.652457:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4923 00000100:00100000:2.0:1763334976.652464:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694544256:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334976.652684:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334976.652688:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb mtime from disk: 0 -> 1763334976 00002000:00010000:2.0:1763334976.652690:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb atime from disk: 0 -> 1763334976 00002000:00010000:2.0:1763334976.652692:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb ctime from disk: 0 -> 1763334977 00002000:00010000:2.0:1763334976.652694:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334976.652718:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694544256:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 253us (1167us total) trans 21474838433 rc 0/0 00000100:00100000:2.0:1763334976.652724:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4923 00000100:00100000:0.0:1763334976.656096:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.656246:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694544512 00000100:00100000:1.0:1763334976.656261:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694544512 00000100:00100000:1.0:1763334976.656341:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4872 00000100:00100000:1.0:1763334976.656354:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53645:x1848989694544512:12345-192.168.201.60@tcp:55:lfs.0 00010000:00010000:1.0:1763334976.656452:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c0ba lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.656475:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c0ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.656490:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c0ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.656525:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c0ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.656532:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c0ba lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.656539:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c0ba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.656550:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334976.656555:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c0ba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.656564:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c0ba lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.656617:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1af:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:1.0:1763334976.656622:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1763334976.656629:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c0ba lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.656637:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c0ba lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334976.656738:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53645:x1848989694544512:12345-192.168.201.60@tcp:55:lfs.0 Request processed in 387us (658us total) trans 0 rc -22/-22 00000100:00100000:1.0:1763334976.656747:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4872 00000100:00100000:3.0:1763334976.659183:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.659295:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694544768 00000100:00100000:2.0:1763334976.659311:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694544768 00000100:00100000:2.0:1763334976.659388:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4873 00000100:00100000:2.0:1763334976.659399:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53645:x1848989694544768:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334976.659466:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334976.659499:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849bfbe lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00d7 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.659518:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334976.659524:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334976.659619:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c0c1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.659634:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334976.659645:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:2.0:1763334976.659853:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007d2160ac reply state 000000000a10b275 transno 8589939072 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334976.659865:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334976.659968:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53645:x1848989694544768:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 571us (799us total) trans 8589939072 rc 0/0 00000100:00100000:2.0:1763334976.659975:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4873 00010000:00010000:3.0:1763334976.663960:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c0c1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.663984:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c0c1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.663992:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c0c1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.663998:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334976.664003:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c0c1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.664012:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c0c1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.664033:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:3.0:1763334976.664038:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334976.664044:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c0c1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.664060:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c0c1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334976.664327:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.664462:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694544896 00000100:00100000:2.0:1763334976.664476:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694544896 00000100:00100000:2.0:1763334976.664542:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4924 00000100:00100000:2.0:1763334976.664554:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+21:53645:x1848989694544896:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334976.665115:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334976.665144:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c0c8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0139 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.665186:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c058 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b010f expref: 22 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334976.665196:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.665199:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.665204:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c0c8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0139 expref: 22 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.665250:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b010f expref: 22 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334976.665404:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c058 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b010f expref: 22 pid: 21625 timeout: 1141 lvb_type: 1 00000100:00100000:2.0:1763334976.665423:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701859584:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334976.665761:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bf9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334976.668461:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701859584:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334976.668512:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c0c8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0139 expref: 22 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.668540:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431a00, rc 0) 00000100:00100000:0.0:1763334976.668643:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+22:53645:x1848989694544896:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4090us (4322us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334976.668655:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4924 00000100:00100000:0.0:1763334976.669772:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.669945:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694545024 00000100:00100000:1.0:1763334976.669956:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694545024 00010000:00010000:1.0:1763334976.670001:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c058 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b010f expref: 22 pid: 21625 timeout: 1141 lvb_type: 1 00000100:00100000:1.0:1763334976.670041:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2586 00000100:00100000:1.0:1763334976.670062:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694545024:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334976.670083:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334976.670108:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c058 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b010f expref: 22 pid: 21625 timeout: 1141 lvb_type: 1 00010000:00010000:1.0:1763334976.670130:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c058 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b010f expref: 22 pid: 21625 timeout: 1141 lvb_type: 1 00010000:00010000:1.0:1763334976.670160:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c058 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b010f expref: 22 pid: 21625 timeout: 1141 lvb_type: 1 00010000:00010000:1.0:1763334976.670178:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.670180:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.670189:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c0c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0139 expref: 21 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.670200:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c0c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0139 expref: 21 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.670242:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c0c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0139 expref: 21 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334976.670267:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701859712:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334976.670356:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334976.674339:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701859712:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334976.674382:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334976.674463:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694545024:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4412us (4697us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.674476:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2586 00000100:00100000:2.0:1763334976.675161:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.675658:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694545152 00000100:00100000:0.0:1763334976.675670:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694545152 00000100:00100000:0.0:1763334976.675743:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4925 00000100:00100000:0.0:1763334976.675753:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:53645:x1848989694545152:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334976.675776:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334976.675803:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c0cf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0140 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.675846:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c05f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0116 expref: 28 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334976.675856:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.675858:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334976.675863:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c0cf lrc: 4/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0140 expref: 28 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.675916:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c05f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0116 expref: 28 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334976.675932:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c05f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0116 expref: 28 pid: 6518 timeout: 1141 lvb_type: 1 00000100:00100000:0.0:1763334976.675948:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701859840:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334976.676061:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac382bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334976.678482:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701859840:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334976.678534:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c0cf lrc: 3/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0140 expref: 28 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.678564:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:2.0:1763334976.678696:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+28:53645:x1848989694545152:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2942us (3536us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.678707:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4925 00000100:00100000:3.0:1763334976.679370:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.679549:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694545280 00000100:00100000:1.0:1763334976.679561:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694545280 00010000:00010000:1.0:1763334976.679636:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c05f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0116 expref: 28 pid: 6518 timeout: 1141 lvb_type: 1 00000100:00100000:1.0:1763334976.679680:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2587 00000100:00100000:1.0:1763334976.679692:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694545280:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334976.679710:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334976.679751:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c05f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0116 expref: 28 pid: 6518 timeout: 1141 lvb_type: 1 00010000:00010000:1.0:1763334976.679770:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c05f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0116 expref: 28 pid: 6518 timeout: 1141 lvb_type: 1 00010000:00010000:1.0:1763334976.679800:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c05f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0116 expref: 28 pid: 6518 timeout: 1141 lvb_type: 1 00010000:00010000:1.0:1763334976.679816:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.679818:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.679826:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c0cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0140 expref: 27 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.679837:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c0cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0140 expref: 27 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.679880:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c0cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0140 expref: 27 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334976.679903:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701859968:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334976.680001:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334976.682773:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701859968:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334976.682810:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334976.683109:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.683441:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694545408 00000100:00100000:2.0:1763334976.683453:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694545408 00000100:00100000:2.0:1763334976.683526:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4926 00000100:00100000:2.0:1763334976.683540:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+21:53645:x1848989694545408:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334976.683566:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334976.683618:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c0d6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0147 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.683659:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c066 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b011d expref: 22 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334976.683669:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.683672:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.683680:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c0d6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0147 expref: 22 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.683726:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c066 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b011d expref: 22 pid: 6518 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1763334976.683732:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694545280:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4037us (4361us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.683750:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2587 00010000:00010000:2.0:1763334976.683754:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c066 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b011d expref: 22 pid: 6518 timeout: 1141 lvb_type: 1 00000100:00100000:2.0:1763334976.683773:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701860096:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334976.683844:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bf9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334976.691767:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.692102:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694545536 00000100:00100000:1.0:1763334976.692116:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694545536 00010000:00010000:1.0:1763334976.692172:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c066 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b011d expref: 23 pid: 6518 timeout: 1141 lvb_type: 1 00000100:00100000:1.0:1763334976.692224:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2588 00000100:00100000:1.0:1763334976.692236:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694545536:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763334976.692406:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701860096:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334976.692447:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c0d6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0147 expref: 23 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.692472:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:2.0:1763334976.692566:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:53645:x1848989694545408:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 9029us (9458us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.692623:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4926 00010000:00010000:1.0:1763334976.693692:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334976.693819:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c066 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b011d expref: 22 pid: 6518 timeout: 1141 lvb_type: 1 00010000:00010000:2.0:1763334976.693839:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c066 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b011d expref: 22 pid: 6518 timeout: 1141 lvb_type: 1 00010000:00010000:2.0:1763334976.693870:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c066 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b011d expref: 22 pid: 6518 timeout: 1141 lvb_type: 1 00010000:00010000:2.0:1763334976.693888:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.693891:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.693898:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c0d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0147 expref: 21 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.693910:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c0d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0147 expref: 21 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.693960:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c0d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0147 expref: 21 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334976.693980:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701860224:192.168.201.60@tcp:105: 00000100:00100000:2.0:1763334976.694107:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bf9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334976.697108:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334976.698905:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.699563:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694545664 00000100:00100000:2.0:1763334976.699592:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694545664 00000100:00100000:2.0:1763334976.699668:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694545792 00000100:00100000:2.0:1763334976.699672:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694545792 00000100:00100000:2.0:1763334976.699712:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4927 00000100:00100000:2.0:1763334976.699724:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694545664:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334976.700020:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 73013 -> 73013 00002000:00010000:2.0:1763334976.700025:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334976.700028:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 0 -> 1763334976 00002000:00010000:2.0:1763334976.700030:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334976 -> 1763334977 00002000:00010000:2.0:1763334976.700033:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 71 -> 71 00000100:00100000:2.0:1763334976.700126:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694545664:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 403us (3031us total) trans 17179871159 rc 0/0 00000100:00100000:2.0:1763334976.700135:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4927 00000100:00100000:2.0:1763334976.700160:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4928 00000100:00100000:2.0:1763334976.700167:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694545792:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334976.700271:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334976.700274:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334976.700276:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 0 -> 1763334976 00002000:00010000:2.0:1763334976.700278:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334976 -> 1763334977 00002000:00010000:2.0:1763334976.700280:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334976.700303:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694545792:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 137us (1412us total) trans 21474838434 rc 0/0 00000100:00100000:2.0:1763334976.700310:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4928 00000100:00100000:0.0:1763334976.700443:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.700690:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701860224:192.168.201.60@tcp:105: 00010000:00010000:0.0:1763334976.700718:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334976.700754:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694545536:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 8520us (9003us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334976.700764:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2588 00000100:00100000:3.0:1763334976.700877:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694545920 00000100:00100000:3.0:1763334976.700883:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694545920 00000100:00100000:3.0:1763334976.700927:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4929 00000100:00100000:3.0:1763334976.700936:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694545920:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:3.0:1763334976.701087:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334976.701091:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334976.701094:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 0 -> 1763334976 00002000:00010000:3.0:1763334976.701096:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334976 -> 1763334977 00002000:00010000:3.0:1763334976.701099:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334976.701131:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694545920:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 196us (689us total) trans 17179871160 rc 0/0 00000100:00100000:3.0:1763334976.701138:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4929 00000100:00100000:0.0:1763334976.715197:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334976.715291:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694546176 00000100:00100000:3.0:1763334976.715306:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694546176 00000100:00100000:3.0:1763334976.715386:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1778 00000100:00100000:3.0:1763334976.715397:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c3768850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53645:x1848989694546176:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:3.0:1763334976.715503:0:29631:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1ab:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c035 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0108 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.715553:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334976.715568:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bf63 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00b4 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.715719:0:29631:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334976.720302:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bf63 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00b4 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.720333:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bf63 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00b4 expref: 192 pid: 32232 timeout: 1141 lvb_type: 0 00000100:00100000:2.0:1763334976.720354:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701860352:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334976.720503:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c9888300 going to sleep for 11 seconds 00000100:00100000:2.0:1763334976.725016:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701860352:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334976.725074:0:29631:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:0.0:1763334976.725234:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.725494:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694546304 00000100:00100000:2.0:1763334976.725505:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694546304 00010000:00010000:2.0:1763334976.725557:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bf63 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00b4 expref: 193 pid: 32232 timeout: 1141 lvb_type: 0 00000100:00100000:2.0:1763334976.725630:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2589 00000100:00100000:2.0:1763334976.725643:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2360:x1848989694546304:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334976.725669:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334976.725677:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bf63 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00b4 expref: 193 pid: 32232 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.725690:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bf63 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00b4 expref: 193 pid: 32232 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.725717:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849bf63 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00b4 expref: 193 pid: 32232 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.725736:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334976.725742:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334976.725753:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334976.725761:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334976.725794:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334976.725874:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694546304:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 233us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.725883:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2589 00010000:00010000:0.0:1763334976.726006:0:29631:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334976.726016:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334976.726063:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334976.726080:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c0a5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0124 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.726090:0:29631:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334976.726132:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0124 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.726147:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c0a5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0124 expref: 191 pid: 30972 timeout: 1141 lvb_type: 0 00000100:00100000:0.0:1763334976.726165:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701860480:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334976.726886:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac382b180 going to sleep for 11 seconds 00000100:00100000:2.0:1763334976.730840:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701860480:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334976.730886:0:29631:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:0.0:1763334976.730991:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.733186:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694546432 00000100:00100000:2.0:1763334976.733206:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694546432 00010000:00010000:2.0:1763334976.733274:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c0a5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0124 expref: 192 pid: 30972 timeout: 1141 lvb_type: 0 00000100:00100000:2.0:1763334976.733337:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2590 00000100:00100000:2.0:1763334976.733349:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2359:x1848989694546432:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334976.733371:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334976.733378:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c0a5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0124 expref: 192 pid: 30972 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.733393:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c0a5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0124 expref: 192 pid: 30972 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.733425:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c0a5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1af:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0124 expref: 192 pid: 30972 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.733450:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1af:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:2.0:1763334976.733457:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334976.733468:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334976.733477:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334976.733526:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334976.733632:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+191:2359:x1848989694546432:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 285us (2641us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.733641:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2590 00010000:00010000:0.0:1763334976.734224:0:29631:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334976.734235:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:0.0:1763334976.734791:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701860608:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334976.736276:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334976.738482:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701860608 00000100:00100000:1.0:1763334976.738496:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701860608 00000100:00100000:1.0:1763334976.738560:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1763334976.738586:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29631:x1848989701860608:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334976.738680:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29631:x1848989701860608:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 111us (2412us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.738688:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1763334976.738712:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c96eeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1763334976.738740:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe7100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701860608:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334976.738830:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701860736:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334976.738865:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334976.738887:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac382b180 going to sleep for 11 seconds 00000100:00100000:2.0:1763334976.738937:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701860736 00000100:00100000:2.0:1763334976.738951:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701860736 00000100:00100000:2.0:1763334976.739021:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1763334976.739032:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:29631:x1848989701860736:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334976.739500:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:29631:x1848989701860736:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 469us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.739511:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1763334976.740704:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701860736:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334976.740797:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701860864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334976.740847:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334976.740886:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac4d06480 going to sleep for 11 seconds 00000100:00100000:2.0:1763334976.740969:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701860864 00000100:00100000:2.0:1763334976.740976:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701860864 00000100:00100000:2.0:1763334976.741136:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1763334976.741145:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:29631:x1848989701860864:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334976.741241:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:29631:x1848989701860864:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 97us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.741249:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1763334976.741656:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa5af800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701860864:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334976.741700:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701860992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334976.741726:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334976.742379:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb6480 going to sleep for 11 seconds 00000100:00100000:2.0:1763334976.742772:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701860992 00000100:00100000:2.0:1763334976.742779:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701860992 00000100:00100000:2.0:1763334976.742816:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1763334976.742823:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29631:x1848989701860992:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334976.742887:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29631:x1848989701860992:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 65us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.742894:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1763334976.742990:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701860992:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334976.743045:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701861120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334976.743084:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334976.743105:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb6480 going to sleep for 11 seconds 00000100:00100000:2.0:1763334976.743331:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701861120 00000100:00100000:2.0:1763334976.743335:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701861120 00000100:00100000:2.0:1763334976.743353:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1763334976.743359:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29631:x1848989701861120:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334976.743411:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa766d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29631:x1848989701861120:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 52us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.743417:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1763334976.743807:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701861120:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334976.743848:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701861248:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334976.743873:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334976.744568:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb6480 going to sleep for 11 seconds 00000100:00100000:0.0:1763334976.745095:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701861248 00000100:00100000:0.0:1763334976.745103:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701861248 00000100:00100000:0.0:1763334976.745151:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1763334976.745159:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:29631:x1848989701861248:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334976.745239:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:29631:x1848989701861248:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 80us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334976.745246:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1763334976.745323:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701861248:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:1.0:1763334976.745678:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].9, 640 off36000 00000001:00080000:1.0:1763334976.745691:0:29631:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939073 00000100:00100000:1.0:1763334976.745760:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701861376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334976.745798:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334976.745826:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb6480 going to sleep for 11 seconds 00000100:00100000:3.0:1763334976.745880:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701861376 00000100:00100000:3.0:1763334976.745896:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701861376 00000100:00100000:3.0:1763334976.745977:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1763334976.745989:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+9:29631:x1848989701861376:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763334976.746372:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+10:29631:x1848989701861376:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 385us (572us total) trans 21474838435 rc 0/0 00000100:00100000:3.0:1763334976.746380:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1763334976.747107:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701861376:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334976.747152:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701861504:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334976.747201:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334976.747233:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c98889c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334976.747279:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701861504 00000100:00100000:3.0:1763334976.747288:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701861504 00000100:00100000:3.0:1763334976.747342:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1763334976.747352:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29631:x1848989701861504:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763334976.747698:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:29631:x1848989701861504:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 347us (495us total) trans 17179871161 rc 0/0 00000100:00100000:3.0:1763334976.747707:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1763334976.747980:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701861504:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1763334976.748130:0:29631:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939074 00010000:00010000:1.0:1763334976.748172:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748182:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748189:0:29631:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748195:0:29631:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334976.748199:0:29631:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748207:0:29631:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748222:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1af:0x0].0x0 (ffff9a5ad28fae00) 00010000:00010000:1.0:1763334976.748225:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1763334976.748230:0:29631:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748236:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c0e4 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1af:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748256:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748262:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748271:0:29631:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748276:0:29631:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334976.748279:0:29631:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748284:0:29631:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748293:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:1.0:1763334976.748295:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1763334976.748298:0:29631:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748304:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c0dd lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334976.748316:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:1.0:1763334976.748318:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334976.748324:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c035 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0108 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334976.748425:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c3768850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53645:x1848989694546176:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 33029us (33243us total) trans 8589939075 rc 0/0 00000100:00100000:1.0:1763334976.748435:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1778 00000020:00080000:1.0:1763334976.748441:0:29631:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1763334976.756962:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.757040:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694546560 00000100:00100000:1.0:1763334976.757059:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694546560 00000100:00100000:1.0:1763334976.757125:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4874 00000100:00100000:1.0:1763334976.757136:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53645:x1848989694546560:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334976.757160:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334976.757186:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c0eb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b014e expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.757261:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c0eb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b014e expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.757276:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c0eb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b014e expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.757296:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa200) 00010000:00010000:1.0:1763334976.757300:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334976.757303:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334976.757360:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53645:x1848989694546560:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 226us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.757367:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4874 00000100:00100000:2.0:1763334976.767405:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.767503:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694546816 00000100:00100000:1.0:1763334976.767514:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694546816 00000100:00100000:1.0:1763334976.767602:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1779 00000100:00100000:1.0:1763334976.767612:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53645:x1848989694546816:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334976.767838:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53645:x1848989694546816:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 227us (441us total) trans 8589939076 rc 0/0 00000100:00100000:1.0:1763334976.767846:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1779 00000100:00100000:0.0:1763334976.771124:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334976.771819:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694547072 00000100:00100000:3.0:1763334976.771830:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694547072 00000100:00100000:3.0:1763334976.771888:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1780 00000100:00100000:3.0:1763334976.771898:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53645:x1848989694547072:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:3.0:1763334976.772277:0:29630:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x1af:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:3.0:1763334976.772395:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c0f2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334976.772412:0:29630:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334976.772424:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c0f2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334976.772431:0:29630:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c0f2 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334976.772437:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c0f2 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334976.772443:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c0f2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334976.772467:0:29630:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334976.772607:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53645:x1848989694547072:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 706us (1485us total) trans 8589939077 rc 0/0 00000100:00100000:3.0:1763334976.772615:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1780 00010000:00010000:2.0:1763334976.772724:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334976.772731:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c0f2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334976.772738:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334976.772741:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c0f2 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334976.772748:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c0f2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334976.772758:0:5737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1af:0x0].0x0 (ffff9a5af66dec00) 00010000:00010000:2.0:1763334976.772762:0:5737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763334976.772766:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c0f2 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334976.772771:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c0f2 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1af:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334976.772789:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334976.772791:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334976.772792:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334976.801633:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334976.801748:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694547200 00000100:00100000:3.0:1763334976.801758:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694547200 00000100:00100000:3.0:1763334976.801812:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4875 00000100:00100000:3.0:1763334976.801821:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53646:x1848989694547200:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334976.801842:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334976.801861:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c0f9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0155 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.801920:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c100 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.801933:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c100 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.801943:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c100 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.801956:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c107 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.801963:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c107 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.801969:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c107 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802076:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c10e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802084:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c10e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802090:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c10e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334976.802118:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 73013 00000004:00200000:3.0:1763334976.802122:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334976.802136:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c10e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802148:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c10e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802155:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c100 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802162:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c100 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802169:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c100 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802174:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334976.802178:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c100 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802184:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c100 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802195:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:3.0:1763334976.802198:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334976.802201:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c100 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802207:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c100 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802218:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c107 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802223:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c107 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802228:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c107 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802233:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334976.802236:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c107 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802242:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c107 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802248:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5af66ded00) 00010000:00010000:3.0:1763334976.802250:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334976.802253:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c107 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802258:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c107 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334976.802282:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c0f9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0155 expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.802293:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c10e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0155 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.802300:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa200) 00010000:00010000:3.0:1763334976.802302:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334976.802304:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:3.0:1763334976.802360:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53646:x1848989694547200:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 540us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334976.802368:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4875 00000100:00100000:0.0:1763334976.807993:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.808087:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694547456 00000100:00100000:1.0:1763334976.808097:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694547456 00000100:00100000:1.0:1763334976.808150:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4876 00000100:00100000:1.0:1763334976.808161:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53646:x1848989694547456:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334976.808181:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334976.808201:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849c115 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b015c expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.808293:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c11c lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.808308:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c11c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.808319:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c11c lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334976.808331:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 73013 00010000:00010000:1.0:1763334976.808453:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849c115 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b015c expref: 199 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.808471:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c11c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b015c expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.808481:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa200) 00010000:00010000:1.0:1763334976.808484:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763334976.808487:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334976.808548:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53646:x1848989694547456:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 390us (566us total) trans 8589939078 rc 0/0 00000100:00100000:1.0:1763334976.808556:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4876 00000100:00100000:0.0:1763334976.811388:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.811468:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694547712 00000100:00100000:1.0:1763334976.811479:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694547712 00000100:00100000:1.0:1763334976.811534:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4877 00000100:00100000:1.0:1763334976.811543:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53646:x1848989694547712:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334976.811600:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334976.811623:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c12a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0163 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.811734:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c131 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.811748:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c131 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.811757:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c131 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334976.811768:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 73013 00010000:00010000:1.0:1763334976.811877:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c12a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0163 expref: 201 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.811893:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c131 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0163 expref: 200 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.811902:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa200) 00010000:00010000:1.0:1763334976.811904:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334976.811908:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334976.811958:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53646:x1848989694547712:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 416us (578us total) trans 8589939079 rc 0/0 00000100:00100000:1.0:1763334976.811966:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4877 00000100:00100000:0.0:1763334976.866906:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.867065:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694547840 00000100:00100000:2.0:1763334976.867082:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694547840 00000100:00100000:2.0:1763334976.867182:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1809 00000100:00100000:2.0:1763334976.867197:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694547840:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334976.867248:0:21630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.867273:0:21630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c0c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0139 expref: 23 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.867283:0:21630:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334976.867285:0:21630:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334976.867290:0:21630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.867337:0:21630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c0c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0139 expref: 23 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.867355:0:21630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c0c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0139 expref: 23 pid: 26216 timeout: 1141 lvb_type: 0 00000100:00100000:2.0:1763334976.867374:0:21630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca873480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:21630:1848989701861632:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334976.867506:0:21630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c25a8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334976.873025:0:21630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca873480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_007:lustre-OST0001_UUID:21630:1848989701861632:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334976.873081:0:21630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334976.875030:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.875346:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694547968 00000100:00100000:2.0:1763334976.875360:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694547968 00010000:00010000:2.0:1763334976.875412:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c0c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0139 expref: 24 pid: 26216 timeout: 1141 lvb_type: 0 00000100:00100000:2.0:1763334976.875459:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2591 00000100:00100000:2.0:1763334976.875471:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694547968:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334976.875490:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334976.875519:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c0c8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0139 expref: 24 pid: 26216 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.875541:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c0c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0139 expref: 24 pid: 26216 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.875618:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c0c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0139 expref: 24 pid: 26216 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.875640:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.875642:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334976.875648:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.875660:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.875702:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334976.875777:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694547968:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 307us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.875786:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2591 00010000:00010000:0.0:1763334976.876301:0:21630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.876317:0:21630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.880331:0:21630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.880351:0:21630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.880361:0:21630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.880368:0:21630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334976.880373:0:21630:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.880381:0:21630:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.880397:0:21630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.880402:0:21630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c13f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21630 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334976.880482:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694547840:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 13282us (13584us total) trans 0 rc 73013/73013 00000100:00100000:2.0:1763334976.880496:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1809 00000100:00100000:1.0:1763334976.884767:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.884821:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334976.884913:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694548096 00000100:00100000:3.0:1763334976.884927:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694548096 00000100:00100000:3.0:1763334976.885383:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694548224 00000100:00100000:3.0:1763334976.885389:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694548224 00000100:00100000:2.0:1763334976.885453:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4930 00000100:00100000:2.0:1763334976.885468:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694548096:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334976.885491:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334976.885516:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c146 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b016a expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334976.885712:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4931 00000100:00100000:0.0:1763334976.885724:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2361:x1848989694548224:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334976.885733:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334976.885745:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c14d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0171 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334976.885796:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701861760:192.168.201.60@tcp:106: 00000100:00100000:2.0:1763334976.886021:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca873480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701861888:192.168.201.60@tcp:106: 00000100:00100000:0.0:1763334976.886140:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c96eed80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334976.886201:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c25a8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1763334976.889701:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec59880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701861760:192.168.201.60@tcp:106: 00010000:00010000:1.0:1763334976.889759:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c14d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0171 expref: 29 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334976.889791:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c14d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0171 expref: 29 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334976.889809:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:3.0:1763334976.889824:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca873480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701861888:192.168.201.60@tcp:106: 00010000:00010000:3.0:1763334976.889880:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c146 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b016a expref: 23 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334976.889909:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c146 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b016a expref: 23 pid: 21625 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1763334976.889910:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2361:x1848989694548224:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4184us (5083us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334976.889944:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4931 00010000:00010000:3.0:1763334976.889946:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431a00, rc 0) 00000100:00100000:3.0:1763334976.890003:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694548096:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4538us (5251us total) trans 0 rc 301/301 00000100:00100000:3.0:1763334976.890012:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4930 00000100:00100000:1.0:1763334976.898163:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.898396:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694548352 00000100:00100000:2.0:1763334976.898409:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694548352 00000100:00100000:1.0:1763334976.898854:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1810 00000100:00100000:1.0:1763334976.898868:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694548352:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:1.0:1763334976.898914:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.898935:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c0ac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b012b expref: 22 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.898944:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334976.898946:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334976.898950:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.898992:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c0ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b012b expref: 22 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.899011:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c0ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b012b expref: 22 pid: 26216 timeout: 1141 lvb_type: 0 00000100:00100000:1.0:1763334976.899027:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701862016:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334976.899153:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334976.903102:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701862016:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334976.903140:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334976.904729:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334976.904828:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694548480 00000100:00100000:3.0:1763334976.904847:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694548480 00010000:00010000:3.0:1763334976.904887:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c0ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b012b expref: 23 pid: 26216 timeout: 1141 lvb_type: 0 00000100:00100000:3.0:1763334976.905236:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2592 00000100:00100000:3.0:1763334976.905248:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694548480:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334976.905264:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334976.905286:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c0ac lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b012b expref: 23 pid: 26216 timeout: 1141 lvb_type: 0 00010000:00010000:3.0:1763334976.905300:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c0ac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b012b expref: 23 pid: 26216 timeout: 1141 lvb_type: 0 00010000:00010000:3.0:1763334976.905323:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c0ac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b012b expref: 23 pid: 26216 timeout: 1141 lvb_type: 0 00010000:00010000:3.0:1763334976.905347:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334976.905349:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334976.905355:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.905367:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334976.907364:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334976.907412:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.907429:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334976.907470:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694548480:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 2220us (2744us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334976.907483:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2592 00010000:00010000:2.0:1763334976.916249:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.916269:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.916279:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.916342:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334976.916347:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.916356:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.916451:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334976.916460:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c154 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->73727] (req 0->73727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334976.917769:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694548352:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 18895us (19619us total) trans 0 rc 73013/73013 00000100:00100000:2.0:1763334976.917781:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1810 00000100:00100000:3.0:1763334976.936386:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.936621:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694548608 00000100:00100000:1.0:1763334976.936635:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694548608 00000100:00100000:1.0:1763334976.936727:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 396 00000100:00100000:1.0:1763334976.936740:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53646:x1848989694548608:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:1.0:1763334976.936761:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334976.936794:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c131 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0163 expref: 200 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.936816:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa200) 00010000:00010000:1.0:1763334976.936822:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334976.936887:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53646:x1848989694548608:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 150us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.936894:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 396 00000100:00100000:3.0:1763334976.940837:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.940984:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694548864 00000100:00100000:0.0:1763334976.940997:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694548864 00000100:00100000:0.0:1763334976.941517:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1781 00000100:00100000:0.0:1763334976.941530:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53646:x1848989694548864:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334976.941989:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53646:x1848989694548864:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 462us (1166us total) trans 8589939080 rc 0/0 00000100:00100000:0.0:1763334976.941997:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1781 00000100:00100000:0.0:1763334976.949357:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.949604:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694549120 00000100:00100000:1.0:1763334976.949619:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694549120 00000100:00100000:1.0:1763334976.949692:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4878 00000100:00100000:1.0:1763334976.949702:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53644:x1848989694549120:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334976.949733:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334976.949758:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c15b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0178 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.949879:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.949897:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c10e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0155 expref: 201 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.949907:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.949950:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c10e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0155 expref: 201 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.949965:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c10e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0155 expref: 201 pid: 30972 timeout: 1141 lvb_type: 0 00000100:00100000:1.0:1763334976.949982:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701862144:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334976.950178:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334976.953345:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701862144:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334976.953385:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334976.955289:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.956344:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694549248 00000100:00100000:2.0:1763334976.956360:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694549248 00010000:00010000:2.0:1763334976.956416:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c10e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0155 expref: 202 pid: 30972 timeout: 1141 lvb_type: 0 00000100:00100000:2.0:1763334976.957558:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2593 00000100:00100000:2.0:1763334976.957603:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+202:2360:x1848989694549248:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334976.957626:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334976.957635:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c10e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0155 expref: 202 pid: 30972 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.957651:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c10e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0155 expref: 202 pid: 30972 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.957680:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c10e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0155 expref: 202 pid: 30972 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.957701:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa200) 00010000:00010000:2.0:1763334976.957708:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.957719:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.957727:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.957759:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334976.957848:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+201:2360:x1848989694549248:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 277us (2572us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.957855:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2593 00010000:00010000:0.0:1763334976.957933:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334976.957942:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334976.957966:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 73013 00010000:00010000:0.0:1763334976.958202:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c15b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0178 expref: 202 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.958245:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0178 expref: 201 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.958253:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa200) 00010000:00010000:0.0:1763334976.958255:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763334976.958258:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478800, rc 0) 00000100:00100000:0.0:1763334976.958407:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53644:x1848989694549120:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 8706us (9065us total) trans 8589939081 rc 0/0 00000100:00100000:0.0:1763334976.958416:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4878 00000100:00100000:0.0:1763334976.967691:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.967768:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694549376 00000100:00100000:1.0:1763334976.967785:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694549376 00000100:00100000:1.0:1763334976.967866:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4879 00000100:00100000:1.0:1763334976.967879:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53644:x1848989694549376:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334976.967911:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334976.967941:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c170 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b017f expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.968060:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c177 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.968079:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0178 expref: 202 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.968089:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c177 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.968142:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0178 expref: 202 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334976.968160:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0178 expref: 202 pid: 32232 timeout: 1141 lvb_type: 0 00000100:00100000:1.0:1763334976.968178:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701862272:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334976.968300:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334976.977929:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701862272:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334976.977973:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c177 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334976.978120:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334976.978634:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694549504 00000100:00100000:2.0:1763334976.978647:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694549504 00010000:00010000:2.0:1763334976.978695:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0178 expref: 203 pid: 32232 timeout: 1141 lvb_type: 0 00000100:00100000:2.0:1763334976.978737:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2594 00000100:00100000:2.0:1763334976.978746:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+203:2360:x1848989694549504:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334976.978767:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334976.978773:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0178 expref: 203 pid: 32232 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.978786:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0178 expref: 203 pid: 32232 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.978810:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c162 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0178 expref: 203 pid: 32232 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334976.978834:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa200) 00010000:00010000:2.0:1763334976.978839:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c177 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.978851:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c177 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.978859:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c177 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334976.978890:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334976.978958:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+202:2360:x1848989694549504:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 213us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334976.978966:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2594 00010000:00010000:0.0:1763334976.979461:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c177 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334976.979472:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c177 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334976.979524:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 73013 00000004:00200000:0.0:1763334976.979529:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334976.979550:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c177 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334976.979610:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c170 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b017f expref: 202 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.979626:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c177 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b017f expref: 201 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.979634:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa200) 00010000:00010000:0.0:1763334976.979637:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334976.979639:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:0.0:1763334976.979687:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53644:x1848989694549376:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 11812us (12007us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334976.979694:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4879 00000100:00100000:3.0:1763334976.982296:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334976.982353:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334976.982462:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694549632 00000100:00100000:1.0:1763334976.982476:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694549632 00000100:00100000:1.0:1763334976.982543:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694549760 00000100:00100000:1.0:1763334976.982547:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694549760 00000100:00100000:1.0:1763334976.982611:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4932 00000100:00100000:1.0:1763334976.982623:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694549632:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334976.982647:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334976.982673:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c17e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0186 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334976.982702:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24d:0x0] initial LVB size: 73013, mtime: 0x691a5b40, atime: 0x691a5b40, ctime: 0x691a5b41, blocks: 0x103 00010000:00010000:1.0:1763334976.982726:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.982729:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334976.982739:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c17e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0186 expref: 22 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334976.982758:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c17e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0186 expref: 22 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334976.982774:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334976.982838:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694549632:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 217us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334976.982845:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4932 00000100:00100000:1.0:1763334976.982866:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4933 00000100:00100000:1.0:1763334976.982873:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694549760:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334976.982881:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334976.982893:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c185 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b018d expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334976.982949:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701862400:192.168.201.60@tcp:106: 00000100:00100000:1.0:1763334976.983017:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bb69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334976.989429:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1ff800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701862400:192.168.201.60@tcp:106: 00010000:00010000:1.0:1763334976.989480:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c185 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b018d expref: 29 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334976.989507:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c185 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b018d expref: 29 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334976.989521:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334976.989638:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb347450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694549760:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 6763us (7282us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334976.989648:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4933 00000100:00100000:3.0:1763334976.993039:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334976.993170:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694550016 00000100:00100000:0.0:1763334976.993185:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694550016 00000100:00100000:0.0:1763334976.993267:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4880 00000100:00100000:0.0:1763334976.993279:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53644:x1848989694550016:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:0.0:1763334976.993351:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334976.993388:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c177 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b017f expref: 201 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334976.993413:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa200) 00010000:00010000:0.0:1763334976.993419:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334976.993764:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c18c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334976.993782:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c18c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334976.993797:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c18c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:0.0:1763334976.993864:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939082 00000004:00010000:0.0:1763334976.993892:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d3c5f60e reply state 000000006825909d transno 8589939083 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c18c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334976.993903:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334976.994026:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694550016:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 748us (999us total) trans 8589939083 rc 0/0 00000100:00100000:0.0:1763334976.994034:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4880 00000020:00080000:0.0:1763334976.994040:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763334976.996666:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c18c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.996685:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c18c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.996693:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c18c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.996700:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334976.996705:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c18c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.996714:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c18c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.996733:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa200) 00010000:00010000:1.0:1763334976.996736:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334976.996741:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c18c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334976.996747:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c18c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334976.999200:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.000081:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694550272 00000100:00100000:0.0:1763334977.000097:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694550272 00000100:00100000:0.0:1763334977.000215:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1782 00000100:00100000:0.0:1763334977.000229:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53644:x1848989694550272:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:0.0:1763334977.000547:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694550272:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 321us (1361us total) trans 8589939084 rc 0/0 00000100:00100000:0.0:1763334977.000556:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1782 00000100:00100000:3.0:1763334977.002372:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.003030:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694550528 00000100:00100000:2.0:1763334977.003052:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694550528 00000100:00100000:2.0:1763334977.003683:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4881 00000100:00100000:2.0:1763334977.003699:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694550528:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334977.003729:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334977.003733:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1763334977.003768:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c11c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b015c expref: 203 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.003790:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c0eb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b014e expref: 202 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.003802:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa200) 00010000:00010000:2.0:1763334977.003814:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334977.003833:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c193 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0194 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.003894:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c19a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.003909:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c19a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.003920:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c19a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:2.0:1763334977.004453:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1145, 88 off97952 00000004:00080000:2.0:1763334977.004466:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1041637893657ns, next at 1040839994511ns, rc = 0 00000100:00080000:0.0:1763334977.004554:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1763334977.004867:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1134, 88 off96864 00000004:00080000:2.0:1763334977.004874:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1041638302238ns, next at 1040839334561ns, rc = 0 00000040:00080000:2.0:1763334977.004945:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1135, 88 off96952 00000004:00080000:2.0:1763334977.004950:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1041638378403ns, next at 1040839334561ns, rc = 0 00000040:00080000:2.0:1763334977.005087:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1146, 88 off98040 00000004:00080000:2.0:1763334977.005097:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1041638524880ns, next at 1040839994511ns, rc = 0 00000040:00080000:2.0:1763334977.005128:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1147, 88 off98128 00000004:00080000:2.0:1763334977.005132:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1041638560470ns, next at 1040839994511ns, rc = 0 00000040:00080000:2.0:1763334977.005147:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1136, 88 off97040 00000004:00080000:2.0:1763334977.005153:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1041638580803ns, next at 1040839334561ns, rc = 0 00000001:00080000:3.0:1763334977.038101:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939084 is committed 00000020:00080000:3.0:1763334977.038157:0:32265:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a59c26a7a80 refcount 2 committed 0 result 0 batchid 4294969315 00000020:00080000:3.0:1763334977.038164:0:32265:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5ac83a9500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a5ad9672d80 00000020:00080000:3.0:1763334977.038169:0:32265:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5ac83a9700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a59c26a7d80 00000020:00080000:3.0:1763334977.038172:0:32265:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5ac83a9b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a5aec73ec00 00000020:00080000:3.0:1763334977.038175:0:32265:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].9 00000001:00080000:3.0:1763334977.038206:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939085 is committed 00000004:00080000:3.0:1763334977.038211:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 747 committed 00000004:00080000:3.0:1763334977.038222:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 759 committed 00000004:00080000:3.0:1763334977.038231:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 758 committed 00000004:00080000:3.0:1763334977.038233:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 746 committed 00000004:00080000:3.0:1763334977.038236:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 745 committed 00000004:00080000:3.0:1763334977.038238:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 757 committed 00000100:00100000:3.0:1763334977.038431:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701862656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334977.038530:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334977.038610:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763334977.038616:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701862784:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334977.038638:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334977.038738:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701863168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334977.038761:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334977.038797:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701862656 00000100:00100000:3.0:1763334977.038807:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701862656 00000100:00100000:3.0:1763334977.038867:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701862784 00000100:00100000:3.0:1763334977.038869:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701862784 00000100:00100000:3.0:1763334977.038883:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701863168 00000100:00100000:3.0:1763334977.038885:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701863168 00000100:00100000:3.0:1763334977.038907:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4934 00000100:00100000:3.0:1763334977.038916:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701862656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334977.039171:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334977.039175:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334977.039178:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334977.039181:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:3.0:1763334977.039183:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334977.039230:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701862656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 315us (701us total) trans 17179871162 rc 0/0 00000100:00100000:3.0:1763334977.039239:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4934 00000100:00100000:3.0:1763334977.039260:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4935 00000100:00100000:3.0:1763334977.039266:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701862784:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334977.039340:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb size from disk: 73013 -> 73013 00002000:00010000:3.0:1763334977.039343:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334977.039345:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334977.039348:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:3.0:1763334977.039350:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:3.0:1763334977.039373:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701862784:12345-0@lo:2:osp-syn-1-0.0 Request processed in 107us (733us total) trans 17179871163 rc 0/0 00000100:00100000:3.0:1763334977.039380:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4935 00000100:00100000:3.0:1763334977.039392:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4936 00000100:00100000:3.0:1763334977.039398:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701863168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334977.039497:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334977.039500:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334977.039502:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334977.039504:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:3.0:1763334977.039506:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334977.039530:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701863168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 132us (768us total) trans 21474838436 rc 0/0 00000100:00100000:3.0:1763334977.039536:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4936 00000004:00080000:3.0:1763334977.039621:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d4e00/2, rc 0, transno 21474838436 00000100:00100000:3.0:1763334977.039627:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701863168:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334977.039640:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d5c00/2, rc 0, transno 17179871163 00000100:00100000:3.0:1763334977.039644:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701862784:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334977.039652:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5502d80/2, rc 0, transno 17179871162 00000100:00100000:3.0:1763334977.039655:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701862656:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1763334977.039742:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969315 committed batchid 4294969314 00000020:00080000:0.0:1763334977.039937:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969314 00000100:00080000:0.0:1763334977.039956:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1763334977.039961:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1763334977.040169:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c19a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0194 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.040185:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334977.040188:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334977.040208:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c193 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0194 expref: 189 pid: 30972 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763334977.040228:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c19a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0194 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.040261:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334977.040263:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334977.040266:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431a00, rc 0) 00000100:00100000:2.0:1763334977.040331:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694550528:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 36637us (37970us total) trans 8589939085 rc 0/0 00000100:00100000:2.0:1763334977.040339:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4881 00000100:00100000:2.0:1763334977.040375:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701862528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334977.040422:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334977.040460:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701863040:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334977.040483:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334977.040509:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763334977.040516:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701862912:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334977.040536:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334977.040623:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701862528 00000100:00100000:2.0:1763334977.040630:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701862528 00000100:00100000:2.0:1763334977.040671:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701863040 00000100:00100000:2.0:1763334977.040674:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701863040 00000100:00100000:2.0:1763334977.040692:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701862912 00000100:00100000:2.0:1763334977.040695:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701862912 00000100:00100000:2.0:1763334977.040717:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4937 00000100:00100000:2.0:1763334977.040725:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3290:x1848989701862528:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334977.040920:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3290:x1848989701862528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (497us total) trans 17179871164 rc 0/0 00000100:00100000:2.0:1763334977.040930:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4937 00000100:00100000:2.0:1763334977.040944:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4938 00000100:00100000:2.0:1763334977.040949:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3290:x1848989701863040:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334977.041062:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334977.041065:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334977.041067:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334977.041070:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:2.0:1763334977.041072:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334977.041096:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3290:x1848989701863040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (612us total) trans 21474838437 rc 0/0 00000100:00100000:2.0:1763334977.041102:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4938 00000100:00100000:2.0:1763334977.041113:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4939 00000100:00100000:2.0:1763334977.041118:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3290:x1848989701862912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334977.041190:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334977.041193:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334977.041196:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334977.041198:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334977.041200:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334977.041222:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3290:x1848989701862912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (685us total) trans 21474838438 rc 0/0 00000100:00100000:2.0:1763334977.041229:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4939 00000004:00080000:2.0:1763334977.041296:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d6d80/2, rc 0, transno 21474838438 00000100:00100000:2.0:1763334977.041303:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701862912:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334977.041313:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5502a00/2, rc 0, transno 17179871164 00000100:00100000:2.0:1763334977.041317:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701862528:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763334977.041324:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d4a80/2, rc 0, transno 21474838437 00000100:00100000:2.0:1763334977.041327:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701863040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334977.046727:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.046840:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694550656 00000100:00100000:0.0:1763334977.046855:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694550656 00000100:00100000:0.0:1763334977.046956:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4940 00000100:00100000:0.0:1763334977.046968:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+22:53644:x1848989694550656:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334977.046993:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334977.047024:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c1a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b019b expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334977.047070:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 73013, mtime: 0x691a5b40, atime: 0x691a5b40, ctime: 0x691a5b41, blocks: 0x47 00010000:00010000:0.0:1763334977.047102:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334977.047105:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334977.047116:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b019b expref: 23 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.047137:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b019b expref: 23 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.047154:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334977.047230:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+23:53644:x1848989694550656:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 264us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334977.047243:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4940 00000100:00080000:2.0:1763334977.047321:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763334977.051530:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.052193:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.052221:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694550784 00000100:00100000:2.0:1763334977.052236:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694550784 00002000:00010000:2.0:1763334977.052304:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (117504->18446744073709551615) 00002000:00100000:2.0:1763334977.052309:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d7100 with x1848989694550784 ext(117504->18446744073709551615) 00002000:00010000:2.0:1763334977.052328:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d7100. 00000100:00100000:2.0:1763334977.052374:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1811 00000100:00100000:2.0:1763334977.052385:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694550784:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334977.052741:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 73013 -> 117504 00002000:00010000:2.0:1763334977.052746:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334976 -> 1763334977 00002000:00010000:2.0:1763334977.052748:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334977.052750:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:2.0:1763334977.052753:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 71 -> 71 00000100:00100000:0.0:1763334977.053054:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694551040 00000100:00100000:0.0:1763334977.053059:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694551040 00002000:00010000:0.0:1763334977.053080:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334977.053085:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d5500 with x1848989694551040 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334977.053092:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d5500. 00000100:00100000:0.0:1763334977.053117:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1812 00000100:00100000:0.0:1763334977.053125:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694551040:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334977.053242:0:21630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334977.053245:0:21630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334976 -> 1763334977 00002000:00010000:0.0:1763334977.053249:0:21630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334977.053251:0:21630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:0.0:1763334977.053253:0:21630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334977.054466:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694550784:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 2072us (2943us total) trans 17179871165 rc 0/0 00000100:00100000:2.0:1763334977.054483:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1811 00002000:00010000:2.0:1763334977.054490:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (117504->18446744073709551615) 00002000:00100000:2.0:1763334977.054494:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d7100 with x1848989694550784 ext(117504->18446744073709551615) 00002000:00010000:2.0:1763334977.054504:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d7100. 00000100:00100000:3.0:1763334977.054863:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.055234:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694550912 00000100:00100000:2.0:1763334977.055245:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694550912 00002000:00010000:2.0:1763334977.055297:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:2.0:1763334977.055301:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c7480 with x1848989694550912 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334977.055311:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c58c7480. 00000100:00100000:2.0:1763334977.055335:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1813 00000100:00100000:2.0:1763334977.055346:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694550912:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334977.055648:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334977.055652:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334976 -> 1763334977 00002000:00010000:2.0:1763334977.055655:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334977.055657:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:2.0:1763334977.055660:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334977.057688:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694551040:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 4546us (5480us total) trans 17179871166 rc 0/0 00000100:00100000:0.0:1763334977.057707:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1812 00002000:00010000:0.0:1763334977.057718:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334977.057722:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d5500 with x1848989694551040 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334977.057736:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d5500. 00000100:00080000:3.0:1763334977.058458:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763334977.058524:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694550912:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 3175us (3657us total) trans 21474838439 rc 0/0 00000100:00100000:2.0:1763334977.058536:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1813 00002000:00010000:2.0:1763334977.058541:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:2.0:1763334977.058544:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c7480 with x1848989694550912 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334977.058552:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c58c7480. 00000100:00100000:3.0:1763334977.070056:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.070306:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694551168 00000100:00100000:2.0:1763334977.070322:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694551168 00002000:00100000:2.0:1763334977.070410:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (69632->73727) req@ffff9a59c58c5180 x1848989694551168/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:23/0 lens 488/0 e 0 to 0 dl 1763334988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334977.070424:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c5180 with x1848989694551168 ext(69632->73727) 00002000:00010000:2.0:1763334977.070431:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c58c5180 00000100:00100000:1.0:1763334977.072394:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1814 00000100:00100000:1.0:1763334977.072428:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694551168:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:1.0:1763334977.072781:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694551168:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 370us (2750us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763334977.072791:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1814 00002000:00100000:1.0:1763334977.072803:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (69632->73727) req@ffff9a59c58c5180 x1848989694551168/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:23/0 lens 488/4536 e 0 to 0 dl 1763334988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334977.072815:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c5180 with x1848989694551168 ext(69632->73727) 00002000:00010000:1.0:1763334977.072823:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c58c5180 00000100:00100000:1.0:1763334977.078541:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.078626:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694551296 00000100:00100000:0.0:1763334977.078641:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694551296 00002000:00100000:0.0:1763334977.078708:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (73728->77823) req@ffff9a5afb1ff480 x1848989694551296/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:23/0 lens 488/0 e 0 to 0 dl 1763334988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334977.078722:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1ff480 with x1848989694551296 ext(73728->77823) 00002000:00010000:0.0:1763334977.078729:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1ff480 00000100:00100000:0.0:1763334977.078768:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1815 00000100:00100000:0.0:1763334977.078778:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694551296:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:0.0:1763334977.079111:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694551296:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 332us (586us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334977.079120:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1815 00002000:00100000:0.0:1763334977.079129:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (73728->77823) req@ffff9a5afb1ff480 x1848989694551296/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:23/0 lens 488/4536 e 0 to 0 dl 1763334988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334977.079138:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1ff480 with x1848989694551296 ext(73728->77823) 00002000:00010000:0.0:1763334977.079141:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1ff480 00000100:00100000:0.0:1763334977.083686:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.095196:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694551424 00000100:00100000:2.0:1763334977.095226:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694551424 00002000:00100000:2.0:1763334977.095319:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (49152->114687) req@ffff9a5af59f8a80 x1848989694551424/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:23/0 lens 504/0 e 0 to 0 dl 1763334988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334977.095332:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af59f8a80 with x1848989694551424 ext(49152->114687) 00002000:00010000:2.0:1763334977.095342:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af59f8a80 00000100:00100000:2.0:1763334977.095397:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1816 00000100:00100000:2.0:1763334977.095409:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694551424:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:2.0:1763334977.099242:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694551424:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 3816us (15554us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1763334977.099264:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1816 00002000:00100000:2.0:1763334977.099281:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (49152->114687) req@ffff9a5af59f8a80 x1848989694551424/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:23/0 lens 504/440 e 0 to 0 dl 1763334988 ref 1 fl Complete:/600/0 rc 57344/57344 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334977.099293:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af59f8a80 with x1848989694551424 ext(49152->114687) 00002000:00010000:2.0:1763334977.099301:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af59f8a80 00000100:00100000:3.0:1763334977.104888:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.105035:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694551552 00000100:00100000:2.0:1763334977.105059:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694551552 00002000:00100000:2.0:1763334977.105131:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (114688->118783) req@ffff9a59c58c5500 x1848989694551552/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:23/0 lens 488/0 e 0 to 0 dl 1763334988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334977.105156:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c5500 with x1848989694551552 ext(114688->118783) 00002000:00010000:2.0:1763334977.105165:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c58c5500 00000100:00100000:2.0:1763334977.105208:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1817 00000100:00100000:2.0:1763334977.105219:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694551552:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:2.0:1763334977.105639:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694551552:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 418us (765us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763334977.105650:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1817 00002000:00100000:2.0:1763334977.105658:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (114688->118783) req@ffff9a59c58c5500 x1848989694551552/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:23/0 lens 488/4536 e 0 to 0 dl 1763334988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334977.105670:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c5500 with x1848989694551552 ext(114688->118783) 00002000:00010000:2.0:1763334977.105675:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c58c5500 00000100:00100000:0.0:1763334977.121775:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.121886:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694551680 00000100:00100000:2.0:1763334977.121901:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694551680 00002000:00100000:2.0:1763334977.121981:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (69632->117503) req@ffff9a5af59faa00 x1848989694551680/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:23/0 lens 488/0 e 0 to 0 dl 1763334988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334977.121995:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af59faa00 with x1848989694551680 ext(69632->117503) 00002000:00010000:2.0:1763334977.122004:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af59faa00 00000100:00100000:2.0:1763334977.122067:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1818 00000100:00100000:2.0:1763334977.122080:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694551680:12345-192.168.201.60@tcp:4:lfs.0 00000100:00100000:3.0:1763334977.127205:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694551680:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 5110us (5428us total) trans 17179871167 rc 0/0 00000100:00100000:3.0:1763334977.127224:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1818 00002000:00100000:3.0:1763334977.127243:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (69632->117503) req@ffff9a5af59faa00 x1848989694551680/t17179871167(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:23/0 lens 488/448 e 0 to 0 dl 1763334988 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334977.127264:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af59faa00 with x1848989694551680 ext(69632->117503) 00002000:00010000:3.0:1763334977.127273:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af59faa00 00000100:00100000:3.0:1763334977.129778:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.129907:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694551808 00000100:00100000:1.0:1763334977.129920:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694551808 00000100:00100000:1.0:1763334977.130004:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4941 00000100:00100000:1.0:1763334977.130016:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694551808:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:3.0:1763334977.172181:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871166 is committed 00000100:00100000:0.0:1763334977.172447:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694551808:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 42422us (42673us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334977.172463:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4941 00000001:00080000:3.0:1763334977.172554:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871167 is committed 00000001:00080000:3.0:1763334977.172599:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871164 is committed 00000100:00100000:0.0:1763334977.177685:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.177866:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694551936 00000100:00100000:2.0:1763334977.177881:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694551936 00000100:00100000:2.0:1763334977.178009:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4882 00000100:00100000:2.0:1763334977.178022:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af59f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694551936:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334977.178158:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334977.178188:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c1a8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01a2 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.178296:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1af lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.178312:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.178324:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334977.178353:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 117506 00000004:00200000:2.0:1763334977.178358:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334977.178378:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1af lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.178410:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c1a8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01a2 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.178428:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1af lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01a2 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.178437:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334977.178440:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334977.178444:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431000, rc 0) 00000100:00100000:2.0:1763334977.178518:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af59f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694551936:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 499us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334977.178524:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4882 00000100:00100000:2.0:1763334977.183812:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.183940:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694552192 00000100:00100000:3.0:1763334977.183957:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694552192 00000100:00100000:3.0:1763334977.184052:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4883 00000100:00100000:3.0:1763334977.184063:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694552192:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:3.0:1763334977.189552:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1763334977.189622:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1af lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01a2 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.189654:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c19a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0194 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.189668:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:3.0:1763334977.189681:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334977.190059:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c1b6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.190077:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.190095:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:3.0:1763334977.190160:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939086 00000004:00010000:3.0:1763334977.190188:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008b100629 reply state 00000000cfaf04d5 transno 8589939087 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334977.190197:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334977.190323:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694552192:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 6260us (6529us total) trans 8589939087 rc 0/0 00000100:00100000:3.0:1763334977.190332:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4883 00000020:00080000:3.0:1763334977.190339:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1763334977.198252:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.198277:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c1b6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.198285:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c1b6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.198292:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334977.198297:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c1b6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.198304:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c1b6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.198324:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66ded00) 00010000:00010000:2.0:1763334977.198328:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334977.198333:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c1b6 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.198339:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c1b6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334977.198746:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.199783:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694552320 00000100:00100000:2.0:1763334977.199802:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694552320 00000100:00100000:2.0:1763334977.202707:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4884 00000100:00100000:2.0:1763334977.202739:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694552320:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334977.202772:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334977.202803:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c1bd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01a9 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.202875:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c1bd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01a9 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.202891:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c1bd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01a9 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.202908:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:2.0:1763334977.202911:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334977.202915:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430400, rc 0) 00000100:00100000:2.0:1763334977.202993:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694552320:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 270us (4254us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334977.203000:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4884 00000100:00100000:3.0:1763334977.211298:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.211338:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.213411:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694552448 00000100:00100000:1.0:1763334977.213432:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694552448 00002000:00010000:1.0:1763334977.213501:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (161659->18446744073709551615) 00002000:00100000:1.0:1763334977.213507:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c6d80 with x1848989694552448 ext(161659->18446744073709551615) 00002000:00010000:1.0:1763334977.213525:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c58c6d80. 00000100:00100000:1.0:1763334977.213594:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694552576 00000100:00100000:1.0:1763334977.213599:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694552576 00002000:00010000:1.0:1763334977.213615:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334977.213619:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c4a80 with x1848989694552576 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334977.213627:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c58c4a80. 00000100:00100000:1.0:1763334977.213663:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1819 00000100:00100000:1.0:1763334977.213674:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694552448:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334977.214083:0:21630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 117504 -> 161659 00002000:00010000:1.0:1763334977.214088:0:21630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334977 -> 1763334977 00002000:00010000:1.0:1763334977.214091:0:21630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334977.214093:0:21630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:1.0:1763334977.214096:0:21630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 71 -> 161 00000100:00100000:1.0:1763334977.214174:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694552448:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 500us (2890us total) trans 17179871168 rc 0/0 00000100:00100000:1.0:1763334977.214181:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1819 00002000:00010000:1.0:1763334977.214186:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (161659->18446744073709551615) 00002000:00100000:1.0:1763334977.214189:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c6d80 with x1848989694552448 ext(161659->18446744073709551615) 00002000:00010000:1.0:1763334977.214194:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c58c6d80. 00000100:00100000:1.0:1763334977.214213:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1820 00000100:00100000:1.0:1763334977.214220:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694552576:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334977.214333:0:21630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334977.214336:0:21630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334977 -> 1763334977 00002000:00010000:1.0:1763334977.214338:0:21630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334977.214341:0:21630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:1.0:1763334977.214343:0:21630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334977.214362:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694552576:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 142us (3022us total) trans 21474838440 rc 0/0 00000100:00100000:1.0:1763334977.214367:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1820 00002000:00010000:1.0:1763334977.214370:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334977.214372:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c4a80 with x1848989694552576 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334977.214377:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c58c4a80. 00000100:00100000:1.0:1763334977.215948:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.216890:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694552704 00000100:00100000:0.0:1763334977.216908:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694552704 00002000:00010000:0.0:1763334977.216984:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334977.216990:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1ff800 with x1848989694552704 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334977.217005:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1ff800. 00000100:00100000:0.0:1763334977.217059:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1821 00000100:00100000:0.0:1763334977.217071:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694552704:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334977.217377:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334977.217381:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334977 -> 1763334977 00002000:00010000:0.0:1763334977.217384:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334977.217386:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:0.0:1763334977.217388:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334977.217468:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694552704:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 397us (1529us total) trans 17179871169 rc 0/0 00000100:00100000:0.0:1763334977.217476:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1821 00002000:00010000:0.0:1763334977.217481:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334977.217484:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1ff800 with x1848989694552704 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334977.217489:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1ff800. 00000100:00100000:1.0:1763334977.219850:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.219995:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694552832 00000100:00100000:2.0:1763334977.220008:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694552832 00000100:00100000:2.0:1763334977.220176:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4885 00000100:00100000:2.0:1763334977.220189:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694552832:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334977.220216:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334977.220704:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c1c4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01b0 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.220831:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c1cb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.220849:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c1cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.220901:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c1cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334977.220937:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 161659 00000004:00200000:2.0:1763334977.220943:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334977.220967:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c1cb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.221001:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c1c4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01b0 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.221024:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c1cb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01b0 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.221035:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:2.0:1763334977.221038:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334977.221053:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430e00, rc 0) 00000100:00100000:2.0:1763334977.221367:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694552832:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 1179us (1528us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334977.221377:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4885 00000100:00100000:2.0:1763334977.226746:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.226908:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694553088 00000100:00100000:0.0:1763334977.226922:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694553088 00000100:00100000:0.0:1763334977.226999:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1783 00000100:00100000:0.0:1763334977.227012:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694553088:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:0.0:1763334977.227890:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53644:x1848989694553088:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 875us (1153us total) trans 8589939088 rc 0/0 00000100:00100000:0.0:1763334977.227902:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1783 00000100:00100000:1.0:1763334977.254753:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.254836:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694553344 00000100:00100000:2.0:1763334977.254851:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694553344 00000100:00100000:2.0:1763334977.254925:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4886 00000100:00100000:2.0:1763334977.254936:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53647:x1848989694553344:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334977.254967:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334977.254997:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c1d2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01b7 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.255116:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c1d9 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.255135:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.255151:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.255170:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849c1e0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.255176:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849c1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.255183:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849c1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.255383:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c1e7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.255393:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.255400:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334977.255412:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 161659 00010000:00010000:2.0:1763334977.255556:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.255564:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c1d9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.257874:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c1d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.257892:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334977.257897:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c1d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.257909:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c1d9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.257935:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334977.257939:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334977.257945:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c1d9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.257954:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c1d9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.257980:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849c1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.257987:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849c1e0 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.257993:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849c1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.258003:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334977.258006:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849c1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.258012:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849c1e0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.258248:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334977.258252:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334977.258256:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849c1e0 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.258263:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430600/0xcedf0054f849c1e0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.258455:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c1d2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01b7 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.258473:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01b7 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.258480:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:2.0:1763334977.258482:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334977.258485:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334977.262761:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53647:x1848989694553344:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7806us (8001us total) trans 8589939089 rc 0/0 00000100:00100000:2.0:1763334977.262780:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4886 00000100:00100000:1.0:1763334977.266448:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.266540:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694553472 00000100:00100000:3.0:1763334977.266556:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694553472 00000100:00100000:3.0:1763334977.266723:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 397 00000100:00100000:3.0:1763334977.266736:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2361:x1848989694553472:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334977.266758:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334977.266792:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c1e7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01b7 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.266816:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:3.0:1763334977.266822:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334977.267210:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2361:x1848989694553472:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 475us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334977.267459:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 397 00000100:00100000:0.0:1763334977.268311:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.268551:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694553728 00000100:00100000:2.0:1763334977.268562:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694553728 00000100:00100000:2.0:1763334977.268654:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4887 00000100:00100000:2.0:1763334977.268673:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53647:x1848989694553728:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334977.268704:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334977.268732:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c1f5 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01be expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.269499:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.269516:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.269527:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334977.269539:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b0:0x0]: returning size 0 00010000:00010000:2.0:1763334977.269622:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c1f5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01be expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.269643:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01be expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.269653:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b0:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:2.0:1763334977.269656:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334977.269659:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431000, rc 0) 00000100:00100000:2.0:1763334977.269736:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53647:x1848989694553728:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1074us (1430us total) trans 8589939090 rc 0/0 00000100:00100000:2.0:1763334977.269744:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4887 00000100:00100000:1.0:1763334977.274812:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.274945:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694553984 00000100:00100000:0.0:1763334977.274961:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694553984 00000100:00100000:0.0:1763334977.275101:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4888 00000100:00100000:0.0:1763334977.275118:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53647:x1848989694553984:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334977.275151:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334977.275179:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c20a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01c5 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.275318:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334977.275337:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1fc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01be expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.275346:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334977.275390:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01be expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.275406:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1fc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01be expref: 196 pid: 30972 timeout: 1141 lvb_type: 0 00000100:00100000:0.0:1763334977.275421:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701863296:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334977.275543:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e7c600 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.279102:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701863296:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334977.279155:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334977.279855:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.280125:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694554112 00000100:00100000:3.0:1763334977.280138:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694554112 00010000:00010000:3.0:1763334977.280191:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1fc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01be expref: 197 pid: 30972 timeout: 1141 lvb_type: 0 00000100:00100000:3.0:1763334977.280241:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2595 00000100:00100000:3.0:1763334977.280263:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2360:x1848989694554112:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334977.280282:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334977.280290:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1fc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01be expref: 197 pid: 30972 timeout: 1141 lvb_type: 0 00010000:00010000:3.0:1763334977.280304:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01be expref: 197 pid: 30972 timeout: 1141 lvb_type: 0 00010000:00010000:3.0:1763334977.280334:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c1fc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01be expref: 197 pid: 30972 timeout: 1141 lvb_type: 0 00010000:00010000:3.0:1763334977.280356:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b0:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:3.0:1763334977.280364:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334977.280374:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334977.280383:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334977.280414:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334977.280488:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2360:x1848989694554112:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 236us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334977.280496:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2595 00010000:00010000:1.0:1763334977.280766:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.280775:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334977.280799:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b0:0x0]: returning size 0 00000004:00080000:1.0:1763334977.281222:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24a:0x0], index 0: 0 00000004:00080000:1.0:1763334977.281234:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24e:0x0], index 1: 0 00010000:00010000:1.0:1763334977.281428:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.281437:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.281446:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.281452:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334977.281458:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.281467:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.281481:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b0:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:1.0:1763334977.281484:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334977.281489:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.281495:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c211 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.281566:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c20a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01c5 expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.281621:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:1.0:1763334977.281624:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1763334977.281628:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c20a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01c5 expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.281644:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:1.0:1763334977.281685:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53647:x1848989694553984:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6575us (6888us total) trans 8589939091 rc 301/301 00000100:00100000:1.0:1763334977.281694:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4888 00000100:00100000:0.0:1763334977.285421:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.285658:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694554368 00000100:00100000:3.0:1763334977.285673:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694554368 00000100:00100000:3.0:1763334977.285741:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1784 00000100:00100000:3.0:1763334977.285752:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c376a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53647:x1848989694554368:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334977.286233:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c376a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53647:x1848989694554368:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 481us (826us total) trans 8589939092 rc 0/0 00000100:00100000:3.0:1763334977.286245:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1784 00000100:00100000:0.0:1763334977.290273:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.290663:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694554496 00000100:00100000:1.0:1763334977.290678:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694554496 00000100:00100000:1.0:1763334977.290907:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4889 00000100:00100000:1.0:1763334977.290918:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53647:x1848989694554496:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334977.290948:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334977.290978:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c21f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01cc expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.291112:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c226 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.291129:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c226 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.291141:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c226 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334977.291189:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b0:0x0]: returning size 0 00000004:00200000:1.0:1763334977.291194:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334977.291214:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c226 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.291241:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c21f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01cc expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.291267:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c226 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01cc expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.291277:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b0:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334977.291280:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1763334977.291284:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334977.291358:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53647:x1848989694554496:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 442us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.291365:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4889 00000100:00100000:2.0:1763334977.295383:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.295423:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.295519:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694554624 00000100:00100000:0.0:1763334977.295534:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694554624 00000100:00100000:0.0:1763334977.295621:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694554752 00000100:00100000:0.0:1763334977.295624:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694554752 00000100:00100000:0.0:1763334977.295654:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4942 00000100:00100000:0.0:1763334977.295666:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2362:x1848989694554624:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334977.295691:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334977.295721:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c22d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01d3 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334977.295754:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334977.295779:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334977.295781:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334977.295793:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c22d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01d3 expref: 31 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334977.295811:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c22d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01d3 expref: 31 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334977.295828:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334977.295896:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2362:x1848989694554624:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 232us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334977.295904:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4942 00000100:00100000:0.0:1763334977.295924:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4943 00000100:00100000:0.0:1763334977.295930:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694554752:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334977.295938:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334977.295950:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c234 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01da expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334977.295966:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1763334977.295975:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334977.295976:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334977.295980:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01da expref: 23 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334977.295991:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01da expref: 23 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334977.295999:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:0.0:1763334977.296014:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc8c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694554752:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 86us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334977.296020:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4943 00000100:00100000:0.0:1763334977.300281:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.300975:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694555008 00000100:00100000:1.0:1763334977.300989:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694555008 00000100:00100000:1.0:1763334977.301377:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4890 00000100:00100000:1.0:1763334977.301392:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53647:x1848989694555008:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334977.301421:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334977.301447:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c23b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01e1 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.301601:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c242 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.301620:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c242 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.301633:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c242 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334977.301648:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 161659 00010000:00010000:1.0:1763334977.301811:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c23b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01e1 expref: 200 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.301834:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c242 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01e1 expref: 199 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.301844:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:1.0:1763334977.301847:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334977.301851:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334977.301934:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53647:x1848989694555008:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 546us (1669us total) trans 8589939093 rc 0/0 00000100:00100000:1.0:1763334977.301943:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4890 00000100:00100000:0.0:1763334977.312061:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.312125:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.314514:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.317988:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694555136 00000100:00100000:1.0:1763334977.318012:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694555136 00000100:00100000:2.0:1763334977.318100:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694555264 00000100:00100000:2.0:1763334977.318106:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694555264 00000100:00100000:1.0:1763334977.318451:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694555392 00000100:00100000:1.0:1763334977.318456:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694555392 00000100:00100000:2.0:1763334977.318522:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4944 00000100:00100000:2.0:1763334977.318536:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694555136:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334977.318619:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.318645:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c1a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b019b expref: 24 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.318655:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334977.318658:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334977.318662:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.318712:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b019b expref: 24 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.318731:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c1a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b019b expref: 24 pid: 32241 timeout: 1141 lvb_type: 0 00000100:00100000:2.0:1763334977.318750:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701863424:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334977.318772:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4945 00000100:00100000:3.0:1763334977.318798:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2362:x1848989694555264:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:3.0:1763334977.318846:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.318865:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c0cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0140 expref: 31 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334977.318872:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530f00 going to sleep for 11 seconds 00010000:00010000:3.0:1763334977.318886:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334977.318889:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334977.318893:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334977.318910:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4946 00000100:00100000:2.0:1763334977.318925:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694555392:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:3.0:1763334977.318933:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c0cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0140 expref: 31 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.318949:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c0cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0140 expref: 31 pid: 26216 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334977.318955:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334977.318966:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701863552:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334977.318991:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c0d6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0147 expref: 24 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.319000:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334977.319002:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334977.319005:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.319030:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c0d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0147 expref: 24 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.319052:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c0d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0147 expref: 24 pid: 26216 timeout: 1141 lvb_type: 0 00000100:00100000:3.0:1763334977.319061:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af687bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334977.319067:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701863680:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334977.319108:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.329374:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701863680:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334977.329415:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334977.329520:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701863552:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334977.329538:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334977.329615:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701863424:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334977.329629:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334977.333254:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.333386:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694555520 00000100:00100000:2.0:1763334977.333401:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694555520 00010000:00010000:2.0:1763334977.333456:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c1a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b019b expref: 25 pid: 32241 timeout: 1141 lvb_type: 0 00000100:00100000:2.0:1763334977.333509:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2596 00000100:00100000:2.0:1763334977.333519:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694555520:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334977.333541:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334977.333568:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c1a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b019b expref: 25 pid: 32241 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334977.333625:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c1a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b019b expref: 25 pid: 32241 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334977.333655:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c1a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b019b expref: 25 pid: 32241 timeout: 1141 lvb_type: 0 00010000:00010000:2.0:1763334977.333685:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.333688:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.333695:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.333708:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.333748:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334977.333823:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694555520:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 305us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334977.333831:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2596 00010000:00010000:0.0:1763334977.334082:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.334094:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.334126:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.334133:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.334141:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.334149:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334977.334153:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.334162:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.334174:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.334180:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c250 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334977.334244:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694555136:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 15711us (22212us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334977.334257:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4944 00000100:00100000:2.0:1763334977.344343:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.345344:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.346420:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694555648 00000100:00100000:3.0:1763334977.346436:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694555648 00010000:00010000:3.0:1763334977.346482:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c0cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0140 expref: 32 pid: 26216 timeout: 1141 lvb_type: 0 00000100:00100000:3.0:1763334977.346516:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694555776 00000100:00100000:3.0:1763334977.346520:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694555776 00010000:00010000:3.0:1763334977.346536:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c0d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0147 expref: 23 pid: 26216 timeout: 1141 lvb_type: 0 00000100:00100000:3.0:1763334977.346614:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2597 00000100:00100000:3.0:1763334977.346625:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2359:x1848989694555648:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334977.346640:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334977.346661:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c0cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0140 expref: 32 pid: 26216 timeout: 1141 lvb_type: 0 00010000:00010000:3.0:1763334977.346675:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c0cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0140 expref: 32 pid: 26216 timeout: 1141 lvb_type: 0 00010000:00010000:3.0:1763334977.346698:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c0cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0140 expref: 32 pid: 26216 timeout: 1141 lvb_type: 0 00010000:00010000:3.0:1763334977.346715:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.346717:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.346722:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.346731:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.346756:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334977.346812:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2359:x1848989694555648:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 189us (2485us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334977.346820:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2597 00000100:00100000:3.0:1763334977.346839:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2598 00000100:00100000:3.0:1763334977.346847:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694555776:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334977.346855:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334977.346867:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c0d6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0147 expref: 23 pid: 26216 timeout: 1141 lvb_type: 0 00010000:00010000:3.0:1763334977.346877:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c0d6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0147 expref: 23 pid: 26216 timeout: 1141 lvb_type: 0 00010000:00010000:3.0:1763334977.346893:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c0d6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0147 expref: 23 pid: 26216 timeout: 1141 lvb_type: 0 00010000:00010000:3.0:1763334977.346906:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.346909:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.346913:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.346921:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.346946:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334977.346973:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694555776:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 123us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334977.346980:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2598 00010000:00010000:1.0:1763334977.346982:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.346998:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.347050:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.347064:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.347073:0:26564:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.347081:0:26564:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334977.347085:0:26564:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.347095:0:26564:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.347114:0:26564:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.347122:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c25e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334977.347215:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2362:x1848989694555392:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 28292us (32712us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.347226:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4946 00010000:00010000:0.0:1763334977.350859:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.350883:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.350934:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.350942:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.350952:0:32241:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.350959:0:32241:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334977.350964:0:32241:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.350973:0:32241:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.350996:0:32241:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.351003:0:32241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c257 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334977.351137:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2362:x1848989694555264:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 32346us (39005us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334977.351149:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4945 00000100:00100000:3.0:1763334977.355198:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.360351:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694555904 00000100:00100000:2.0:1763334977.360831:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.360948:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.360989:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694556032 00000100:00100000:2.0:1763334977.361001:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694556032 00000100:00100000:2.0:1763334977.361064:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694556160 00000100:00100000:2.0:1763334977.361067:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694556160 00000100:00100000:2.0:1763334977.361089:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4947 00000100:00100000:2.0:1763334977.361099:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2362:x1848989694556032:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334977.361121:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334977.361148:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c265 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01ef expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334977.361180:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x248:0x0] initial LVB size: 0, mtime: 0x691a5b41, atime: 0x691a5b40, ctime: 0x691a5b41, blocks: 0x1 00010000:00010000:2.0:1763334977.361205:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.361208:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.361221:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c265 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01ef expref: 31 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334977.361243:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c265 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01ef expref: 31 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334977.361260:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430800, rc 0) 00000100:00100000:2.0:1763334977.361329:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2362:x1848989694556032:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 231us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334977.361337:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4947 00000100:00100000:2.0:1763334977.361359:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4948 00000100:00100000:2.0:1763334977.361366:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694556160:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334977.361374:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334977.361389:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c26c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01f6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334977.361405:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x691a5b41, atime: 0x691a5b40, ctime: 0x691a5b41, blocks: 0x3 00010000:00010000:2.0:1763334977.361418:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.361420:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.361424:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c26c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01f6 expref: 22 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334977.361436:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c26c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01f6 expref: 22 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334977.361444:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:2.0:1763334977.361466:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694556160:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 100us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334977.361472:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4948 00000100:00100000:0.0:1763334977.361750:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694555904 00000100:00100000:0.0:1763334977.361793:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4949 00000100:00100000:0.0:1763334977.361801:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694555904:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334977.361810:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334977.361823:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c273 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01e8 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334977.361837:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 161659, mtime: 0x691a5b41, atime: 0x691a5b40, ctime: 0x691a5b41, blocks: 0xa1 00010000:00010000:0.0:1763334977.361847:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334977.361849:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334977.361855:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c273 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01e8 expref: 23 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334977.361866:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c273 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01e8 expref: 23 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334977.361874:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334977.361912:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694555904:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 112us (6728us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334977.361918:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4949 00010000:00010000:2.0:1763334977.381970:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334977.422326:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.422564:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694556288 00000100:00100000:0.0:1763334977.422622:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694556288 00000100:00100000:3.0:1763334977.425651:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1822 00000100:00100000:3.0:1763334977.425933:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694556288:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:3.0:1763334977.426000:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c27a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.426025:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.426028:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.426034:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c27a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.426060:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c27a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.446702:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c27a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.446729:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c27a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.446740:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c27a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.446748:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334977.446754:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c27a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.446765:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c27a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.446793:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c27a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.446801:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c27a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334977.446932:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694556288:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 21257us (24614us total) trans 0 rc 161659/161659 00000100:00100000:3.0:1763334977.446945:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1822 00000100:00100000:2.0:1763334977.454907:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.454998:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694556416 00000100:00100000:3.0:1763334977.455022:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694556416 00000100:00100000:3.0:1763334977.455150:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1823 00000100:00100000:3.0:1763334977.455161:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2362:x1848989694556416:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:3.0:1763334977.455211:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.455238:0:14385:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c22d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01d3 expref: 31 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334977.455248:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.455250:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.455255:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.455311:0:14385:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c22d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01d3 expref: 31 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334977.455327:0:14385:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c22d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01d3 expref: 31 pid: 26216 timeout: 1142 lvb_type: 1 00000100:00100000:3.0:1763334977.455346:0:14385:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14385:1848989701863808:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334977.455491:0:14385:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af687bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1763334977.457686:0:14385:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14385:1848989701863808:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334977.457723:0:14385:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334977.462459:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.462640:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694556544 00000100:00100000:0.0:1763334977.462655:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694556544 00010000:00010000:0.0:1763334977.462712:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c22d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01d3 expref: 32 pid: 26216 timeout: 1142 lvb_type: 1 00000100:00100000:0.0:1763334977.462763:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2599 00000100:00100000:0.0:1763334977.462773:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2360:x1848989694556544:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334977.462791:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334977.462820:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c22d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01d3 expref: 32 pid: 26216 timeout: 1142 lvb_type: 1 00010000:00010000:0.0:1763334977.462834:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c22d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01d3 expref: 32 pid: 26216 timeout: 1142 lvb_type: 1 00010000:00010000:0.0:1763334977.462866:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c22d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01d3 expref: 32 pid: 26216 timeout: 1142 lvb_type: 1 00010000:00010000:0.0:1763334977.462887:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334977.462890:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334977.462896:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.462909:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.462943:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334977.463615:0:14385:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.463629:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334977.466860:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68ced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2360:x1848989694556544:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4072us (4405us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334977.466882:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2599 00000001:00080000:0.0:1763334977.531447:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838432 is committed 00000001:00080000:0.0:1763334977.531476:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838431 is committed 00000001:00080000:0.0:1763334977.531506:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838440 is committed 00000001:00080000:0.0:1763334977.531535:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838438 is committed 00000001:00080000:0.0:1763334977.531554:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838441 is committed 00002000:00010000:3.0:1763334977.531735:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 0 -> 161659 00002000:00010000:3.0:1763334977.531742:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 0 -> 1763334978 00002000:00010000:3.0:1763334977.531745:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 0 -> 1763334978 00002000:00010000:3.0:1763334977.531748:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 1 -> 515 00010000:00010000:3.0:1763334977.531769:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.531783:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.531794:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.531803:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334977.531809:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.531821:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.531853:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.531862:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c281 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334977.531991:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2362:x1848989694556416:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 76823us (77092us total) trans 21474838441 rc 0/0 00000100:00100000:3.0:1763334977.532004:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1823 00000100:00100000:2.0:1763334977.536395:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.537204:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694556672 00000100:00100000:1.0:1763334977.537222:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694556672 00000100:00100000:1.0:1763334977.537311:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4891 00000100:00100000:1.0:1763334977.537324:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53647:x1848989694556672:12345-192.168.201.60@tcp:44:lfs.0 00000001:00080000:3.0:1763334977.576205:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939088 is committed 00000020:00080000:3.0:1763334977.576228:0:32265:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969315 batchid updated 00000001:00080000:3.0:1763334977.576249:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939093 is committed 00000020:00080000:0.0:1763334977.576315:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969315 00000020:00080000:0.0:1763334977.576606:0:29663:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969315 cancel update log [0x200000bd0:0x1:0x0].9: rc = 0 00000020:00080000:0.0:1763334977.576617:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969315 00000100:00100000:1.0:1763334977.576833:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53647:x1848989694556672:12345-192.168.201.60@tcp:44:lfs.0 Request processed in 39504us (40447us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.576846:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4891 00000100:00100000:1.0:1763334977.580075:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.580187:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.580294:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694556800 00000100:00100000:0.0:1763334977.580308:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694556800 00000100:00100000:0.0:1763334977.580380:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694556928 00000100:00100000:0.0:1763334977.580384:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694556928 00000100:00100000:0.0:1763334977.580416:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4950 00000100:00100000:0.0:1763334977.580427:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694556800:12345-192.168.201.60@tcp:16:lfs.0 00000100:00100000:0.0:1763334977.580604:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694556800:12345-192.168.201.60@tcp:16:lfs.0 Request processed in 147us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334977.580613:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4950 00000100:00100000:0.0:1763334977.580634:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4951 00000100:00100000:0.0:1763334977.580641:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694556928:12345-192.168.201.60@tcp:16:lfs.0 00000100:00100000:0.0:1763334977.580690:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694556928:12345-192.168.201.60@tcp:16:lfs.0 Request processed in 49us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334977.580697:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4951 00000100:00100000:3.0:1763334977.591279:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.591723:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694557056 00000100:00100000:1.0:1763334977.591737:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694557056 00000100:00100000:1.0:1763334977.591812:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4952 00000100:00100000:1.0:1763334977.591825:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694557056:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334977.591883:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c288 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.591902:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334977.591905:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334977.591911:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c288 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.591928:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c288 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.591966:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c288 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.591974:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c288 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.591982:0:26564:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.591990:0:26564:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334977.591995:0:26564:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c288 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.592003:0:26564:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c288 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.592019:0:26564:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c288 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.592026:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c288 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334977.592131:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694557056:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 307us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.592139:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4952 00000100:00100000:0.0:1763334977.595399:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.595456:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.595616:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694557184 00000100:00100000:2.0:1763334977.595632:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694557184 00000100:00100000:2.0:1763334977.595689:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694557312 00000100:00100000:2.0:1763334977.595692:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694557312 00000100:00100000:2.0:1763334977.595732:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4953 00000100:00100000:2.0:1763334977.595745:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2361:x1848989694557184:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334977.595810:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c28f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.595831:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.595834:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.595841:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c28f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.595863:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c28f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.595906:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c28f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.595915:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c28f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.595924:0:26216:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c28f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.595931:0:26216:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334977.595936:0:26216:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c28f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.595946:0:26216:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c28f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.595964:0:26216:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c28f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.595971:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c28f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334977.596069:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2361:x1848989694557184:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 326us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334977.596078:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4953 00000100:00100000:2.0:1763334977.596099:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4954 00000100:00100000:2.0:1763334977.596106:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2361:x1848989694557312:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334977.596126:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c296 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.596133:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.596135:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.596138:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c296 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.596147:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c296 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.596166:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c296 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.596172:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c296 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.596179:0:26216:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c296 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.596187:0:26216:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334977.596190:0:26216:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c296 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.596201:0:26216:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c296 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.596210:0:26216:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c296 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.596216:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c296 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334977.596246:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2361:x1848989694557312:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 141us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334977.596253:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4954 00000100:00100000:0.0:1763334977.604345:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.604494:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694557568 00000100:00100000:1.0:1763334977.604508:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694557568 00000100:00100000:1.0:1763334977.604621:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4892 00000100:00100000:1.0:1763334977.604635:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53647:x1848989694557568:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334977.604709:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334977.604744:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c226 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1b0:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01cc expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.604766:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b0:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334977.604779:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334977.604844:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c29d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.604859:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c29d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.604872:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c29d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00010000:1.0:1763334977.605125:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005d346699 reply state 00000000820c1431 transno 8589939094 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c29d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334977.605135:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334977.607342:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53647:x1848989694557568:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 619us (921us total) trans 8589939094 rc 0/0 00000100:00100000:1.0:1763334977.607368:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4892 00000100:00100000:0.0:1763334977.608066:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334977.608380:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c29d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.608395:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c29d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.608402:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c29d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.608409:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334977.608415:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c29d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.608424:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c29d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.608443:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b0:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:1.0:1763334977.608447:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334977.608453:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c29d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.608458:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c29d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334977.608599:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694557696 00000100:00100000:3.0:1763334977.608613:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694557696 00000100:00100000:3.0:1763334977.608678:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4893 00000100:00100000:3.0:1763334977.608689:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53647:x1848989694557696:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334977.608716:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334977.608740:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c2a4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b01fd expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.608813:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c2a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01fd expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.608829:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c2a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01fd expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.608852:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b0:0x0].0x0 (ffff9a5af66de100) 00010000:00010000:3.0:1763334977.608855:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334977.608858:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:3.0:1763334977.608936:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53647:x1848989694557696:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 247us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334977.608943:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4893 00000100:00100000:0.0:1763334977.612755:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.612860:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694557824 00000100:00100000:2.0:1763334977.612874:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694557824 00000100:00100000:2.0:1763334977.612942:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4955 00000100:00100000:2.0:1763334977.612954:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+13:53647:x1848989694557824:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334977.612977:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334977.613007:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c2ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0204 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334977.613103:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 161659, mtime: 0x691a5b42, atime: 0x0, ctime: 0x691a5b42, blocks: 0x203 00010000:00010000:2.0:1763334977.613131:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.613133:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.613143:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c2ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0204 expref: 14 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.613168:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c2ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0204 expref: 14 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.613182:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431000, rc 0) 00000100:00100000:2.0:1763334977.613257:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+14:53647:x1848989694557824:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 305us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334977.613264:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4955 00000100:00100000:0.0:1763334977.615702:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.615957:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694557952 00000100:00100000:3.0:1763334977.615970:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694557952 00000100:00100000:3.0:1763334977.616042:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4956 00000100:00100000:3.0:1763334977.616055:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+23:53647:x1848989694557952:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334977.616078:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334977.616102:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c2b2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b020b expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.616138:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c234 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01da expref: 24 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334977.616148:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.616150:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.616155:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c2b2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b020b expref: 24 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.616202:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01da expref: 24 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334977.616218:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c234 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01da expref: 24 pid: 26216 timeout: 1142 lvb_type: 1 00000100:00100000:3.0:1763334977.616236:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701863936:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334977.616365:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac8393540 going to sleep for 11 seconds 00000100:00100000:3.0:1763334977.619675:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701863936:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334977.619729:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c2b2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b020b expref: 24 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.619753:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:3.0:1763334977.619830:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+24:53647:x1848989694557952:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3776us (4141us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334977.619841:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4956 00000100:00100000:2.0:1763334977.620093:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.620247:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694558080 00000100:00100000:1.0:1763334977.620264:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694558080 00010000:00010000:1.0:1763334977.620302:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c234 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01da expref: 24 pid: 26216 timeout: 1142 lvb_type: 1 00000100:00100000:1.0:1763334977.620337:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2600 00000100:00100000:1.0:1763334977.620348:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694558080:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334977.620369:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334977.620398:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c234 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01da expref: 24 pid: 26216 timeout: 1142 lvb_type: 1 00010000:00010000:1.0:1763334977.620411:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c234 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01da expref: 24 pid: 26216 timeout: 1142 lvb_type: 1 00010000:00010000:1.0:1763334977.620440:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c234 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01da expref: 24 pid: 26216 timeout: 1142 lvb_type: 1 00010000:00010000:1.0:1763334977.620454:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334977.620456:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334977.620462:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b020b expref: 23 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.620479:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c2b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b020b expref: 23 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.620519:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c2b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b020b expref: 23 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334977.620533:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e85c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701864064:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334977.620625:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e70780 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.624878:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e85c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701864064:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334977.624917:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334977.624994:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694558080:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4646us (4901us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.625007:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2600 00000100:00100000:0.0:1763334977.625201:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.625312:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.625388:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694558208 00000100:00100000:3.0:1763334977.625398:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694558208 00000100:00100000:3.0:1763334977.625456:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694558336 00000100:00100000:3.0:1763334977.625459:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694558336 00000100:00100000:3.0:1763334977.625485:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4957 00000100:00100000:3.0:1763334977.625495:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694558208:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:3.0:1763334977.625860:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 161659 -> 161659 00002000:00010000:3.0:1763334977.625865:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334978 -> 1763334977 00002000:00010000:3.0:1763334977.625867:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 0 -> 1763334976 00002000:00010000:3.0:1763334977.625870:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334978 -> 1763334978 00002000:00010000:3.0:1763334977.625872:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334977.625904:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694558208:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 410us (704us total) trans 21474838442 rc 0/0 00000100:00100000:3.0:1763334977.625910:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4957 00000100:00100000:3.0:1763334977.625925:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4958 00000100:00100000:3.0:1763334977.625931:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694558336:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:3.0:1763334977.626114:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334977.626117:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 0 -> 1763334977 00002000:00010000:3.0:1763334977.626119:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 0 -> 1763334976 00002000:00010000:3.0:1763334977.626121:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 0 -> 1763334978 00002000:00010000:3.0:1763334977.626123:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334977.626146:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694558336:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 214us (833us total) trans 17179871170 rc 0/0 00000100:00100000:3.0:1763334977.626153:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4958 00000100:00100000:0.0:1763334977.629379:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.630162:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694558592 00000100:00100000:2.0:1763334977.630178:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694558592 00000100:00100000:2.0:1763334977.630305:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4894 00000100:00100000:2.0:1763334977.630317:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53647:x1848989694558592:12345-192.168.201.60@tcp:55:lfs.0 00010000:00010000:2.0:1763334977.630415:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c2b9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.630440:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.630455:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.630491:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c2b9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.630498:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c2b9 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.630505:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c2b9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.630512:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334977.630518:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c2b9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.630526:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c2b9 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.630541:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b0:0x0].0x0 (ffff9a5af66de100) 00010000:00010000:2.0:1763334977.630544:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1763334977.630550:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c2b9 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334977.630555:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c2b9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334977.631429:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53647:x1848989694558592:12345-192.168.201.60@tcp:55:lfs.0 Request processed in 1104us (2054us total) trans 0 rc -22/-22 00000100:00100000:0.0:1763334977.631443:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4894 00000100:00100000:1.0:1763334977.634345:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.634499:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694558848 00000100:00100000:0.0:1763334977.634514:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694558848 00000100:00100000:0.0:1763334977.634724:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4895 00000100:00100000:0.0:1763334977.634737:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53647:x1848989694558848:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334977.634812:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334977.634846:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c1cb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01b0 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.634869:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334977.634874:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334977.634925:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c2c0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334977.634940:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334977.634950:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334977.635164:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009a33a93d reply state 000000005b6081e9 transno 8589939095 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334977.635176:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334977.635292:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53647:x1848989694558848:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 557us (961us total) trans 8589939095 rc 0/0 00000100:00100000:0.0:1763334977.635301:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4895 00000100:00100000:2.0:1763334977.638062:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334977.638263:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c2c0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.638278:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c2c0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.638287:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c2c0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.638293:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334977.638299:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c2c0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.638307:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c2c0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.638326:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:3.0:1763334977.638329:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334977.638334:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c2c0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.638345:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c2c0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334977.638473:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694558976 00000100:00100000:0.0:1763334977.638487:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694558976 00000100:00100000:0.0:1763334977.638549:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4959 00000100:00100000:0.0:1763334977.638560:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:53647:x1848989694558976:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334977.638611:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334977.638634:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c2c7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0212 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.638668:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c273 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01e8 expref: 25 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334977.638677:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334977.638679:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334977.638684:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c2c7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0212 expref: 25 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.638723:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c273 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01e8 expref: 25 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334977.638737:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c273 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01e8 expref: 25 pid: 32241 timeout: 1142 lvb_type: 1 00000100:00100000:0.0:1763334977.638753:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701864192:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334977.638847:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c96eeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.641354:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.641670:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab31c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701864192:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334977.641715:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c2c7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0212 expref: 25 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.641741:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334977.641813:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:53647:x1848989694558976:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3254us (3764us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334977.641823:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4959 00000100:00100000:2.0:1763334977.642170:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694559104 00000100:00100000:2.0:1763334977.642180:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694559104 00010000:00010000:2.0:1763334977.642221:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c273 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01e8 expref: 25 pid: 32241 timeout: 1142 lvb_type: 1 00000100:00100000:2.0:1763334977.642255:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2601 00000100:00100000:2.0:1763334977.642265:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694559104:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334977.642282:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334977.642311:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c273 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01e8 expref: 25 pid: 32241 timeout: 1142 lvb_type: 1 00010000:00010000:2.0:1763334977.642327:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c273 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01e8 expref: 25 pid: 32241 timeout: 1142 lvb_type: 1 00010000:00010000:2.0:1763334977.642364:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c273 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01e8 expref: 25 pid: 32241 timeout: 1142 lvb_type: 1 00010000:00010000:2.0:1763334977.642380:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.642382:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.642391:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c2c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0212 expref: 24 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.642402:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0212 expref: 24 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.642444:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0212 expref: 24 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334977.642461:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af68cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701864320:192.168.201.60@tcp:105: 00000100:00100000:2.0:1763334977.642530:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c25a8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.647404:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af68cea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701864320:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334977.647443:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334977.647532:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694559104:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5266us (6188us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.647547:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2601 00000100:00100000:2.0:1763334977.647741:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.647968:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694559232 00000100:00100000:3.0:1763334977.647978:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694559232 00000100:00100000:3.0:1763334977.648028:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4960 00000100:00100000:3.0:1763334977.648051:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+15:53647:x1848989694559232:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334977.648075:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334977.648103:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c2ce lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0219 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.648144:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c265 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01ef expref: 16 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334977.648154:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.648157:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.648162:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c2ce lrc: 4/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0219 expref: 16 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.648209:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c265 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01ef expref: 16 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334977.648226:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c265 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01ef expref: 16 pid: 6519 timeout: 1142 lvb_type: 1 00000100:00100000:3.0:1763334977.648242:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701864448:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334977.648335:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac8393540 going to sleep for 11 seconds 00000100:00100000:2.0:1763334977.652116:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.652242:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701864448:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334977.652299:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c2ce lrc: 3/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0219 expref: 16 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.652324:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:3.0:1763334977.652399:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+16:53647:x1848989694559232:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4351us (4659us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334977.652411:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4960 00000100:00100000:1.0:1763334977.652643:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694559360 00000100:00100000:1.0:1763334977.652654:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694559360 00010000:00010000:1.0:1763334977.652695:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c265 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01ef expref: 16 pid: 6519 timeout: 1142 lvb_type: 1 00000100:00100000:1.0:1763334977.652740:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2602 00000100:00100000:1.0:1763334977.652750:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694559360:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334977.652768:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1763334977.652791:0:5735:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 1 -> 3 00010000:00010000:1.0:1763334977.652799:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c265 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01ef expref: 16 pid: 6519 timeout: 1142 lvb_type: 1 00010000:00010000:1.0:1763334977.652812:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c265 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01ef expref: 16 pid: 6519 timeout: 1142 lvb_type: 1 00010000:00010000:1.0:1763334977.652842:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c265 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01ef expref: 16 pid: 6519 timeout: 1142 lvb_type: 1 00010000:00010000:1.0:1763334977.652857:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334977.652859:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334977.652867:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c2ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0219 expref: 15 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.652879:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c2ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0219 expref: 15 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.652922:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c2ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0219 expref: 15 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334977.652939:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701864576:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334977.653004:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e70d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334977.657639:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.657809:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701864576:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334977.657844:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334977.657915:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694559360:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5165us (5814us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.657928:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2602 00000100:00100000:3.0:1763334977.658223:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694559488 00000100:00100000:3.0:1763334977.658233:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694559488 00000100:00100000:3.0:1763334977.658305:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4961 00000100:00100000:3.0:1763334977.658316:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af68cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:53647:x1848989694559488:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334977.658338:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334977.658365:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c2d5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0220 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.658402:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c26c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01f6 expref: 25 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334977.658412:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.658415:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.658420:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c2d5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0220 expref: 25 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.658460:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c26c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01f6 expref: 25 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334977.658482:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c26c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01f6 expref: 25 pid: 6519 timeout: 1142 lvb_type: 1 00000100:00100000:3.0:1763334977.658500:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701864704:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334977.658601:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac8393540 going to sleep for 11 seconds 00000100:00100000:3.0:1763334977.662240:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701864704:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334977.662294:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c2d5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0220 expref: 25 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.662319:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:3.0:1763334977.662396:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af68cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:53647:x1848989694559488:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4081us (4772us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334977.662406:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4961 00000100:00100000:0.0:1763334977.662601:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.662737:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694559616 00000100:00100000:1.0:1763334977.662745:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694559616 00010000:00010000:1.0:1763334977.662781:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c26c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01f6 expref: 25 pid: 6519 timeout: 1142 lvb_type: 1 00000100:00100000:1.0:1763334977.662816:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2603 00000100:00100000:1.0:1763334977.662825:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694559616:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334977.662841:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334977.662866:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c26c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01f6 expref: 25 pid: 6519 timeout: 1142 lvb_type: 1 00010000:00010000:1.0:1763334977.662878:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c26c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01f6 expref: 25 pid: 6519 timeout: 1142 lvb_type: 1 00010000:00010000:1.0:1763334977.662904:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c26c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01f6 expref: 25 pid: 6519 timeout: 1142 lvb_type: 1 00010000:00010000:1.0:1763334977.662920:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334977.662922:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334977.662930:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c2d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0220 expref: 24 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.662946:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c2d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0220 expref: 24 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.662988:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c2d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0220 expref: 24 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334977.663003:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701864832:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334977.663088:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e70d80 going to sleep for 11 seconds 00000100:00100000:0.0:1763334977.666947:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.666982:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.667031:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334977.667080:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694559744 00000100:00100000:0.0:1763334977.667092:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694559744 00000100:00100000:0.0:1763334977.667158:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694559872 00000100:00100000:0.0:1763334977.667161:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694559872 00000100:00100000:0.0:1763334977.667182:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694560000 00000100:00100000:0.0:1763334977.667185:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694560000 00000100:00100000:0.0:1763334977.667211:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4962 00000100:00100000:0.0:1763334977.667225:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694559744:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334977.667525:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 161659 -> 161659 00002000:00010000:0.0:1763334977.667529:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334977 -> 1763334977 00002000:00010000:0.0:1763334977.667532:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334977.667535:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334977 -> 1763334978 00002000:00010000:0.0:1763334977.667538:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 161 -> 161 00000100:00100000:0.0:1763334977.667657:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694559744:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 434us (724us total) trans 17179871171 rc 0/0 00000100:00100000:0.0:1763334977.667668:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4962 00000100:00100000:0.0:1763334977.667690:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4963 00000100:00100000:0.0:1763334977.667696:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694559872:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334977.667818:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334977.667822:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334977 -> 1763334977 00002000:00010000:0.0:1763334977.667824:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334977.667826:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334977 -> 1763334978 00002000:00010000:0.0:1763334977.667828:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334977.667849:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694559872:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 153us (867us total) trans 21474838443 rc 0/0 00000100:00100000:0.0:1763334977.667854:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4963 00000100:00100000:0.0:1763334977.667865:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4964 00000100:00100000:0.0:1763334977.667870:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694560000:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334977.667933:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334977.667936:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334977 -> 1763334977 00002000:00010000:0.0:1763334977.667938:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334977.667941:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334977 -> 1763334978 00002000:00010000:0.0:1763334977.667943:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334977.667960:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694560000:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 89us (929us total) trans 17179871172 rc 0/0 00000100:00100000:0.0:1763334977.667966:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4964 00000100:00100000:1.0:1763334977.668309:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701864832:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334977.668340:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334977.668373:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694559616:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5549us (5772us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.668383:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2603 00000100:00100000:0.0:1763334977.673215:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.674512:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694560256 00000100:00100000:2.0:1763334977.674533:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694560256 00000100:00100000:2.0:1763334977.674958:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1785 00000100:00100000:2.0:1763334977.674971:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53647:x1848989694560256:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:2.0:1763334977.675094:0:29630:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1ab:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c242 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01e1 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.675154:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.675169:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c1bd lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01a9 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.675177:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.675227:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c1bd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01a9 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.675242:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c1bd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01a9 expref: 192 pid: 30972 timeout: 1142 lvb_type: 0 00000100:00100000:2.0:1763334977.675356:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701864960:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334977.675476:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c25a8900 going to sleep for 11 seconds 00000100:00100000:2.0:1763334977.679097:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701864960:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334977.679140:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:0.0:1763334977.679917:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.680671:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694560384 00000100:00100000:1.0:1763334977.680686:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694560384 00010000:00010000:1.0:1763334977.680741:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c1bd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01a9 expref: 193 pid: 30972 timeout: 1142 lvb_type: 0 00000100:00100000:1.0:1763334977.680922:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2604 00000100:00100000:1.0:1763334977.680935:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2360:x1848989694560384:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334977.680955:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334977.680963:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c1bd lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01a9 expref: 193 pid: 30972 timeout: 1142 lvb_type: 0 00010000:00010000:1.0:1763334977.680978:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c1bd lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01a9 expref: 193 pid: 30972 timeout: 1142 lvb_type: 0 00010000:00010000:1.0:1763334977.681009:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c1bd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01a9 expref: 193 pid: 30972 timeout: 1142 lvb_type: 0 00010000:00010000:1.0:1763334977.681028:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:1.0:1763334977.681044:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334977.681057:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334977.681066:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334977.681493:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334977.681636:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694560384:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 700us (1719us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.681646:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2604 00010000:00010000:2.0:1763334977.682420:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.682436:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.682468:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.682488:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c2a4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01fd expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.682496:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.682538:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c2a4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01fd expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.682553:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c2a4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01fd expref: 191 pid: 32232 timeout: 1142 lvb_type: 0 00000100:00100000:2.0:1763334977.682591:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701865088:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334977.682684:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c25a8900 going to sleep for 11 seconds 00000100:00100000:0.0:1763334977.686723:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.686845:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694560512 00000100:00100000:1.0:1763334977.686858:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694560512 00010000:00010000:1.0:1763334977.686910:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c2a4 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01fd expref: 192 pid: 32232 timeout: 1142 lvb_type: 0 00000100:00100000:1.0:1763334977.686961:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2605 00000100:00100000:1.0:1763334977.686973:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694560512:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334977.686992:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334977.687000:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c2a4 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01fd expref: 192 pid: 32232 timeout: 1142 lvb_type: 0 00010000:00010000:1.0:1763334977.687022:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c2a4 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01fd expref: 192 pid: 32232 timeout: 1142 lvb_type: 0 00010000:00010000:1.0:1763334977.687065:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b0:0x0].0x0 (ffff9a5af66de100) 00010000:00010000:1.0:1763334977.687072:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334977.687083:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334977.687092:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334977.687116:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334977.687179:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694560512:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 207us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.687187:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2605 00010000:00010000:2.0:1763334977.687491:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c2a4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1b0:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01fd expref: 191 pid: 32232 timeout: 1142 lvb_type: 0 00000100:00100000:2.0:1763334977.687512:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701865088:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334977.687540:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.687550:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.687556:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:2.0:1763334977.688147:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.688217:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334977.688258:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac4d06480 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.688695:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701865216 00000100:00100000:1.0:1763334977.688705:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701865216 00000100:00100000:1.0:1763334977.688764:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1763334977.688773:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334977.688870:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 98us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.688878:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1763334977.690390:0:29630:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871164 gen 2 00000004:00080000:2.0:1763334977.690406:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca872300, transno 17179871157 00000004:00080000:2.0:1763334977.690426:0:29630:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179871161 committed transno 17179871164 00000004:00080000:2.0:1763334977.690452:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5502d80, transno 17179871162 00000004:00080000:2.0:1763334977.690455:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d5c00, transno 17179871163 00000004:00080000:2.0:1763334977.690458:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5502a00, transno 17179871164 00000100:00100000:2.0:1763334977.690467:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b4000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.690553:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.690649:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334977.690682:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530f00 going to sleep for 11 seconds 00000004:00080000:3.0:1763334977.691010:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 4 done 00000100:00100000:0.0:1763334977.691101:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701865344 00000100:00100000:0.0:1763334977.691110:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701865344 00000100:00100000:0.0:1763334977.691167:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1763334977.691175:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc848850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1763334977.691265:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc848850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 90us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334977.691273:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1763334977.691981:0:29630:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838438 gen 2 00000004:00080000:2.0:1763334977.691989:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeeceb100, transno 21474838416 00000004:00080000:2.0:1763334977.692007:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeecebb80, transno 21474838417 00000004:00080000:2.0:1763334977.692010:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeece9c00, transno 21474838418 00000004:00080000:2.0:1763334977.692013:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac8418380, transno 21474838432 00000004:00080000:2.0:1763334977.692017:0:29630:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474838435 committed transno 21474838438 00000004:00080000:2.0:1763334977.692041:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d4e00, transno 21474838436 00000004:00080000:2.0:1763334977.692045:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d4a80, transno 21474838437 00000004:00080000:2.0:1763334977.692048:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d6d80, transno 21474838438 00000100:00100000:2.0:1763334977.692054:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.692140:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865472:0@lo:1000:mdt_rdpg00_000.0 00000004:00080000:3.0:1763334977.692464:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 7 done 00000100:00100000:2.0:1763334977.692500:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334977.692627:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701865472 00000100:00100000:1.0:1763334977.692642:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701865472 00000100:00100000:2.0:1763334977.692661:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac4d06480 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.692696:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1763334977.692705:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334977.692824:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 120us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.692832:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1763334977.692922:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.693051:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.693085:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334977.693108:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af687b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.693155:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701865600 00000100:00100000:1.0:1763334977.693160:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701865600 00000100:00100000:1.0:1763334977.693189:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1763334977.693196:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334977.693246:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 51us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.693257:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1763334977.693280:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.693320:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.693346:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334977.693361:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad9672d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.693381:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701865728 00000100:00100000:1.0:1763334977.693386:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701865728 00000100:00100000:1.0:1763334977.693418:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1763334977.693424:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334977.693478:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 54us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.693484:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1763334977.693523:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.693548:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.693563:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334977.693601:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af687bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.693601:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701865856 00000100:00100000:1.0:1763334977.693605:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701865856 00000100:00100000:1.0:1763334977.693633:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1763334977.693639:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334977.693689:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.693695:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1763334977.693766:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.693799:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.693821:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334977.693841:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac4d06480 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.693878:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701865984 00000100:00100000:1.0:1763334977.693882:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701865984 00000100:00100000:1.0:1763334977.693909:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1763334977.693915:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865984:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334977.693968:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701865984:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 53us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.693974:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1763334977.694062:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701865984:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.694093:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701866112:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.694116:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334977.694135:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad9672d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.694156:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701866112 00000100:00100000:1.0:1763334977.694161:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701866112 00000100:00100000:1.0:1763334977.694184:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1763334977.694194:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701866112:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334977.694245:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701866112:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 55us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334977.694251:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1763334977.694311:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701866112:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:2.0:1763334977.694642:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].10, 552 off36552 00000001:00080000:2.0:1763334977.694652:0:29630:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939096 00000100:00100000:2.0:1763334977.694697:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701866240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.694715:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334977.694731:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c25a8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.694755:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701866240 00000100:00100000:1.0:1763334977.694759:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701866240 00000100:00100000:1.0:1763334977.694794:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1763334977.694801:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701866240:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334977.694957:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701866240:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 156us (240us total) trans 17179871173 rc 0/0 00000100:00100000:1.0:1763334977.694964:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1763334977.695066:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a20a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701866240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.695088:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701866368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334977.695117:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334977.695138:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.695227:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701866368 00000100:00100000:1.0:1763334977.695231:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701866368 00000100:00100000:1.0:1763334977.695298:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1763334977.695304:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701866368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334977.695719:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701866368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 414us (600us total) trans 21474838444 rc 0/0 00000100:00100000:1.0:1763334977.695725:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1763334977.695779:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8418380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701866368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1763334977.695868:0:29630:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939097 00010000:00010000:2.0:1763334977.695895:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.695905:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.695913:0:29630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.695919:0:29630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334977.695923:0:29630:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.695930:0:29630:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.695945:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b0:0x0].0x0 (ffff9a5af66de100) 00010000:00010000:2.0:1763334977.695948:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763334977.695953:0:29630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.695958:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c2e3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1b0:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.695978:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.696092:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.696098:0:29630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.696102:0:29630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334977.696105:0:29630:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.696111:0:29630:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.696119:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:2.0:1763334977.696121:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763334977.696125:0:29630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.696130:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2dc lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.696142:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:2.0:1763334977.696145:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334977.696151:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c242 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b01e1 expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334977.696249:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53647:x1848989694560256:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 21280us (23050us total) trans 8589939098 rc 0/0 00000100:00100000:2.0:1763334977.696261:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1785 00000020:00080000:2.0:1763334977.696266:0:29630:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1763334977.705325:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.705420:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694560640 00000100:00100000:3.0:1763334977.705435:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694560640 00000100:00100000:3.0:1763334977.705995:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4896 00000100:00100000:3.0:1763334977.706011:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53647:x1848989694560640:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334977.706217:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334977.706257:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c2ea lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0227 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.706346:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c2ea lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0227 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.706364:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c2ea lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0227 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.706384:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:3.0:1763334977.706388:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334977.706392:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:3.0:1763334977.706473:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53647:x1848989694560640:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 468us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334977.706481:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4896 00000100:00100000:3.0:1763334977.715650:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.715818:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694560896 00000100:00100000:2.0:1763334977.715835:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694560896 00000100:00100000:2.0:1763334977.715908:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1786 00000100:00100000:2.0:1763334977.715919:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53647:x1848989694560896:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334977.716537:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53647:x1848989694560896:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 616us (899us total) trans 8589939099 rc 0/0 00000100:00100000:2.0:1763334977.716547:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1786 00000100:00100000:0.0:1763334977.722228:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.722356:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694561152 00000100:00100000:2.0:1763334977.722371:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694561152 00000100:00100000:2.0:1763334977.723046:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1787 00000100:00100000:2.0:1763334977.723064:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53647:x1848989694561152:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:2.0:1763334977.723469:0:29630:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x1b0:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1763334977.723647:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2f1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.723670:0:29630:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.723684:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2f1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.723693:0:29630:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2f1 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.723700:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2f1 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.723713:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2f1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334977.723730:0:29630:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334977.723890:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53647:x1848989694561152:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 829us (1676us total) trans 8589939100 rc 0/0 00000100:00100000:2.0:1763334977.723899:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1787 00010000:00010000:0.0:1763334977.723991:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1763334977.724001:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2f1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334977.724009:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334977.724013:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2f1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334977.724022:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2f1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334977.724047:0:8205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b0:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334977.724051:0:8205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1763334977.724058:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2f1 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334977.724064:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c2f1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b0:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334977.724083:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334977.724085:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1763334977.724087:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334977.738926:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.739695:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694561280 00000100:00100000:3.0:1763334977.739713:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694561280 00000100:00100000:3.0:1763334977.739795:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4897 00000100:00100000:3.0:1763334977.739808:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53648:x1848989694561280:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334977.739841:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334977.739870:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c2f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b022e expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.739960:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c2ff lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.739977:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c2ff lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.739991:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c2ff lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740008:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c306 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740016:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c306 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740023:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c306 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740181:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849c30d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740191:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849c30d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740199:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849c30d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334977.740244:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 161659 00000004:00200000:3.0:1763334977.740250:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334977.740273:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849c30d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740287:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849c30d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740296:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c2ff lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740303:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c2ff lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740310:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c2ff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740317:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334977.740322:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c2ff lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740331:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c2ff lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740344:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:3.0:1763334977.740348:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334977.740354:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c2ff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740360:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c2ff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740378:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c306 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740384:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c306 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740390:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c306 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740395:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334977.740398:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c306 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740405:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c306 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740412:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5af66de400) 00010000:00010000:3.0:1763334977.740415:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334977.740417:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c306 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740423:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c306 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.740460:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c2f8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b022e expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.740474:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849c30d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b022e expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.740482:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:3.0:1763334977.740484:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334977.740487:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5aec6d4a00, rc 0) 00000100:00100000:3.0:1763334977.740564:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53648:x1848989694561280:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 758us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334977.740634:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4897 00000100:00100000:2.0:1763334977.745618:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.745841:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694561536 00000100:00100000:1.0:1763334977.745855:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694561536 00000100:00100000:1.0:1763334977.745929:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4898 00000100:00100000:1.0:1763334977.745946:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53648:x1848989694561536:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334977.745975:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334977.746004:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c314 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0235 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.746172:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c31b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.746190:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c31b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.746203:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c31b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334977.746217:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 161659 00010000:00010000:1.0:1763334977.746441:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c314 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0235 expref: 199 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.746460:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c31b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0235 expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.746470:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:1.0:1763334977.746473:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763334977.746478:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334977.746559:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53648:x1848989694561536:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 616us (997us total) trans 8589939101 rc 0/0 00000100:00100000:1.0:1763334977.746567:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4898 00000100:00100000:0.0:1763334977.749522:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.750197:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694561792 00000100:00100000:1.0:1763334977.750214:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694561792 00000100:00100000:1.0:1763334977.750358:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4899 00000100:00100000:1.0:1763334977.750371:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53648:x1848989694561792:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334977.750405:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334977.750434:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c329 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b023c expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.750587:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c330 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.750606:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c330 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334977.750619:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c330 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334977.750634:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 161659 00010000:00010000:1.0:1763334977.750787:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c329 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b023c expref: 201 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.750807:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c330 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b023c expref: 200 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334977.750816:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:1.0:1763334977.750819:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334977.750823:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334977.750901:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53648:x1848989694561792:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 534us (1392us total) trans 8589939102 rc 0/0 00000100:00100000:1.0:1763334977.750908:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4899 00000100:00100000:0.0:1763334977.755449:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.755558:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694561920 00000100:00100000:2.0:1763334977.755588:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694561920 00000100:00100000:2.0:1763334977.755649:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4965 00000100:00100000:2.0:1763334977.755658:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694561920:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334977.755678:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334977.755700:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c33e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0243 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334977.755762:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701866496:192.168.201.60@tcp:106: 00000100:00100000:2.0:1763334977.755846:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.760376:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab35180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701866496:192.168.201.60@tcp:106: 00010000:00010000:1.0:1763334977.760433:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c33e lrc: 1/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0243 expref: 17 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334977.760462:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c33e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0243 expref: 17 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334977.760476:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431600, rc 0) 00000100:00100000:1.0:1763334977.760558:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694561920:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4900us (5125us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334977.760568:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4965 00000100:00100000:0.0:1763334977.823974:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.825017:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694562048 00000100:00100000:3.0:1763334977.825040:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694562048 00000100:00100000:3.0:1763334977.825138:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1824 00000100:00100000:3.0:1763334977.825149:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694562048:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:3.0:1763334977.825200:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.825223:0:14385:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c2c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0212 expref: 26 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.825231:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334977.825234:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334977.825238:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.825289:0:14385:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0212 expref: 26 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.825305:0:14385:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c2c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0212 expref: 26 pid: 25383 timeout: 1142 lvb_type: 0 00000100:00100000:3.0:1763334977.825323:0:14385:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14385:1848989701866624:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334977.825439:0:14385:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac8393540 going to sleep for 11 seconds 00000100:00100000:3.0:1763334977.834521:0:14385:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14385:1848989701866624:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334977.834562:0:14385:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334977.834784:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.834889:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694562176 00000100:00100000:3.0:1763334977.834899:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694562176 00010000:00010000:3.0:1763334977.834945:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c2c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0212 expref: 27 pid: 25383 timeout: 1142 lvb_type: 0 00000100:00100000:3.0:1763334977.834992:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2606 00000100:00100000:3.0:1763334977.835003:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694562176:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334977.835024:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334977.835064:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c2c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0212 expref: 27 pid: 25383 timeout: 1142 lvb_type: 0 00010000:00010000:3.0:1763334977.835080:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c2c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0212 expref: 27 pid: 25383 timeout: 1142 lvb_type: 0 00010000:00010000:3.0:1763334977.835119:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c2c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0212 expref: 27 pid: 25383 timeout: 1142 lvb_type: 0 00010000:00010000:3.0:1763334977.835139:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.835141:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.835148:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.835159:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.835949:0:14385:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334977.835964:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.838953:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334977.840944:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694562176:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5924us (6142us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334977.840964:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2606 00010000:00010000:3.0:1763334977.845996:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.846021:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.846043:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.846051:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5aec6d5200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334977.846056:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.846071:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.846094:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.846102:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5200/0xcedf0054f849c345 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334977.846241:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694562048:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 21088us (22276us total) trans 0 rc 161659/161659 00000100:00100000:3.0:1763334977.846254:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1824 00000100:00100000:2.0:1763334977.850829:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.850922:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.851007:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694562304 00000100:00100000:1.0:1763334977.851025:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694562304 00000100:00100000:1.0:1763334977.851104:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694562432 00000100:00100000:1.0:1763334977.851108:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694562432 00000100:00100000:1.0:1763334977.851142:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4966 00000100:00100000:1.0:1763334977.851153:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694562304:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334977.851179:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334977.851204:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c34c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b024a expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334977.851211:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4967 00000100:00100000:3.0:1763334977.851222:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694562432:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334977.851230:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334977.851242:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849c353 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0251 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334977.851278:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701866880:192.168.201.60@tcp:106: 00000100:00100000:1.0:1763334977.851278:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701866752:192.168.201.60@tcp:106: 00000100:00100000:1.0:1763334977.851947:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e70d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334977.851985:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac8393540 going to sleep for 11 seconds 00000100:00100000:0.0:1763334977.856624:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701866880:192.168.201.60@tcp:106: 00010000:00010000:0.0:1763334977.856697:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849c353 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0251 expref: 26 pid: 25383 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1763334977.856722:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701866752:192.168.201.60@tcp:106: 00010000:00010000:0.0:1763334977.856729:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066400/0xcedf0054f849c353 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0251 expref: 26 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334977.856745:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00010000:00010000:2.0:1763334977.856757:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c34c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b024a expref: 17 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334977.856771:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849c34c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b024a expref: 17 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334977.856781:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:2.0:1763334977.856824:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694562304:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5672us (6008us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334977.856834:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4966 00000100:00100000:0.0:1763334977.857661:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694562432:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6242us (6538us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334977.857674:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4967 00000100:00100000:0.0:1763334977.861215:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.861417:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694562560 00000100:00100000:3.0:1763334977.861434:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694562560 00000100:00100000:3.0:1763334977.861533:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1825 00000100:00100000:3.0:1763334977.861545:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae8d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694562560:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:3.0:1763334977.861640:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.861669:0:14385:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c2ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0204 expref: 16 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.861679:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334977.861682:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334977.861687:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.861735:0:14385:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c2ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0204 expref: 16 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.861752:0:14385:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c2ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0204 expref: 16 pid: 25383 timeout: 1142 lvb_type: 0 00000100:00100000:3.0:1763334977.861770:0:14385:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14385:1848989701867008:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334977.861882:0:14385:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac8393e40 going to sleep for 11 seconds 00000100:00100000:3.0:1763334977.866081:0:14385:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0000_UUID:14385:1848989701867008:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334977.866127:0:14385:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334977.866814:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.867468:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694562688 00000100:00100000:2.0:1763334977.867487:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694562688 00010000:00010000:2.0:1763334977.867553:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c2ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0204 expref: 17 pid: 25383 timeout: 1142 lvb_type: 0 00000100:00100000:2.0:1763334977.867654:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2607 00000100:00100000:2.0:1763334977.867665:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694562688:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334977.867686:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334977.867716:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c2ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0204 expref: 17 pid: 25383 timeout: 1142 lvb_type: 0 00010000:00010000:2.0:1763334977.867731:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c2ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0204 expref: 17 pid: 25383 timeout: 1142 lvb_type: 0 00010000:00010000:2.0:1763334977.867759:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c2ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0204 expref: 17 pid: 25383 timeout: 1142 lvb_type: 0 00010000:00010000:2.0:1763334977.867780:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.867783:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334977.867789:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.867807:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.867838:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334977.867901:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694562688:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 238us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334977.867909:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2607 00010000:00010000:3.0:1763334977.868160:0:14385:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.868171:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.871894:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.871920:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.871930:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.871938:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334977.871943:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.871952:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.871977:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.871986:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c35a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334977.872118:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae8d4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2361:x1848989694562560:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 10568us (10916us total) trans 0 rc 161659/161659 00000100:00100000:3.0:1763334977.872139:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1825 00000100:00100000:0.0:1763334977.883192:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334977.884061:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694562816 00000100:00100000:1.0:1763334977.884077:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694562816 00000100:00100000:2.0:1763334977.884722:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 398 00000100:00100000:2.0:1763334977.884739:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad886e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53648:x1848989694562816:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:2.0:1763334977.884768:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334977.884800:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c330 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b023c expref: 200 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334977.884824:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:2.0:1763334977.884831:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334977.885174:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad886e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53648:x1848989694562816:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 438us (1995us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334977.885183:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 398 00000100:00100000:0.0:1763334977.890192:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.890297:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694563072 00000100:00100000:2.0:1763334977.890311:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694563072 00000100:00100000:2.0:1763334977.890392:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1788 00000100:00100000:2.0:1763334977.890404:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53648:x1848989694563072:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334977.890824:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53648:x1848989694563072:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 421us (650us total) trans 8589939103 rc 0/0 00000100:00100000:2.0:1763334977.890833:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1788 00000100:00100000:0.0:1763334977.907524:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.907716:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694563328 00000100:00100000:3.0:1763334977.907731:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694563328 00000100:00100000:3.0:1763334977.907816:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4900 00000100:00100000:3.0:1763334977.907829:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53649:x1848989694563328:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334977.907864:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334977.907891:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c361 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0258 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.908019:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c368 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.908046:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c368 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334977.908060:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c368 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334977.908076:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 161659 00010000:00010000:3.0:1763334977.908265:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c361 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0258 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.908290:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c368 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0258 expref: 202 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.908301:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:3.0:1763334977.908304:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763334977.908308:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:3.0:1763334977.908394:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53649:x1848989694563328:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 566us (886us total) trans 8589939104 rc 0/0 00000100:00100000:3.0:1763334977.908402:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4900 00000100:00100000:0.0:1763334977.916365:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334977.916461:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694563456 00000100:00100000:2.0:1763334977.916476:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694563456 00000100:00100000:1.0:1763334977.916770:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4968 00000100:00100000:1.0:1763334977.916787:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2362:x1848989694563456:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334977.916813:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334977.916844:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c376 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b025f expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334977.916924:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701867136:192.168.201.60@tcp:106: 00000100:00100000:1.0:1763334977.917073:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e70840 going to sleep for 11 seconds 00000100:00100000:1.0:1763334977.919203:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701867136:192.168.201.60@tcp:106: 00010000:00010000:1.0:1763334977.919270:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c376 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b025f expref: 16 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334977.919304:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c376 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b025f expref: 16 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334977.919322:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334977.920006:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2362:x1848989694563456:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3218us (3651us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334977.920020:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4968 00000100:00100000:0.0:1763334977.922533:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334977.922727:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694563584 00000100:00100000:3.0:1763334977.922742:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694563584 00000100:00100000:3.0:1763334977.923065:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1826 00000100:00100000:3.0:1763334977.923078:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2361:x1848989694563584:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:3.0:1763334977.923128:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c37d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.923147:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.923150:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334977.923157:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c37d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.923173:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c37d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.930552:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c37d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.930603:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c37d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.930613:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c37d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.930621:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334977.930627:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c37d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.930637:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c37d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.930670:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c37d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334977.930680:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c37d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334977.930812:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2361:x1848989694563584:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 7729us (8285us total) trans 0 rc 73728/73728 00000100:00100000:3.0:1763334977.930825:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1826 00000100:00100000:0.0:1763334978.006104:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.006375:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694563712 00000100:00100000:1.0:1763334978.006392:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694563712 00000100:00100000:1.0:1763334978.006804:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4969 00000100:00100000:1.0:1763334978.006821:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694563712:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334978.006851:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334978.006889:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c384 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0266 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334978.006920:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 161659, mtime: 0x691a5b41, atime: 0x691a5b40, ctime: 0x691a5b42, blocks: 0xa1 00010000:00010000:1.0:1763334978.006951:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334978.006954:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334978.006971:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c384 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0266 expref: 26 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334978.006994:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c384 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0266 expref: 26 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334978.007012:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334978.007124:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694563712:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 308us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334978.007133:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4969 00000100:00100000:0.0:1763334978.015846:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.016873:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694563840 00000100:00100000:3.0:1763334978.016887:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694563840 00000100:00100000:3.0:1763334978.016973:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1827 00000100:00100000:3.0:1763334978.016983:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694563840:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:3.0:1763334978.017019:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c38b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.017045:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334978.017048:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334978.017053:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c38b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.017066:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c38b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.032673:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c38b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.032693:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c38b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.032701:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c38b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.032710:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334978.032714:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c38b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.032722:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c38b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.032742:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c38b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.032748:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c38b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334978.032843:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694563840:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 15857us (17002us total) trans 0 rc 161659/161659 00000100:00100000:3.0:1763334978.032853:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1827 00000100:00100000:0.0:1763334978.041843:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.042204:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694563968 00000100:00100000:3.0:1763334978.042218:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694563968 00000100:00100000:3.0:1763334978.042309:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1828 00000100:00100000:3.0:1763334978.042321:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694563968:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:3.0:1763334978.042383:0:14385:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 161659, mtime: 0x691a5b41, atime: 0x691a5b40, ctime: 0x691a5b42, blocks: 0x203 00010000:00010000:3.0:1763334978.042393:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c392 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.042410:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334978.042412:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334978.042419:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c392 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.042436:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c392 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.046640:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c392 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.046660:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c392 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.046669:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.046677:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334978.046681:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c392 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.046690:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c392 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.046711:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c392 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.046718:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c392 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->163839] (req 0->163839) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334978.046809:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694563968:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 4485us (4970us total) trans 0 rc 161659/161659 00000100:00100000:3.0:1763334978.046823:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1828 00000100:00100000:0.0:1763334978.063764:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334978.064636:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694564096 00000100:00100000:2.0:1763334978.064652:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694564096 00000100:00100000:2.0:1763334978.064728:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 399 00000100:00100000:2.0:1763334978.064740:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53649:x1848989694564096:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:2.0:1763334978.064757:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334978.064784:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c368 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0258 expref: 202 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.064803:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:2.0:1763334978.064809:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334978.064877:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53649:x1848989694564096:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 140us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334978.064885:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 399 00000100:00100000:0.0:1763334978.068177:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.068514:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694564352 00000100:00100000:1.0:1763334978.068534:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694564352 00000100:00100000:1.0:1763334978.068665:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1789 00000100:00100000:1.0:1763334978.068678:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c3769050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53649:x1848989694564352:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334978.069078:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c3769050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53649:x1848989694564352:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 401us (916us total) trans 8589939105 rc 0/0 00000100:00100000:1.0:1763334978.069088:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1789 00000100:00100000:1.0:1763334978.082005:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.082543:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694564608 00000100:00100000:3.0:1763334978.082558:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694564608 00000100:00100000:2.0:1763334978.083966:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4901 00000100:00100000:2.0:1763334978.083985:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53644:x1848989694564608:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334978.084032:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334978.084061:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c399 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b026d expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.085729:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334978.085767:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849c30d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b022e expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.085778:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334978.085838:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849c30d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b022e expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.085858:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849c30d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b022e expref: 203 pid: 30972 timeout: 1142 lvb_type: 0 00000100:00100000:2.0:1763334978.085877:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701867264:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334978.086041:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad9672d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334978.094724:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab35180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701867264:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334978.094776:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334978.096327:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.097163:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694564736 00000100:00100000:0.0:1763334978.097180:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694564736 00010000:00010000:0.0:1763334978.097237:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849c30d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b022e expref: 204 pid: 30972 timeout: 1142 lvb_type: 0 00000100:00100000:0.0:1763334978.097488:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2608 00000100:00100000:0.0:1763334978.097499:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2359:x1848989694564736:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334978.097519:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334978.097527:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849c30d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b022e expref: 204 pid: 30972 timeout: 1142 lvb_type: 0 00010000:00010000:0.0:1763334978.097542:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849c30d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b022e expref: 204 pid: 30972 timeout: 1142 lvb_type: 0 00010000:00010000:0.0:1763334978.097585:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849c30d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b022e expref: 204 pid: 30972 timeout: 1142 lvb_type: 0 00010000:00010000:0.0:1763334978.097608:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:0.0:1763334978.097614:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.097625:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.097634:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.097672:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334978.097755:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:2359:x1848989694564736:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 257us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.097765:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2608 00010000:00010000:2.0:1763334978.097845:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334978.097854:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334978.097878:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 161659 00010000:00010000:2.0:1763334978.098076:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c399 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b026d expref: 204 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.098093:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b026d expref: 203 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.098100:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:2.0:1763334978.098103:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334978.098106:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431a00, rc 0) 00000100:00100000:2.0:1763334978.098139:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694564608:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 14162us (16150us total) trans 8589939106 rc 0/0 00000100:00100000:2.0:1763334978.098147:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4901 00000100:00100000:1.0:1763334978.101120:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334978.101222:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694564864 00000100:00100000:2.0:1763334978.101239:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694564864 00000100:00100000:2.0:1763334978.101411:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4902 00000100:00100000:2.0:1763334978.101422:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694564864:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334978.101456:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334978.101485:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c3ae lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0274 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.101748:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c3b5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334978.101767:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b026d expref: 204 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.101775:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c3b5 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334978.101818:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b026d expref: 204 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.101832:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b026d expref: 204 pid: 32232 timeout: 1142 lvb_type: 0 00000100:00100000:2.0:1763334978.101847:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701867392:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334978.102125:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad9672d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334978.116836:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab35180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701867392:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334978.116891:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c3b5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334978.122560:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.122808:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694564992 00000100:00100000:0.0:1763334978.122822:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694564992 00010000:00010000:0.0:1763334978.122878:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b026d expref: 205 pid: 32232 timeout: 1142 lvb_type: 0 00000100:00100000:0.0:1763334978.122928:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2609 00000100:00100000:0.0:1763334978.122940:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+205:2360:x1848989694564992:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334978.122959:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334978.122968:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b026d expref: 205 pid: 32232 timeout: 1142 lvb_type: 0 00010000:00010000:0.0:1763334978.122982:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b026d expref: 205 pid: 32232 timeout: 1142 lvb_type: 0 00010000:00010000:0.0:1763334978.123012:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c3a0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b026d expref: 205 pid: 32232 timeout: 1142 lvb_type: 0 00010000:00010000:0.0:1763334978.123314:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:0.0:1763334978.123321:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c3b5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.123337:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.123345:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c3b5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.123387:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334978.123465:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2360:x1848989694564992:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 526us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.123475:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2609 00010000:00010000:2.0:1763334978.123724:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334978.123841:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334978.123901:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 161659 00000004:00200000:2.0:1763334978.123907:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334978.123930:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334978.123971:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c3ae lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0274 expref: 204 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.123988:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0274 expref: 203 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.123996:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:2.0:1763334978.123999:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334978.124002:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431c00, rc 0) 00000100:00100000:2.0:1763334978.124319:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694564864:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 22642us (22959us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334978.124331:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4902 00000100:00100000:1.0:1763334978.129117:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.129215:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694565120 00000100:00100000:3.0:1763334978.129229:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694565120 00002000:00100000:3.0:1763334978.129297:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (53248->110591) req@ffff9a5ad809d880 x1848989694565120/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/0 e 0 to 0 dl 1763334989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.129310:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809d880 with x1848989694565120 ext(53248->110591) 00002000:00010000:3.0:1763334978.129318:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad809d880 00000100:00100000:3.0:1763334978.129362:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1829 00000100:00100000:3.0:1763334978.129373:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694565120:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:3.0:1763334978.132553:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694565120:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 3164us (3434us total) trans 0 rc 57344/57344 00000100:00100000:3.0:1763334978.132673:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1829 00002000:00100000:3.0:1763334978.132694:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (53248->110591) req@ffff9a5ad809d880 x1848989694565120/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/440 e 0 to 0 dl 1763334989 ref 1 fl Complete:/600/0 rc 57344/57344 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.132705:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809d880 with x1848989694565120 ext(53248->110591) 00002000:00010000:3.0:1763334978.132713:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad809d880 00000100:00100000:1.0:1763334978.138322:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334978.139325:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694565376 00000100:00100000:2.0:1763334978.139341:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694565376 00000100:00100000:2.0:1763334978.139420:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4903 00000100:00100000:2.0:1763334978.139434:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694565376:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334978.139505:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334978.139539:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c3b5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0274 expref: 203 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.139562:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:2.0:1763334978.139567:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334978.141820:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c3bc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.141851:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c3bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.141866:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c3bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:0.0:1763334978.141932:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939107 00000004:00010000:0.0:1763334978.141961:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001a6cc527 reply state 000000006e174777 transno 8589939108 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c3bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334978.141971:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334978.142152:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694565376:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 2713us (3840us total) trans 8589939108 rc 0/0 00000100:00100000:0.0:1763334978.142163:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4903 00000020:00080000:0.0:1763334978.142170:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763334978.148346:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334978.148452:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694565632 00000100:00100000:2.0:1763334978.148465:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694565632 00000100:00100000:2.0:1763334978.148535:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1790 00000100:00100000:2.0:1763334978.148545:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694565632:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:2.0:1763334978.149095:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+206:53644:x1848989694565632:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 547us (764us total) trans 8589939109 rc 0/0 00000100:00100000:2.0:1763334978.149104:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1790 00010000:00010000:0.0:1763334978.149962:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c3bc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.149978:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c3bc lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.149989:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c3bc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.149996:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334978.150001:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c3bc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.150011:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c3bc lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.150044:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:0.0:1763334978.150047:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334978.150053:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c3bc lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.150060:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c3bc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334978.154280:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.154420:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694565888 00000100:00100000:1.0:1763334978.154435:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694565888 00000100:00100000:1.0:1763334978.154513:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4904 00000100:00100000:1.0:1763334978.154525:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeefe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694565888:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334978.154559:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334978.154563:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1763334978.154637:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c31b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0235 expref: 205 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.154662:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c2ea lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0227 expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.154673:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de600) 00010000:00010000:1.0:1763334978.154686:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334978.154704:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c3c3 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b027b expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.154768:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c3ca lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334978.154782:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c3ca lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334978.154792:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c3ca lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000040:00080000:1.0:1763334978.155354:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1148, 88 off98216 00000004:00080000:1.0:1763334978.155366:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1042788793375ns, next at 1040839994511ns, rc = 0 00000040:00080000:1.0:1763334978.157869:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1137, 88 off97128 00000004:00080000:1.0:1763334978.157897:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1042791324551ns, next at 1040839334561ns, rc = 0 00000040:00080000:1.0:1763334978.158416:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1138, 88 off97216 00000004:00080000:1.0:1763334978.158426:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1042791853760ns, next at 1040839334561ns, rc = 0 00000040:00080000:1.0:1763334978.160235:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1149, 88 off98304 00000004:00080000:1.0:1763334978.160254:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1042793682044ns, next at 1040839994511ns, rc = 0 00000040:00080000:1.0:1763334978.160352:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1150, 88 off98392 00000004:00080000:1.0:1763334978.160357:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1042793785452ns, next at 1040839994511ns, rc = 0 00000040:00080000:1.0:1763334978.160380:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1139, 88 off97304 00000004:00080000:1.0:1763334978.160383:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1042793811756ns, next at 1040839334561ns, rc = 0 00000040:00080000:1.0:1763334978.161511:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1140, 88 off97392 00000004:00080000:1.0:1763334978.161526:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1042794954024ns, next at 1040839334561ns, rc = 0 00000040:00080000:1.0:1763334978.164021:0:32232:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1151, 88 off98480 00000004:00080000:1.0:1763334978.164055:0:32232:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1042797482264ns, next at 1040839994511ns, rc = 0 00000001:00080000:3.0:1763334978.230020:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939108 is committed 00010000:00010000:0.0:1763334978.230040:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c3ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b027b expref: 206 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.230063:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fad00) 00000001:00080000:3.0:1763334978.230064:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939110 is committed 00010000:00010000:0.0:1763334978.230068:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00000004:00080000:3.0:1763334978.230073:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 763 committed 00000004:00080000:3.0:1763334978.230090:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 751 committed 00000004:00080000:3.0:1763334978.230099:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 750 committed 00000004:00080000:3.0:1763334978.230102:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 762 committed 00000004:00080000:3.0:1763334978.230106:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 761 committed 00000004:00080000:3.0:1763334978.230108:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 749 committed 00000004:00080000:3.0:1763334978.230111:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 748 committed 00010000:00010000:0.0:1763334978.230114:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c3c3 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b027b expref: 202 pid: 32232 timeout: 0 lvb_type: 3 00000004:00080000:3.0:1763334978.230115:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 760 committed 00010000:00010000:0.0:1763334978.230143:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c3ca lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b027b expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00000020:00080000:3.0:1763334978.230167:0:32265:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a5ac3530d80 refcount 2 committed 0 result 0 batchid 4294969316 00000020:00080000:3.0:1763334978.230174:0:32265:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5ac8d70300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a5af687b600 00000020:00080000:3.0:1763334978.230177:0:32265:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5ac8d70600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a59c25a8900 00000020:00080000:3.0:1763334978.230181:0:32265:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5ac8d70800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a5ac6c1c400 00000020:00080000:3.0:1763334978.230184:0:32265:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].10 00010000:00010000:0.0:1763334978.230197:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fad00) 00010000:00010000:0.0:1763334978.230201:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1763334978.230205:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:0.0:1763334978.230312:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeefe7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694565888:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 75786us (76046us total) trans 8589939110 rc 0/0 00000100:00100000:0.0:1763334978.230323:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4904 00000020:00080000:3.0:1763334978.230463:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969316 committed batchid 4294969315 00000100:00100000:2.0:1763334978.230665:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701867904:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334978.230740:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1763334978.230751:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969315 00000100:00100000:3.0:1763334978.230768:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701867648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334978.230805:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334978.230824:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763334978.230834:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeefe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701867520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334978.230836:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763334978.230846:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701867776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334978.232275:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701867904 00000100:00100000:0.0:1763334978.232296:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701867904 00000100:00100000:0.0:1763334978.232360:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701867648 00000100:00100000:0.0:1763334978.232364:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701867648 00000100:00100000:0.0:1763334978.232394:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4970 00000100:00100000:0.0:1763334978.232405:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+7:3291:x1848989701867904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334978.232726:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334978.232731:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334977 -> 1763334977 00002000:00010000:0.0:1763334978.232734:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334978.232737:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334978 -> 1763334978 00002000:00010000:0.0:1763334978.232740:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334978.232789:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334978.232806:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701867904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 402us (2064us total) trans 17179871174 rc 0/0 00000100:00100000:0.0:1763334978.232816:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4970 00000100:00100000:0.0:1763334978.232842:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701867776 00000100:00100000:0.0:1763334978.232846:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701867776 00000100:00100000:0.0:1763334978.232873:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4971 00000100:00100000:0.0:1763334978.232882:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701867648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334978.232887:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4972 00000100:00100000:3.0:1763334978.232901:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701867776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334978.233001:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334978.233004:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334977 -> 1763334977 00002000:00010000:0.0:1763334978.233006:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334978.233009:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334978 -> 1763334978 00002000:00010000:0.0:1763334978.233012:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334978.233061:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701867648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (2255us total) trans 17179871175 rc 0/0 00000100:00100000:0.0:1763334978.233069:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4971 00002000:00010000:3.0:1763334978.233078:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb size from disk: 73013 -> 73013 00002000:00010000:3.0:1763334978.233083:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334978.233085:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334978.233088:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:3.0:1763334978.233090:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:3.0:1763334978.233120:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701867776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 224us (334us total) trans 17179871176 rc 0/0 00000100:00100000:3.0:1763334978.233127:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4972 00000004:00080000:3.0:1763334978.233179:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca873100/2, rc 0, transno 17179871176 00000100:00100000:3.0:1763334978.233189:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701867776:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334978.233200:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeefe6680/2, rc 0, transno 17179871175 00000100:00100000:3.0:1763334978.233204:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701867648:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334978.235189:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701868032:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334978.235292:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334978.235365:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334978.235373:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeecebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701868416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334978.235401:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334978.235897:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1763334978.237930:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca870e00/2, rc 0, transno 17179871174 00000100:00100000:2.0:1763334978.237951:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca870e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701867904:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334978.238008:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701868032 00000100:00100000:0.0:1763334978.238019:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701868032 00000100:00100000:0.0:1763334978.238115:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701868416 00000100:00100000:0.0:1763334978.238120:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701868416 00000100:00100000:0.0:1763334978.238144:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701867520 00000100:00100000:0.0:1763334978.238147:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701867520 00000100:00100000:0.0:1763334978.238174:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4973 00000100:00100000:0.0:1763334978.238185:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3292:x1848989701868032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334978.238225:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4974 00000100:00100000:1.0:1763334978.238238:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3292:x1848989701868416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334978.238987:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4975 00000100:00100000:2.0:1763334978.239000:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701867520:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763334978.239275:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 161659 -> 161659 00002000:00010000:2.0:1763334978.239279:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334977 -> 1763334977 00002000:00010000:2.0:1763334978.239282:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334978.239284:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334978 -> 1763334978 00002000:00010000:2.0:1763334978.239286:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 161 -> 161 00000100:00100000:2.0:1763334978.239369:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb346450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701867520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 372us (3475us total) trans 17179871177 rc 0/0 00000100:00100000:2.0:1763334978.239376:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4975 00000004:00080000:2.0:1763334978.239628:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeefe4a80/2, rc 0, transno 17179871177 00000100:00100000:2.0:1763334978.239636:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeefe4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701867520:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334978.241649:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeeceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701868288:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334978.241751:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334978.241802:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763334978.241810:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701868160:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334978.241832:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334978.241903:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.241996:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701868288 00000100:00100000:3.0:1763334978.242008:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701868288 00000100:00100000:3.0:1763334978.242066:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4976 00000100:00100000:3.0:1763334978.242077:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3290:x1848989701868288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334978.242258:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701868160 00000100:00100000:1.0:1763334978.242263:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701868160 00000100:00100000:0.0:1763334978.242281:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694566016 00000100:00100000:0.0:1763334978.242287:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694566016 00000100:00100000:1.0:1763334978.242297:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4977 00000100:00100000:1.0:1763334978.242308:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3290:x1848989701868160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334978.242317:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4978 00000100:00100000:0.0:1763334978.242326:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+26:53644:x1848989694566016:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334978.242338:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334978.242360:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c3d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0282 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.242392:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c384 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0266 expref: 27 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334978.242401:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334978.242404:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334978.242409:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c3d1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0282 expref: 27 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.242447:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c384 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0266 expref: 27 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334978.242468:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c384 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0266 expref: 27 pid: 26564 timeout: 1142 lvb_type: 1 00000100:00100000:0.0:1763334978.242480:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701868544:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334978.242553:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c96eeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1763334978.242638:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701868416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 4403us (7234us total) trans 21474838445 rc 0/0 00000100:00100000:1.0:1763334978.242648:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4974 00000004:00080000:0.0:1763334978.242676:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeecebb80/2, rc 0, transno 21474838445 00000100:00100000:0.0:1763334978.242684:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeecebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701868416:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334978.243165:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334978.243170:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334977 -> 1763334977 00002000:00010000:1.0:1763334978.243172:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334978.243175:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334978 -> 1763334978 00002000:00010000:1.0:1763334978.243178:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334978.243243:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3290:x1848989701868160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 938us (1408us total) trans 21474838447 rc 0/0 00000100:00100000:1.0:1763334978.243258:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4977 00000004:00080000:0.0:1763334978.243270:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa766680/2, rc 0, transno 21474838447 00000100:00100000:0.0:1763334978.243278:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa766680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701868160:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334978.243319:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334978.243323:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334978.243325:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334978.243328:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334978.243330:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:2.0:1763334978.243400:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701868032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5214us (8106us total) trans 21474838446 rc 0/0 00000100:00100000:2.0:1763334978.243408:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4973 00000004:00080000:0.0:1763334978.243412:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa766d80/2, rc 0, transno 21474838446 00000100:00100000:0.0:1763334978.243419:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa766d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701868032:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334978.243648:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334978.243652:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334978.243655:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334978.243657:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:3.0:1763334978.243659:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334978.243716:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3290:x1848989701868288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1640us (1965us total) trans 21474838448 rc 0/0 00000100:00100000:3.0:1763334978.243730:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4976 00000004:00080000:0.0:1763334978.246463:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeeceb100/2, rc 0, transno 21474838448 00000100:00100000:0.0:1763334978.246483:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeeceb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701868288:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334978.256539:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.256686:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694566144 00000100:00100000:1.0:1763334978.256699:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694566144 00010000:00010000:1.0:1763334978.256768:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c384 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0266 expref: 28 pid: 26564 timeout: 1142 lvb_type: 1 00000100:00100000:1.0:1763334978.256821:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2610 00000100:00100000:1.0:1763334978.256833:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694566144:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334978.256853:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334978.256882:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c384 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0266 expref: 28 pid: 26564 timeout: 1142 lvb_type: 1 00010000:00010000:1.0:1763334978.256898:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c384 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0266 expref: 28 pid: 26564 timeout: 1142 lvb_type: 1 00010000:00010000:1.0:1763334978.256932:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334978.256934:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334978.256944:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c3d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0282 expref: 28 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.256955:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c3d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0282 expref: 28 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.257008:0:6532:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c3d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0282 expref: 28 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334978.257038:0:6532:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6532:1848989701868672:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334978.257159:0:6532:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7840 going to sleep for 11 seconds 00010000:00010000:2.0:1763334978.258169:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c384 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0266 expref: 28 pid: 26564 timeout: 1142 lvb_type: 1 00000100:00100000:2.0:1763334978.258192:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701868544:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334978.258230:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c3d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0282 expref: 27 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.258244:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:2.0:1763334978.258319:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:53644:x1848989694566016:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 15992us (16417us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334978.258334:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4978 00000100:00100000:1.0:1763334978.262665:0:6532:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6532:1848989701868672:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334978.262711:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334978.262808:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694566144:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5975us (6281us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334978.262823:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2610 00000100:00100000:3.0:1763334978.265511:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.268167:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694566272 00000100:00100000:0.0:1763334978.268192:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694566272 00002000:00010000:0.0:1763334978.268960:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (262144->18446744073709551615) 00002000:00100000:0.0:1763334978.268967:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d4000 with x1848989694566272 ext(262144->18446744073709551615) 00002000:00010000:0.0:1763334978.268986:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d4000. 00000100:00100000:0.0:1763334978.269054:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1830 00000100:00100000:0.0:1763334978.269067:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694566272:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334978.269371:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 161659 -> 262144 00002000:00010000:0.0:1763334978.269376:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334977 -> 1763334978 00002000:00010000:0.0:1763334978.269379:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334978.269381:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334978 -> 1763334978 00002000:00010000:0.0:1763334978.269384:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 161 -> 161 00000100:00100000:0.0:1763334978.269473:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2362:x1848989694566272:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 407us (3976us total) trans 17179871178 rc 0/0 00000100:00100000:0.0:1763334978.269481:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1830 00002000:00010000:0.0:1763334978.269486:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (262144->18446744073709551615) 00002000:00100000:0.0:1763334978.269489:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d4000 with x1848989694566272 ext(262144->18446744073709551615) 00002000:00010000:0.0:1763334978.269493:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d4000. 00000100:00100000:0.0:1763334978.269594:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.269619:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694566400 00000100:00100000:0.0:1763334978.269626:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694566400 00002000:00010000:0.0:1763334978.269645:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334978.269648:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1f0700 with x1848989694566400 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334978.269657:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afb1f0700. 00000100:00100000:0.0:1763334978.269674:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1831 00000100:00100000:0.0:1763334978.269680:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2362:x1848989694566400:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334978.269827:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334978.269830:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334977 -> 1763334978 00002000:00010000:0.0:1763334978.269832:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334978.269835:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334978 -> 1763334978 00002000:00010000:0.0:1763334978.269837:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334978.269861:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2362:x1848989694566400:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 180us (288us total) trans 21474838449 rc 0/0 00000100:00100000:0.0:1763334978.269868:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1831 00002000:00010000:0.0:1763334978.269871:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334978.269874:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1f0700 with x1848989694566400 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334978.269878:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afb1f0700. 00000100:00100000:0.0:1763334978.270037:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.270058:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694566528 00000100:00100000:0.0:1763334978.270062:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694566528 00002000:00010000:0.0:1763334978.270076:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334978.270080:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1f1500 with x1848989694566528 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334978.270087:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1f1500. 00000100:00100000:0.0:1763334978.270102:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1832 00000100:00100000:0.0:1763334978.270108:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2362:x1848989694566528:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334978.270215:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334978.270218:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334977 -> 1763334978 00002000:00010000:0.0:1763334978.270220:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334978.270222:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334978 -> 1763334978 00002000:00010000:0.0:1763334978.270224:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334978.270245:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2362:x1848989694566528:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 137us (208us total) trans 17179871179 rc 0/0 00000100:00100000:0.0:1763334978.270252:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1832 00002000:00010000:0.0:1763334978.270256:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334978.270258:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1f1500 with x1848989694566528 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334978.270262:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1f1500. 00000100:00100000:2.0:1763334978.279314:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.279488:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694566656 00000100:00100000:3.0:1763334978.279503:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694566656 00002000:00100000:3.0:1763334978.279615:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (241664->245759) req@ffff9a5afab35c00 x1848989694566656/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/0 e 0 to 0 dl 1763334989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.279628:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab35c00 with x1848989694566656 ext(241664->245759) 00002000:00010000:3.0:1763334978.279636:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab35c00 00000100:00100000:3.0:1763334978.279666:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1833 00000100:00100000:3.0:1763334978.279677:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2362:x1848989694566656:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:3.0:1763334978.280007:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2362:x1848989694566656:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 329us (707us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763334978.280017:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1833 00002000:00100000:3.0:1763334978.280036:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (241664->245759) req@ffff9a5afab35c00 x1848989694566656/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/4536 e 0 to 0 dl 1763334989 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.280045:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab35c00 with x1848989694566656 ext(241664->245759) 00002000:00010000:3.0:1763334978.280049:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab35c00 00000100:00100000:2.0:1763334978.290487:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.291219:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694566784 00000100:00100000:0.0:1763334978.291237:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694566784 00002000:00100000:2.0:1763334978.291509:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (245760->249855) req@ffff9a5afab35180 x1848989694566784/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/0 e 0 to 0 dl 1763334989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334978.291523:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab35180 with x1848989694566784 ext(245760->249855) 00002000:00010000:2.0:1763334978.291531:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab35180 00000100:00100000:2.0:1763334978.291604:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1834 00000100:00100000:2.0:1763334978.291615:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2361:x1848989694566784:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:2.0:1763334978.291974:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2361:x1848989694566784:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 360us (1505us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763334978.291983:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1834 00002000:00100000:2.0:1763334978.291991:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (245760->249855) req@ffff9a5afab35180 x1848989694566784/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/4536 e 0 to 0 dl 1763334989 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334978.291998:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab35180 with x1848989694566784 ext(245760->249855) 00002000:00010000:2.0:1763334978.292002:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab35180 00000100:00100000:1.0:1763334978.296733:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334978.296877:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694566912 00000100:00100000:2.0:1763334978.297107:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694566912 00002000:00100000:2.0:1763334978.297188:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (221184->262143) req@ffff9a5aeece9c00 x1848989694566912/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 504/0 e 0 to 0 dl 1763334989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334978.297203:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece9c00 with x1848989694566912 ext(221184->262143) 00002000:00010000:2.0:1763334978.297210:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece9c00 00000100:00100000:2.0:1763334978.297255:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1835 00000100:00100000:2.0:1763334978.297269:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2361:x1848989694566912:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:2.0:1763334978.300521:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2361:x1848989694566912:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 3234us (3788us total) trans 0 rc 32768/32768 00000100:00100000:2.0:1763334978.300543:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1835 00002000:00100000:2.0:1763334978.300562:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (221184->262143) req@ffff9a5aeece9c00 x1848989694566912/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 504/440 e 0 to 0 dl 1763334989 ref 1 fl Complete:/600/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334978.300626:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece9c00 with x1848989694566912 ext(221184->262143) 00002000:00010000:2.0:1763334978.300635:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece9c00 00000100:00100000:0.0:1763334978.305014:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334978.305139:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694567040 00000100:00100000:2.0:1763334978.305153:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694567040 00002000:00100000:2.0:1763334978.305218:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (241664->262143) req@ffff9a5ad88bd500 x1848989694567040/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/0 e 0 to 0 dl 1763334989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334978.305231:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad88bd500 with x1848989694567040 ext(241664->262143) 00002000:00010000:2.0:1763334978.305239:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad88bd500 00000100:00100000:2.0:1763334978.305624:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1836 00000100:00100000:2.0:1763334978.305637:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2361:x1848989694567040:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:2.0:1763334978.309197:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2361:x1848989694567040:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 3545us (4181us total) trans 17179871180 rc 0/0 00000100:00100000:2.0:1763334978.309215:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1836 00002000:00100000:2.0:1763334978.309231:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (241664->262143) req@ffff9a5ad88bd500 x1848989694567040/t17179871180(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/448 e 0 to 0 dl 1763334989 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334978.309244:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad88bd500 with x1848989694567040 ext(241664->262143) 00002000:00010000:2.0:1763334978.309252:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad88bd500 00000100:00100000:0.0:1763334978.313135:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334978.313269:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694567168 00000100:00100000:2.0:1763334978.313283:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694567168 00000100:00100000:2.0:1763334978.313361:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4979 00000100:00100000:2.0:1763334978.313373:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad88bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2362:x1848989694567168:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:2.0:1763334978.358943:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871179 is committed 00000001:00080000:2.0:1763334978.358969:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871175 is committed 00000001:00080000:2.0:1763334978.358996:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871180 is committed 00000001:00080000:2.0:1763334978.359009:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871177 is committed 00000100:00100000:0.0:1763334978.359354:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad88bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2362:x1848989694567168:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 45972us (46226us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.359372:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4979 00000100:00100000:0.0:1763334978.363550:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.363706:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694567296 00000100:00100000:1.0:1763334978.363719:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694567296 00000100:00100000:1.0:1763334978.363791:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4905 00000100:00100000:1.0:1763334978.363802:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694567296:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334978.363835:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334978.363864:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c3d8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0289 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.363980:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c3df lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334978.363998:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c3df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334978.364011:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c3df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:1.0:1763334978.364054:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 262146 00000004:00200000:1.0:1763334978.364059:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334978.364080:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c3df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334978.364112:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c3d8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0289 expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.364133:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c3df lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0289 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.364143:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fad00) 00010000:00010000:1.0:1763334978.364146:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334978.364150:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478800, rc 0) 00000100:00100000:1.0:1763334978.364228:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694567296:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 427us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334978.364236:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4905 00000100:00100000:1.0:1763334978.368081:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.368190:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694567552 00000100:00100000:3.0:1763334978.368205:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694567552 00000100:00100000:3.0:1763334978.368283:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4906 00000100:00100000:3.0:1763334978.368296:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694567552:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:3.0:1763334978.368371:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1763334978.368413:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c3df lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0289 expref: 189 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.368441:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c3ca lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b027b expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.368455:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fad00) 00010000:00010000:3.0:1763334978.368468:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334978.368909:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3e6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.368928:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3e6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.368941:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3e6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:3.0:1763334978.369015:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939111 00000004:00010000:3.0:1763334978.369061:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000da1e55cc reply state 0000000003f008ba transno 8589939112 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3e6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334978.369071:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334978.369199:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694567552:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 904us (1133us total) trans 8589939112 rc 0/0 00000100:00100000:3.0:1763334978.369209:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4906 00000020:00080000:3.0:1763334978.369216:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1763334978.373928:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3e6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334978.373952:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3e6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334978.373961:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3e6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334978.373968:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334978.373973:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3e6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334978.373980:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3e6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334978.374001:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:2.0:1763334978.374004:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334978.374008:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3e6 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334978.374015:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3e6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334978.375295:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.376033:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694567680 00000100:00100000:0.0:1763334978.376049:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694567680 00000100:00100000:0.0:1763334978.376124:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4907 00000100:00100000:0.0:1763334978.376135:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c3c4d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694567680:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334978.376167:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334978.376199:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c3ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0290 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.376279:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c3ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0290 expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.376296:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c3ed lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0290 expref: 190 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.376320:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334978.376324:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334978.376329:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334978.376414:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c3c4d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694567680:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 280us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.376423:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4907 00000100:00100000:3.0:1763334978.381392:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.381442:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.381482:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.381605:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694567808 00000100:00100000:1.0:1763334978.381621:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694567808 00002000:00010000:1.0:1763334978.381683:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (204328->18446744073709551615) 00002000:00100000:1.0:1763334978.381689:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d5c00 with x1848989694567808 ext(204328->18446744073709551615) 00002000:00010000:1.0:1763334978.381707:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d5c00. 00000100:00100000:1.0:1763334978.381743:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694568064 00000100:00100000:1.0:1763334978.381747:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694568064 00002000:00010000:1.0:1763334978.381762:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763334978.381765:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d6a00 with x1848989694568064 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334978.381772:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d6a00. 00000100:00100000:1.0:1763334978.381789:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694567936 00000100:00100000:1.0:1763334978.381793:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694567936 00002000:00010000:1.0:1763334978.381806:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334978.381809:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d6680 with x1848989694567936 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334978.381818:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aee9d6680. 00000100:00100000:1.0:1763334978.382164:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1837 00000100:00100000:1.0:1763334978.382180:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694567808:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:2.0:1763334978.382365:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1838 00000100:00100000:2.0:1763334978.382378:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694568064:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:0.0:1763334978.382480:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1839 00000100:00100000:0.0:1763334978.382494:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694567936:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334978.382780:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334978.382785:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334978 -> 1763334979 00002000:00010000:0.0:1763334978.382789:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334978.382791:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334978 -> 1763334979 00002000:00010000:0.0:1763334978.382794:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334978.382881:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2361:x1848989694567936:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 389us (1396us total) trans 21474838450 rc 0/0 00000100:00100000:0.0:1763334978.382889:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1839 00002000:00010000:0.0:1763334978.382894:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334978.382903:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d6680 with x1848989694567936 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334978.382910:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aee9d6680. 00002000:00010000:2.0:1763334978.383534:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334978.383538:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334978 -> 1763334979 00002000:00010000:2.0:1763334978.383541:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334978.383543:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334978 -> 1763334979 00002000:00010000:2.0:1763334978.383545:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334978.383604:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2361:x1848989694568064:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 1228us (2159us total) trans 17179871181 rc 0/0 00000100:00100000:2.0:1763334978.383611:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1838 00002000:00010000:2.0:1763334978.383615:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:2.0:1763334978.383618:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d6a00 with x1848989694568064 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334978.383624:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d6a00. 00002000:00010000:1.0:1763334978.383865:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 262144 -> 204328 00002000:00010000:1.0:1763334978.383869:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334978 -> 1763334979 00002000:00010000:1.0:1763334978.383871:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334978.383873:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334978 -> 1763334979 00002000:00010000:1.0:1763334978.383875:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 161 -> 201 00000100:00100000:1.0:1763334978.383900:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2361:x1848989694567808:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 1724us (2526us total) trans 17179871182 rc 0/0 00000100:00100000:1.0:1763334978.383908:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1837 00002000:00010000:1.0:1763334978.383910:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (204328->18446744073709551615) 00002000:00100000:1.0:1763334978.383913:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d5c00 with x1848989694567808 ext(204328->18446744073709551615) 00002000:00010000:1.0:1763334978.383918:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d5c00. 00000100:00100000:2.0:1763334978.387856:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.387963:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694568192 00000100:00100000:3.0:1763334978.387977:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694568192 00000100:00100000:3.0:1763334978.388065:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4908 00000100:00100000:3.0:1763334978.388079:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694568192:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334978.388106:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334978.388136:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c3f4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0297 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.388245:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3fb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.388274:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.388288:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334978.388329:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 204328 00000004:00200000:3.0:1763334978.388334:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334978.388357:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3fb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.388388:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c3f4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0297 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.388412:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3fb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0297 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.388422:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:3.0:1763334978.388425:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334978.388429:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:3.0:1763334978.388513:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694568192:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 437us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334978.388522:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4908 00000100:00100000:1.0:1763334978.406767:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.406880:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694568320 00000100:00100000:3.0:1763334978.406896:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694568320 00002000:00100000:3.0:1763334978.406968:0:21629:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x24a:0x0] (155648->217087) req@ffff9a5aeece8380 x1848989694568320/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/0 e 0 to 0 dl 1763334989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.406987:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece8380 with x1848989694568320 ext(155648->217087) 00002000:00010000:3.0:1763334978.406994:0:21629:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece8380 00000100:00100000:3.0:1763334978.407045:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1840 00000100:00100000:3.0:1763334978.407057:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694568320:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:3.0:1763334978.412385:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694568320:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 5312us (5617us total) trans 0 rc 49152/49152 00000100:00100000:3.0:1763334978.412403:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1840 00002000:00100000:3.0:1763334978.412421:0:21629:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x24a:0x0] (155648->217087) req@ffff9a5aeece8380 x1848989694568320/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/440 e 0 to 0 dl 1763334989 ref 1 fl Complete:/600/0 rc 49152/49152 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.412433:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece8380 with x1848989694568320 ext(155648->217087) 00002000:00010000:3.0:1763334978.412441:0:21629:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece8380 00010000:00010000:1.0:1763334978.414281:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334978.423568:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.423817:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694568448 00000100:00100000:3.0:1763334978.423832:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694568448 00002000:00100000:3.0:1763334978.423901:0:21629:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x24a:0x0] (176128->245938) req@ffff9a5afa77df80 x1848989694568448/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 504/0 e 0 to 0 dl 1763334989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.423914:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77df80 with x1848989694568448 ext(176128->245938) 00002000:00010000:3.0:1763334978.423921:0:21629:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77df80 00000100:00100000:3.0:1763334978.424509:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1841 00000100:00100000:3.0:1763334978.424525:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694568448:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:3.0:1763334978.427868:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2362:x1848989694568448:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 3333us (4302us total) trans 17179871183 rc 0/0 00000100:00100000:3.0:1763334978.427888:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1841 00002000:00100000:3.0:1763334978.427903:0:21629:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x24a:0x0] (176128->245938) req@ffff9a5afa77df80 x1848989694568448/t17179871183(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 504/448 e 0 to 0 dl 1763334989 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.427915:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77df80 with x1848989694568448 ext(176128->245938) 00002000:00010000:3.0:1763334978.427923:0:21629:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77df80 00000100:00100000:1.0:1763334978.434166:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.434337:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694568576 00000100:00100000:0.0:1763334978.434350:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694568576 00000100:00100000:1.0:1763334978.434516:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4980 00000100:00100000:1.0:1763334978.434528:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2361:x1848989694568576:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:3.0:1763334978.469993:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871182 is committed 00000001:00080000:3.0:1763334978.470057:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871183 is committed 00000100:00100000:0.0:1763334978.470366:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694568576:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 35830us (36204us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.470381:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4980 00000100:00100000:0.0:1763334978.476641:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.476919:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694568704 00000100:00100000:3.0:1763334978.476934:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694568704 00002000:00100000:3.0:1763334978.477005:0:21629:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x24a:0x0] (204800->241663) req@ffff9a5afa77fb80 x1848989694568704/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/0 e 0 to 0 dl 1763334989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.477029:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77fb80 with x1848989694568704 ext(204800->241663) 00002000:00010000:3.0:1763334978.477036:0:21629:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77fb80 00000100:00100000:3.0:1763334978.477067:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1842 00000100:00100000:3.0:1763334978.477079:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694568704:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:3.0:1763334978.481092:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694568704:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 3999us (4451us total) trans 17179871184 rc 0/0 00000100:00100000:3.0:1763334978.481111:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1842 00002000:00100000:3.0:1763334978.481126:0:21629:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x24a:0x0] (204800->241663) req@ffff9a5afa77fb80 x1848989694568704/t17179871184(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/448 e 0 to 0 dl 1763334989 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.481138:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77fb80 with x1848989694568704 ext(204800->241663) 00002000:00010000:3.0:1763334978.481145:0:21629:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77fb80 00000100:00100000:0.0:1763334978.486963:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.487086:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694568832 00000100:00100000:1.0:1763334978.487100:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694568832 00000100:00100000:1.0:1763334978.487172:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4981 00000100:00100000:1.0:1763334978.487183:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694568832:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:3.0:1763334978.519909:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871184 is committed 00000100:00100000:0.0:1763334978.519909:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694568832:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 32710us (32942us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.519925:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4981 00000100:00100000:0.0:1763334978.525410:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.525956:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694569088 00000100:00100000:3.0:1763334978.525974:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694569088 00000100:00100000:3.0:1763334978.526074:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4909 00000100:00100000:3.0:1763334978.526089:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694569088:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:3.0:1763334978.526172:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334978.526210:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c3fb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0297 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.526236:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:3.0:1763334978.526243:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334978.526556:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c402 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.526621:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c402 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.526632:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c402 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:3.0:1763334978.526695:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939113 00000004:00010000:3.0:1763334978.526739:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000829013fd reply state 00000000261aed5b transno 8589939114 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c402 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334978.526749:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334978.526889:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53644:x1848989694569088:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 802us (1494us total) trans 8589939114 rc 0/0 00000100:00100000:3.0:1763334978.526898:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4909 00000020:00080000:3.0:1763334978.526905:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763334978.538397:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.538433:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.538702:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334978.538768:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c402 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334978.538787:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c402 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334978.538797:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c402 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334978.538806:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334978.538811:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c402 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334978.538821:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c402 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334978.538846:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334978.538850:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334978.538857:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c402 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334978.538863:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c402 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334978.539069:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694569216 00000100:00100000:2.0:1763334978.539084:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694569216 00002000:00010000:2.0:1763334978.539143:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (102616->18446744073709551615) 00002000:00100000:2.0:1763334978.539148:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece8700 with x1848989694569216 ext(102616->18446744073709551615) 00002000:00010000:2.0:1763334978.539162:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece8700. 00000100:00100000:3.0:1763334978.539221:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694569344 00000100:00100000:3.0:1763334978.539227:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694569344 00002000:00010000:3.0:1763334978.539246:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:3.0:1763334978.539250:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeeceaa00 with x1848989694569344 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334978.539258:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeeceaa00. 00000100:00100000:2.0:1763334978.539447:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694569472 00000100:00100000:2.0:1763334978.539451:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694569472 00002000:00010000:2.0:1763334978.539465:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:2.0:1763334978.539468:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeecea680 with x1848989694569472 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334978.539474:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeecea680. 00000100:00100000:1.0:1763334978.539526:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1843 00000100:00100000:1.0:1763334978.539540:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694569216:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334978.540249:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 204328 -> 102616 00002000:00010000:1.0:1763334978.540256:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:1.0:1763334978.540259:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334978.540261:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:1.0:1763334978.540264:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 201 -> 309 00000100:00100000:1.0:1763334978.540361:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694569216:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 822us (1983us total) trans 17179871185 rc 0/0 00000100:00100000:1.0:1763334978.540370:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1843 00002000:00010000:1.0:1763334978.540376:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (102616->18446744073709551615) 00002000:00100000:1.0:1763334978.540378:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece8700 with x1848989694569216 ext(102616->18446744073709551615) 00002000:00010000:1.0:1763334978.540383:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece8700. 00000100:00100000:1.0:1763334978.540406:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1844 00000100:00100000:1.0:1763334978.540415:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694569344:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334978.540551:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334978.540554:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:1.0:1763334978.540557:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334978.540559:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:1.0:1763334978.540561:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334978.540612:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694569344:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 198us (2178us total) trans 21474838451 rc 0/0 00000100:00100000:1.0:1763334978.540619:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1844 00002000:00010000:1.0:1763334978.540622:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334978.540625:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeeceaa00 with x1848989694569344 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334978.540632:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeeceaa00. 00000100:00100000:1.0:1763334978.540648:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1845 00000100:00100000:1.0:1763334978.540654:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694569472:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334978.540760:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334978.540764:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:1.0:1763334978.540766:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334978.540769:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:1.0:1763334978.540772:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334978.540793:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694569472:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 138us (2091us total) trans 17179871186 rc 0/0 00000100:00100000:1.0:1763334978.540800:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1845 00002000:00010000:1.0:1763334978.540803:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763334978.540805:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeecea680 with x1848989694569472 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334978.540810:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeecea680. 00000100:00100000:2.0:1763334978.545552:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.545713:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694569600 00000100:00100000:0.0:1763334978.545728:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694569600 00000100:00100000:3.0:1763334978.546429:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4910 00000100:00100000:3.0:1763334978.546449:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53644:x1848989694569600:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334978.546486:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334978.546512:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c409 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b029e expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.546660:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c410 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.546678:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c410 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.546693:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c410 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334978.546730:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 102616 00000004:00200000:3.0:1763334978.546735:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334978.546759:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c410 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.546792:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c409 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b029e expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.546811:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c410 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b029e expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.546821:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:3.0:1763334978.546824:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334978.546828:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:3.0:1763334978.546937:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53644:x1848989694569600:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 494us (1401us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334978.546945:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4910 00000100:00100000:1.0:1763334978.552135:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.552226:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694569856 00000100:00100000:3.0:1763334978.552240:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694569856 00000100:00100000:3.0:1763334978.552404:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4911 00000100:00100000:3.0:1763334978.552416:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53644:x1848989694569856:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:3.0:1763334978.552490:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334978.552526:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c410 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b029e expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.552549:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:3.0:1763334978.552555:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334978.553444:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c417 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.553469:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c417 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.553483:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c417 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:3.0:1763334978.553554:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939115 00000004:00010000:3.0:1763334978.553611:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000ae4939a5 reply state 00000000a379519b transno 8589939116 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c417 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334978.553622:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334978.554399:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694569856:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 1976us (2270us total) trans 8589939116 rc 0/0 00000100:00100000:3.0:1763334978.554410:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4911 00000020:00080000:3.0:1763334978.554419:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1763334978.557535:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c417 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334978.557565:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c417 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334978.557690:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c417 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334978.557697:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334978.557703:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c417 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334978.557711:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c417 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334978.557733:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:2.0:1763334978.557736:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334978.557742:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c417 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334978.557748:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c417 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334978.561707:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.561823:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.561931:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694569984 00000100:00100000:3.0:1763334978.561945:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694569984 00002000:00010000:3.0:1763334978.562005:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (217778->18446744073709551615) 00002000:00100000:3.0:1763334978.562011:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece9f80 with x1848989694569984 ext(217778->18446744073709551615) 00002000:00010000:3.0:1763334978.562039:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece9f80. 00000100:00100000:3.0:1763334978.562077:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694570112 00000100:00100000:3.0:1763334978.562081:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694570112 00000100:00100000:0.0:1763334978.562177:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1846 00000100:00100000:0.0:1763334978.562192:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694569984:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334978.562498:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 102616 -> 217778 00002000:00010000:0.0:1763334978.562503:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334978.562505:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334978.562507:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334978.562510:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 309 -> 309 00000100:00100000:0.0:1763334978.562614:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694569984:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 426us (921us total) trans 17179871187 rc 0/0 00000100:00100000:0.0:1763334978.562623:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1846 00002000:00010000:0.0:1763334978.562627:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (217778->18446744073709551615) 00002000:00100000:0.0:1763334978.562630:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece9f80 with x1848989694569984 ext(217778->18446744073709551615) 00002000:00010000:0.0:1763334978.562635:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece9f80. 00002000:00010000:3.0:1763334978.563056:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:3.0:1763334978.563060:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeecead80 with x1848989694570112 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334978.563067:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeecead80. 00000100:00100000:3.0:1763334978.563096:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1847 00000100:00100000:3.0:1763334978.563104:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694570112:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334978.563260:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334978.563264:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334978.563266:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334978.563268:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334978.563271:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334978.563302:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694570112:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 199us (1479us total) trans 21474838452 rc 0/0 00000100:00100000:3.0:1763334978.563308:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1847 00002000:00010000:3.0:1763334978.563310:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:3.0:1763334978.563313:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeecead80 with x1848989694570112 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334978.563317:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeecead80. 00000100:00100000:1.0:1763334978.563757:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.564169:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694570240 00000100:00100000:3.0:1763334978.564179:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694570240 00002000:00010000:3.0:1763334978.564209:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:3.0:1763334978.564212:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeecea300 with x1848989694570240 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334978.564220:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeecea300. 00000100:00100000:2.0:1763334978.565599:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1848 00000100:00100000:2.0:1763334978.565623:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694570240:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334978.565923:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334978.565927:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334978.565929:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334978.565931:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334978.565934:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334978.566028:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694570240:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 407us (2262us total) trans 17179871188 rc 0/0 00000100:00100000:2.0:1763334978.566041:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1848 00002000:00010000:2.0:1763334978.566047:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:2.0:1763334978.566051:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeecea300 with x1848989694570240 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334978.566060:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeecea300. 00000100:00100000:1.0:1763334978.573940:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.574167:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694570368 00000100:00100000:0.0:1763334978.574185:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694570368 00002000:00100000:0.0:1763334978.574260:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (135168->200703) req@ffff9a5aeece8a80 x1848989694570368/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/0 e 0 to 0 dl 1763334989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334978.574273:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece8a80 with x1848989694570368 ext(135168->200703) 00002000:00010000:0.0:1763334978.574281:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece8a80 00000100:00100000:0.0:1763334978.574323:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1849 00000100:00100000:0.0:1763334978.574335:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2362:x1848989694570368:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:1.0:1763334978.593195:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2362:x1848989694570368:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 18847us (19255us total) trans 0 rc 65536/65536 00000100:00100000:1.0:1763334978.593214:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1849 00002000:00100000:1.0:1763334978.593229:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (135168->200703) req@ffff9a5aeece8a80 x1848989694570368/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/440 e 0 to 0 dl 1763334989 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334978.593241:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece8a80 with x1848989694570368 ext(135168->200703) 00002000:00010000:1.0:1763334978.593249:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece8a80 00000100:00100000:1.0:1763334978.599748:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.599888:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694570496 00000100:00100000:0.0:1763334978.599904:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694570496 00002000:00100000:0.0:1763334978.599980:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (200704->221183) req@ffff9a5b01f2dc00 x1848989694570496/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/0 e 0 to 0 dl 1763334989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334978.599991:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5b01f2dc00 with x1848989694570496 ext(200704->221183) 00002000:00010000:0.0:1763334978.599999:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5b01f2dc00 00000100:00100000:3.0:1763334978.600828:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1850 00000100:00100000:3.0:1763334978.600851:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694570496:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:3.0:1763334978.603972:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694570496:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 3113us (4225us total) trans 0 rc 20480/20480 00000100:00100000:3.0:1763334978.603989:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1850 00002000:00100000:3.0:1763334978.604006:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (200704->221183) req@ffff9a5b01f2dc00 x1848989694570496/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/440 e 0 to 0 dl 1763334989 ref 1 fl Complete:/600/0 rc 20480/20480 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.604029:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5b01f2dc00 with x1848989694570496 ext(200704->221183) 00002000:00010000:3.0:1763334978.604038:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5b01f2dc00 00000100:00100000:2.0:1763334978.608808:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.608932:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694570624 00000100:00100000:3.0:1763334978.608948:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694570624 00002000:00100000:3.0:1763334978.609029:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (163840->217777) req@ffff9a5afab34000 x1848989694570624/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/0 e 0 to 0 dl 1763334989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.609043:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab34000 with x1848989694570624 ext(163840->217777) 00002000:00010000:3.0:1763334978.609053:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab34000 00000100:00100000:3.0:1763334978.609295:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1851 00000100:00100000:3.0:1763334978.609309:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2361:x1848989694570624:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:3.0:1763334978.612892:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2361:x1848989694570624:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 3569us (4085us total) trans 17179871189 rc 0/0 00000100:00100000:3.0:1763334978.612909:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1851 00002000:00100000:3.0:1763334978.612927:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (163840->217777) req@ffff9a5afab34000 x1848989694570624/t17179871189(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/448 e 0 to 0 dl 1763334989 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.612940:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab34000 with x1848989694570624 ext(163840->217777) 00002000:00010000:3.0:1763334978.612948:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab34000 00000100:00100000:2.0:1763334978.618539:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.620517:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694570752 00000100:00100000:0.0:1763334978.620538:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694570752 00000100:00100000:1.0:1763334978.620694:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4982 00000100:00100000:1.0:1763334978.620707:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694570752:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:3.0:1763334978.657225:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871187 is committed 00000001:00080000:3.0:1763334978.657258:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871188 is committed 00000001:00080000:3.0:1763334978.657266:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871189 is committed 00000100:00100000:0.0:1763334978.657458:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694570752:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 36742us (38926us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.657473:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4982 00000100:00100000:2.0:1763334978.663283:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.663738:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694570880 00000100:00100000:3.0:1763334978.663752:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694570880 00000100:00100000:3.0:1763334978.663830:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4912 00000100:00100000:3.0:1763334978.663843:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53644:x1848989694570880:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334978.663875:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334978.663905:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c41e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b02a5 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.664044:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c425 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.664062:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c425 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.664077:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c425 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334978.664114:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00000004:00200000:3.0:1763334978.664120:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334978.664146:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c425 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.664178:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849c41e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02a5 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.664198:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c425 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02a5 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.664212:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:3.0:1763334978.664216:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334978.664220:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:3.0:1763334978.664294:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694570880:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 453us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334978.664302:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4912 00000100:00100000:1.0:1763334978.673212:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.673463:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694571008 00000100:00100000:3.0:1763334978.673478:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694571008 00002000:00100000:3.0:1763334978.673967:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (147456->180223) req@ffff9a5b01f2fb80 x1848989694571008/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/0 e 0 to 0 dl 1763334989 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334978.673983:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5b01f2fb80 with x1848989694571008 ext(147456->180223) 00002000:00010000:3.0:1763334978.673992:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5b01f2fb80 00000100:00100000:0.0:1763334978.674697:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1852 00000100:00100000:0.0:1763334978.674719:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694571008:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:0.0:1763334978.682038:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694571008:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 7302us (8815us total) trans 17179871190 rc 0/0 00000100:00100000:0.0:1763334978.682064:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1852 00002000:00100000:0.0:1763334978.682082:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (147456->180223) req@ffff9a5b01f2fb80 x1848989694571008/t17179871190(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:24/0 lens 488/448 e 0 to 0 dl 1763334989 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334978.682093:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5b01f2fb80 with x1848989694571008 ext(147456->180223) 00002000:00010000:0.0:1763334978.682101:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5b01f2fb80 00000100:00100000:2.0:1763334978.694205:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.694615:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694571136 00000100:00100000:0.0:1763334978.694630:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694571136 00000100:00100000:0.0:1763334978.694711:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4983 00000100:00100000:0.0:1763334978.694723:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694571136:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:2.0:1763334978.728554:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871190 is committed 00000100:00100000:0.0:1763334978.728904:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694571136:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 34171us (34703us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.728919:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4983 00000100:00100000:1.0:1763334978.735938:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334978.736820:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694571392 00000100:00100000:2.0:1763334978.736837:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694571392 00000100:00100000:2.0:1763334978.736916:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1791 00000100:00100000:2.0:1763334978.736928:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694571392:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:2.0:1763334978.737424:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53644:x1848989694571392:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 497us (1499us total) trans 8589939117 rc 0/0 00000100:00100000:2.0:1763334978.737433:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1791 00000100:00100000:1.0:1763334978.752900:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.753998:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694571520 00000100:00100000:0.0:1763334978.754024:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694571520 00000100:00100000:0.0:1763334978.755087:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4913 00000100:00100000:0.0:1763334978.755107:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53650:x1848989694571520:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334978.755149:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334978.755179:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c42c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b02ac expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.755283:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c433 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755300:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c433 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755314:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c433 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755333:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c43a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755339:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c43a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755346:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c43a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755713:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c441 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755723:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c441 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755730:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c441 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334978.755773:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00000004:00200000:0.0:1763334978.755778:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334978.755798:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c441 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755812:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c441 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755821:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c433 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755828:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c433 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755836:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c433 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755847:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334978.755852:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c433 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755860:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c433 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755874:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:0.0:1763334978.755878:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334978.755884:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c433 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755891:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c433 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755906:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c43a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755912:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c43a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755917:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c43a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755922:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334978.755924:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c43a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755930:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c43a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755936:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac7d60f00) 00010000:00010000:0.0:1763334978.755939:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334978.755942:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c43a lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755948:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c43a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.755984:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c42c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02ac expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.755999:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c441 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02ac expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.756007:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334978.756010:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334978.756024:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334978.756120:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53650:x1848989694571520:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1020us (3236us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.756130:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4913 00000100:00100000:3.0:1763334978.760449:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.760731:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694571648 00000100:00100000:1.0:1763334978.760744:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694571648 00000100:00100000:1.0:1763334978.760824:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 400 00000100:00100000:1.0:1763334978.760834:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694571648:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334978.760851:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334978.760881:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c441 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02ac expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.760901:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:1.0:1763334978.760906:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334978.760983:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694571648:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 150us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334978.760992:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 400 00000100:00100000:1.0:1763334978.763820:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.763931:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694571904 00000100:00100000:0.0:1763334978.763946:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694571904 00000100:00100000:0.0:1763334978.764032:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4914 00000100:00100000:0.0:1763334978.764044:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53650:x1848989694571904:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334978.764071:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334978.764099:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c448 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b02b3 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.764419:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.764442:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c425 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02a5 expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.764452:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.764496:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c425 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02a5 expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.764513:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c425 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02a5 expref: 197 pid: 30972 timeout: 1143 lvb_type: 0 00000100:00100000:0.0:1763334978.764528:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701868800:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334978.764676:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afaf3e840 going to sleep for 11 seconds 00000100:00100000:0.0:1763334978.766635:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77d180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701868800:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334978.766677:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334978.768874:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.769430:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694572032 00000100:00100000:0.0:1763334978.769445:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694572032 00010000:00010000:0.0:1763334978.769500:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c425 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02a5 expref: 198 pid: 30972 timeout: 1143 lvb_type: 0 00000100:00100000:0.0:1763334978.769555:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2611 00000100:00100000:0.0:1763334978.769566:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+198:2359:x1848989694572032:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334978.769605:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334978.769615:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c425 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02a5 expref: 198 pid: 30972 timeout: 1143 lvb_type: 0 00010000:00010000:0.0:1763334978.769631:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c425 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02a5 expref: 198 pid: 30972 timeout: 1143 lvb_type: 0 00010000:00010000:0.0:1763334978.769659:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c425 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02a5 expref: 198 pid: 30972 timeout: 1143 lvb_type: 0 00010000:00010000:0.0:1763334978.769679:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334978.769684:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.769695:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.769703:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.769749:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334978.769829:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694572032:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 265us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.769837:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2611 00010000:00010000:2.0:1763334978.769923:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334978.769932:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334978.769955:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00010000:00010000:2.0:1763334978.770176:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c448 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02b3 expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.770195:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02b3 expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.770203:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:2.0:1763334978.770206:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334978.770209:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:2.0:1763334978.770981:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53650:x1848989694571904:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6934us (7172us total) trans 8589939118 rc 0/0 00000100:00100000:2.0:1763334978.770993:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4914 00000100:00100000:1.0:1763334978.779172:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334978.779251:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694572160 00000100:00100000:2.0:1763334978.779266:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694572160 00000100:00100000:2.0:1763334978.779337:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4915 00000100:00100000:2.0:1763334978.779348:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53650:x1848989694572160:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334978.779379:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334978.779409:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c45d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b02ba expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.779527:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c464 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334978.779545:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02b3 expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.779556:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c464 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334978.779634:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02b3 expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.779650:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02b3 expref: 198 pid: 32232 timeout: 1143 lvb_type: 0 00000100:00100000:2.0:1763334978.779668:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701868928:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334978.779793:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8eee40 going to sleep for 11 seconds 00000100:00100000:0.0:1763334978.782192:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701868928:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334978.782650:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c464 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334978.784282:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.786271:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694572288 00000100:00100000:0.0:1763334978.786287:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694572288 00010000:00010000:0.0:1763334978.788593:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02b3 expref: 199 pid: 32232 timeout: 1143 lvb_type: 0 00000100:00100000:0.0:1763334978.788658:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2612 00000100:00100000:0.0:1763334978.788678:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:2360:x1848989694572288:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334978.788696:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334978.788705:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02b3 expref: 199 pid: 32232 timeout: 1143 lvb_type: 0 00010000:00010000:0.0:1763334978.788719:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02b3 expref: 199 pid: 32232 timeout: 1143 lvb_type: 0 00010000:00010000:0.0:1763334978.788741:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c44f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02b3 expref: 199 pid: 32232 timeout: 1143 lvb_type: 0 00010000:00010000:0.0:1763334978.788758:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334978.788763:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c464 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.788772:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c464 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.788778:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c464 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.788823:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334978.788897:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+198:2360:x1848989694572288:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 229us (4632us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.788905:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2612 00010000:00010000:2.0:1763334978.789169:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c464 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334978.789179:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c464 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334978.789224:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00000004:00200000:2.0:1763334978.789230:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334978.789249:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c464 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334978.789278:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c45d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02ba expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.789294:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c464 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02ba expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.789302:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:2.0:1763334978.789305:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334978.789308:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334978.789357:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53650:x1848989694572160:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 10010us (10202us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334978.789374:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4915 00000100:00100000:1.0:1763334978.795720:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.796393:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694572544 00000100:00100000:0.0:1763334978.796408:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694572544 00000100:00100000:0.0:1763334978.796496:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4916 00000100:00100000:0.0:1763334978.796507:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53650:x1848989694572544:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334978.796528:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334978.796547:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c46b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b02c1 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.796654:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c472 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.796669:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c472 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334978.796681:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c472 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334978.796693:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00010000:00010000:0.0:1763334978.796811:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c46b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02c1 expref: 200 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.796830:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c472 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02c1 expref: 199 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.796839:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334978.796842:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334978.796845:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334978.796914:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53650:x1848989694572544:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 409us (1349us total) trans 8589939119 rc 0/0 00000100:00100000:0.0:1763334978.796922:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4916 00000100:00100000:0.0:1763334978.801659:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.801751:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694572672 00000100:00100000:1.0:1763334978.801764:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694572672 00000100:00100000:1.0:1763334978.801833:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4984 00000100:00100000:1.0:1763334978.801843:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694572672:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334978.801898:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.801929:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c3d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0282 expref: 21 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.801940:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334978.801943:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334978.801947:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.801998:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c3d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0282 expref: 21 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.802023:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c3d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0282 expref: 21 pid: 26216 timeout: 1143 lvb_type: 0 00000100:00100000:1.0:1763334978.802042:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701869056:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334978.802174:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af69b2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334978.805808:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.805937:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.806358:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694572928 00000100:00100000:3.0:1763334978.806374:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694572928 00000100:00100000:3.0:1763334978.807362:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694572800 00000100:00100000:3.0:1763334978.807371:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694572800 00000100:00100000:3.0:1763334978.807426:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4985 00000100:00100000:3.0:1763334978.807438:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694572928:12345-192.168.201.60@tcp:1:lfs.0 00000100:00100000:1.0:1763334978.807459:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4986 00000100:00100000:1.0:1763334978.807469:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694572800:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334978.807500:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.807501:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.807523:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c2d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0220 expref: 22 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.807523:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c2ce lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0219 expref: 19 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.807532:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334978.807532:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334978.807535:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334978.807535:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334978.807540:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.807540:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.807596:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c2d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0220 expref: 22 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.807596:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c2ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0219 expref: 19 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.807611:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c2d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0220 expref: 22 pid: 25383 timeout: 1143 lvb_type: 0 00010000:00010000:1.0:1763334978.807670:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c2ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0219 expref: 19 pid: 25383 timeout: 1143 lvb_type: 0 00000100:00100000:1.0:1763334978.807688:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701869184:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334978.807789:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af69b2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1763334978.808527:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701869312:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334978.808672:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afad85180 going to sleep for 11 seconds 00000100:00100000:1.0:1763334978.812743:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701869056:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334978.812786:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334978.813125:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.813191:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.813226:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694573056 00000100:00100000:0.0:1763334978.813239:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694573056 00010000:00010000:0.0:1763334978.813285:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c3d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0282 expref: 23 pid: 26216 timeout: 1143 lvb_type: 0 00000100:00100000:0.0:1763334978.813319:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694573312 00000100:00100000:0.0:1763334978.813323:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694573312 00010000:00010000:0.0:1763334978.813338:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c2d5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0220 expref: 24 pid: 25383 timeout: 1143 lvb_type: 0 00000100:00100000:0.0:1763334978.813362:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2613 00000100:00100000:0.0:1763334978.813372:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694573056:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334978.813388:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1763334978.813403:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701869184:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334978.813414:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c3d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0282 expref: 24 pid: 26216 timeout: 1143 lvb_type: 0 00010000:00010000:1.0:1763334978.813418:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.813427:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c3d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0282 expref: 24 pid: 26216 timeout: 1143 lvb_type: 0 00010000:00010000:0.0:1763334978.813455:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849c3d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0282 expref: 24 pid: 26216 timeout: 1143 lvb_type: 0 00010000:00010000:0.0:1763334978.813479:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334978.813482:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334978.813488:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.813504:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334978.813505:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701869312:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334978.813522:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.813540:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334978.813668:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.813678:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.813707:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.813716:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.813724:0:26216:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.813732:0:26216:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334978.813737:0:26216:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.813753:0:26216:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.813767:0:26216:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.813774:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c480 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334978.814035:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694573056:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 662us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334978.814066:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2614 00000100:00100000:3.0:1763334978.814078:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694573312:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763334978.814080:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334978.814087:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334978.814100:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c2d5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0220 expref: 23 pid: 25383 timeout: 1143 lvb_type: 0 00010000:00010000:3.0:1763334978.814110:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c2d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0220 expref: 23 pid: 25383 timeout: 1143 lvb_type: 0 00010000:00010000:3.0:1763334978.814122:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c2d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0220 expref: 23 pid: 25383 timeout: 1143 lvb_type: 0 00010000:00010000:3.0:1763334978.814132:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334978.814134:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334978.814137:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.814150:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.814168:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334978.814194:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694573184 00000100:00100000:3.0:1763334978.814197:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694573312:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 123us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334978.814199:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694573184 00000100:00100000:3.0:1763334978.814206:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2614 00010000:00010000:2.0:1763334978.814219:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c2ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0219 expref: 20 pid: 25383 timeout: 1143 lvb_type: 0 00000100:00100000:2.0:1763334978.814244:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2615 00000100:00100000:2.0:1763334978.814251:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694573184:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334978.814261:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334978.814277:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c2ce lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0219 expref: 20 pid: 25383 timeout: 1143 lvb_type: 0 00010000:00010000:3.0:1763334978.814282:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.814287:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c2ce lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0219 expref: 20 pid: 25383 timeout: 1143 lvb_type: 0 00010000:00010000:3.0:1763334978.814290:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.814303:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c2ce lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0219 expref: 20 pid: 25383 timeout: 1143 lvb_type: 0 00010000:00010000:3.0:1763334978.814308:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.814314:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334978.814315:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.814316:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334978.814319:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.814323:0:32241:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.814328:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.814329:0:32241:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334978.814333:0:32241:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.814347:0:32241:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.814352:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334978.814356:0:32241:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.814364:0:32241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c48e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334978.814370:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694573184:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 121us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334978.814376:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2615 00010000:00010000:2.0:1763334978.814395:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334978.814399:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694572928:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 6964us (8607us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334978.814407:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4985 00010000:00010000:2.0:1763334978.814419:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.814437:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.814443:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.814450:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.814456:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334978.814458:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.814465:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.814480:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.814486:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849c487 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334978.814524:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694572800:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 7058us (8588us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334978.814531:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4986 00000100:00100000:0.0:1763334978.814599:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2613 00000100:00100000:1.0:1763334978.815062:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694572672:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 13218us (13417us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334978.815071:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4984 00000100:00100000:0.0:1763334978.819409:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.819548:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694573568 00000100:00100000:3.0:1763334978.819558:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694573568 00000100:00100000:3.0:1763334978.819647:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4917 00000100:00100000:3.0:1763334978.819658:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53650:x1848989694573568:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:3.0:1763334978.819716:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1763334978.819752:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c464 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02ba expref: 199 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.819777:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c3ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0290 expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334978.819788:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:3.0:1763334978.819792:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334978.819824:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c495 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.819838:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c495 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334978.819863:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c495 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:3.0:1763334978.820490:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1152, 88 off98568 00000004:00080000:3.0:1763334978.820500:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1043453927999ns, next at 1040839994511ns, rc = 0 00000040:00080000:3.0:1763334978.820695:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1141, 88 off97480 00000004:00080000:3.0:1763334978.820702:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1043454130269ns, next at 1040839334561ns, rc = 0 00000040:00080000:3.0:1763334978.820738:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1142, 88 off97568 00000004:00080000:3.0:1763334978.820746:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1043454173397ns, next at 1040839334561ns, rc = 0 00000040:00080000:3.0:1763334978.820768:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1153, 88 off98656 00000004:00080000:3.0:1763334978.820772:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1043454199994ns, next at 1040839994511ns, rc = 0 00000040:00080000:3.0:1763334978.820794:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1154, 88 off98744 00000004:00080000:3.0:1763334978.820800:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1043454227884ns, next at 1040839994511ns, rc = 0 00000040:00080000:3.0:1763334978.820842:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1143, 88 off97656 00000004:00080000:3.0:1763334978.820848:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1043454276547ns, next at 1040839334561ns, rc = 0 00000040:00080000:3.0:1763334978.821249:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1144, 88 off97744 00000004:00080000:3.0:1763334978.821256:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1043454684594ns, next at 1040839334561ns, rc = 0 00000040:00080000:3.0:1763334978.821292:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1155, 88 off98832 00000004:00080000:3.0:1763334978.821297:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1043454724879ns, next at 1040839994511ns, rc = 0 00000001:00080000:3.0:1763334978.854058:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939119 is committed 00000001:00080000:3.0:1763334978.854083:0:32265:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939120 is committed 00000004:00080000:3.0:1763334978.854087:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 767 committed 00000004:00080000:3.0:1763334978.854099:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 755 committed 00000004:00080000:3.0:1763334978.854107:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 754 committed 00000004:00080000:3.0:1763334978.854110:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 766 committed 00000004:00080000:3.0:1763334978.854112:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 765 committed 00000004:00080000:3.0:1763334978.854114:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 753 committed 00000004:00080000:3.0:1763334978.854116:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 752 committed 00000004:00080000:3.0:1763334978.854118:0:32265:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 764 committed 00000020:00080000:3.0:1763334978.854135:0:32265:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969316 batchid updated 00000020:00080000:3.0:1763334978.854427:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969316 00000020:00080000:3.0:1763334978.854737:0:29663:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969316 cancel update log [0x200000bd0:0x1:0x0].10: rc = 0 00000020:00080000:3.0:1763334978.854748:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969316 00000100:00100000:3.0:1763334978.854768:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701869440:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334978.854833:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334978.854864:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701869952:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334978.854885:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334978.854909:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1763334978.854916:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701869824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334978.854936:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334978.854950:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701870336:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334978.854966:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334978.854995:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701869568:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334978.855040:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334978.855059:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701870080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334978.855079:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334978.855096:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763334978.855102:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701869696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334978.855121:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334978.855137:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701870208:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334978.855155:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334978.855198:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701869440 00000100:00100000:3.0:1763334978.855206:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701869440 00000100:00100000:3.0:1763334978.855248:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701869952 00000100:00100000:3.0:1763334978.855251:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701869952 00000100:00100000:3.0:1763334978.855268:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701869824 00000100:00100000:3.0:1763334978.855271:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701869824 00000100:00100000:3.0:1763334978.855280:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701870336 00000100:00100000:3.0:1763334978.855283:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701870336 00000100:00100000:3.0:1763334978.855290:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701869568 00000100:00100000:3.0:1763334978.855293:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701869568 00000100:00100000:3.0:1763334978.855301:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701870080 00000100:00100000:3.0:1763334978.855303:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701870080 00000100:00100000:3.0:1763334978.855312:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701869696 00000100:00100000:3.0:1763334978.855314:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701869696 00000100:00100000:3.0:1763334978.855323:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701870208 00000100:00100000:3.0:1763334978.855325:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701870208 00000100:00100000:3.0:1763334978.855338:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4987 00000100:00100000:3.0:1763334978.855346:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3292:x1848989701869440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334978.855606:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701869440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 259us (771us total) trans 17179871191 rc 0/0 00000100:00100000:3.0:1763334978.855613:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4987 00000100:00100000:3.0:1763334978.855631:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4988 00000100:00100000:3.0:1763334978.855637:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3292:x1848989701869952:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334978.855739:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334978.855742:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334978.855745:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334978.855748:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334978.855750:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334978.855780:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3292:x1848989701869952:12345-0@lo:2:osp-syn-0-0.0 Request processed in 143us (893us total) trans 21474838453 rc 0/0 00000100:00100000:3.0:1763334978.855790:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4988 00000100:00100000:3.0:1763334978.855806:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4989 00000100:00100000:3.0:1763334978.855814:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3292:x1848989701869824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334978.855904:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334978.855906:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334977 -> 1763334977 00002000:00010000:3.0:1763334978.855908:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334978.855910:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334978 -> 1763334978 00002000:00010000:3.0:1763334978.855912:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334978.855935:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701869824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (998us total) trans 17179871192 rc 0/0 00000100:00100000:3.0:1763334978.855941:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4989 00000100:00100000:3.0:1763334978.855955:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4990 00000100:00100000:3.0:1763334978.855961:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3292:x1848989701870336:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334978.856070:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3292:x1848989701870336:12345-0@lo:2:osp-syn-0-0.0 Request processed in 109us (1102us total) trans 21474838454 rc 0/0 00000100:00100000:3.0:1763334978.856077:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4990 00000100:00100000:3.0:1763334978.856095:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4991 00000100:00100000:3.0:1763334978.856102:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701869568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334978.856221:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4992 00000100:00100000:1.0:1763334978.856230:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701870080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334978.856356:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3289:x1848989701870080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 128us (1276us total) trans 21474838455 rc 0/0 00000100:00100000:1.0:1763334978.856363:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4992 00000100:00100000:1.0:1763334978.856376:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4993 00000100:00100000:1.0:1763334978.856381:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701869696:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334978.856450:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d6300/2, rc 0, transno 21474838455 00000100:00100000:0.0:1763334978.856459:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701870080:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334978.856513:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb size from disk: 73013 -> 73013 00002000:00010000:1.0:1763334978.856517:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334978.856519:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334978.856521:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:1.0:1763334978.856522:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb blocks from disk: 259 -> 259 00000100:00100000:1.0:1763334978.856559:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701869696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 177us (1436us total) trans 17179871193 rc 0/0 00000100:00100000:1.0:1763334978.856566:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4993 00000100:00100000:1.0:1763334978.856602:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4994 00000100:00100000:1.0:1763334978.856609:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701870208:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334978.856651:0:3289:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871177 gen 2 00000004:00080000:0.0:1763334978.856658:0:3289:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179871173 committed transno 17179871177 00000004:00080000:0.0:1763334978.856677:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca870e00, transno 17179871174 00000004:00080000:0.0:1763334978.856691:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeefe6680, transno 17179871175 00000004:00080000:0.0:1763334978.856694:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca873100, transno 17179871176 00000004:00080000:0.0:1763334978.856698:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeefe4a80, transno 17179871177 00000100:00100000:0.0:1763334978.856707:0:3289:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5aee9d7b80 x1848989701869696/t17179871193(17179871193) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334994 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00002000:00010000:1.0:1763334978.856714:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb size from disk: 0 -> 0 00000004:00080000:0.0:1763334978.856717:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d7b80/2, rc 0, transno 17179871193 00002000:00010000:1.0:1763334978.856719:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334978.856725:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00000100:00100000:0.0:1763334978.856726:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701869696:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334978.856732:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb ctime from disk: 1763334977 -> 1763334977 00002000:00010000:1.0:1763334978.856736:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334978.856777:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3289:x1848989701870208:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (1619us total) trans 21474838456 rc 0/0 00000100:00100000:1.0:1763334978.856784:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4994 00000004:00080000:0.0:1763334978.856859:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeec5bb80/2, rc 0, transno 21474838456 00000100:00100000:0.0:1763334978.856865:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701870208:0@lo:2:osp-syn-0-0.0 00000004:00010000:2.0:1763334978.856889:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004bece3b7 reply state 00000000b329596a transno 8589939120 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c495 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334978.856902:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:2.0:1763334978.856987:0:30972:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1763334978.857006:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53650:x1848989694573568:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 37349us (37606us total) trans 8589939120 rc 0/0 00000100:00100000:2.0:1763334978.857024:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4917 00010000:00010000:1.0:1763334978.857095:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c495 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334978.857105:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c495 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334978.857114:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c495 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334978.857119:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334978.857124:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c495 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334978.857131:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c495 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334978.857146:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:1.0:1763334978.857150:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334978.857159:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c495 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334978.857165:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c495 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334978.857399:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701869568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1296us (2357us total) trans 17179871194 rc 0/0 00000100:00100000:3.0:1763334978.857407:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4991 00000004:00080000:1.0:1763334978.857463:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d5f80/2, rc 0, transno 17179871194 00000100:00100000:1.0:1763334978.857767:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701869568:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334978.857939:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 2 in flight, 4 done 00000004:00080000:3.0:1763334978.857966:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d5180/2, rc 0, transno 17179871192 00000100:00100000:3.0:1763334978.857971:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701869824:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334978.857983:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeec5b100/2, rc 0, transno 21474838454 00000100:00100000:3.0:1763334978.857987:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701870336:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334978.857996:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d7800/2, rc 0, transno 17179871191 00000100:00100000:3.0:1763334978.858000:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701869440:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334978.858008:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d4700/2, rc 0, transno 21474838453 00000100:00100000:3.0:1763334978.858026:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701869952:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334978.864433:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334978.864522:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694573696 00000100:00100000:2.0:1763334978.864537:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694573696 00000100:00100000:2.0:1763334978.865045:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4918 00000100:00100000:2.0:1763334978.865058:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53650:x1848989694573696:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334978.865082:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334978.865105:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c49c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b02c8 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.865169:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c49c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02c8 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.865190:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c49c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02c8 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.865210:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:2.0:1763334978.865213:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334978.865218:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431600, rc 0) 00000100:00100000:2.0:1763334978.865292:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53650:x1848989694573696:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 236us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334978.865299:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4918 00000100:00100000:2.0:1763334978.877254:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.879065:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694573824 00000100:00100000:0.0:1763334978.879081:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694573824 00000100:00100000:0.0:1763334978.879158:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4919 00000100:00100000:0.0:1763334978.879169:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53650:x1848989694573824:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334978.879189:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334978.879210:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c4a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b02cf expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.879297:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c4aa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334978.879312:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c4aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334978.879324:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c4aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334978.879351:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00000004:00200000:0.0:1763334978.879356:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334978.879372:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c4aa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334978.879405:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c4a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02cf expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.879423:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c4aa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02cf expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.879431:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334978.879434:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334978.879438:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:0.0:1763334978.879511:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53650:x1848989694573824:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 343us (2266us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.879520:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4919 00000100:00100000:0.0:1763334978.887287:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334978.887511:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694573952 00000100:00100000:3.0:1763334978.887523:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694573952 00000100:00100000:3.0:1763334978.887618:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4995 00000100:00100000:3.0:1763334978.887628:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694573952:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334978.887646:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334978.887668:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c4b1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b02d6 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334978.887694:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 217778, mtime: 0x691a5b43, atime: 0x691a5b40, ctime: 0x691a5b43, blocks: 0x11b 00010000:00010000:3.0:1763334978.887713:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334978.887715:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334978.887725:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c4b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02d6 expref: 20 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334978.887741:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c4b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02d6 expref: 20 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334978.887754:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:3.0:1763334978.889324:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694573952:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1687us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334978.889340:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4995 00000100:00100000:1.0:1763334978.891886:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334978.891968:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.892065:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694574080 00000100:00100000:0.0:1763334978.892075:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694574080 00000100:00100000:0.0:1763334978.892135:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694574208 00000100:00100000:0.0:1763334978.892139:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694574208 00000100:00100000:0.0:1763334978.893134:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4996 00000100:00100000:0.0:1763334978.893149:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694574080:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334978.893169:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334978.893193:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c4b8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b02dd expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334978.893219:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x248:0x0] initial LVB size: 0, mtime: 0x691a5b43, atime: 0x691a5b40, ctime: 0x691a5b43, blocks: 0x3 00010000:00010000:0.0:1763334978.893239:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334978.893241:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334978.893251:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c4b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02dd expref: 19 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334978.893269:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c4b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02dd expref: 19 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334978.893282:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334978.893348:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694574080:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 203us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.893355:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4996 00000100:00100000:0.0:1763334978.893376:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4997 00000100:00100000:0.0:1763334978.893384:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694574208:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334978.893393:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334978.893405:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c4bf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b02e4 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334978.893420:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x691a5b43, atime: 0x691a5b40, ctime: 0x691a5b43, blocks: 0x3 00010000:00010000:0.0:1763334978.893430:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334978.893431:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334978.893436:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c4bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02e4 expref: 21 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334978.893447:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c4bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02e4 expref: 21 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334978.893454:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334978.893474:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694574208:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 92us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.893480:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4997 00000100:00100000:2.0:1763334978.937794:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.938145:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694574336 00000100:00100000:0.0:1763334978.938160:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694574336 00000100:00100000:0.0:1763334978.938246:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1853 00000100:00100000:0.0:1763334978.938255:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694574336:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334978.938289:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c4c6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.938303:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334978.938306:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334978.938310:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c4c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.938323:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c4c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.948766:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c4c6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.948786:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c4c6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.948794:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.948801:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334978.948805:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c4c6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.948813:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c4c6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.948833:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c4c6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.948840:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792800/0xcedf0054f849c4c6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334978.950079:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694574336:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 11805us (12281us total) trans 0 rc 217778/217778 00000100:00100000:0.0:1763334978.950092:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1853 00000100:00100000:1.0:1763334978.960270:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334978.960504:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694574464 00000100:00100000:2.0:1763334978.960518:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694574464 00000100:00100000:2.0:1763334978.960662:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1854 00000100:00100000:2.0:1763334978.960675:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694574464:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:2.0:1763334978.962895:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.962933:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c17e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0186 expref: 21 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334978.962943:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334978.962945:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334978.962950:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334978.963026:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c17e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0186 expref: 21 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334978.963050:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c17e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0186 expref: 21 pid: 26216 timeout: 1143 lvb_type: 1 00000100:00100000:2.0:1763334978.963072:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701870464:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334978.963759:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee480 going to sleep for 11 seconds 00000100:00100000:2.0:1763334978.969347:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334978.969495:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694574592 00000100:00100000:0.0:1763334978.969515:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694574592 00000100:00100000:1.0:1763334978.969698:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701870464:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334978.969734:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.970412:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c17e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0186 expref: 22 pid: 26216 timeout: 1143 lvb_type: 1 00000100:00100000:0.0:1763334978.970469:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2616 00000100:00100000:0.0:1763334978.970485:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694574592:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334978.970504:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334978.970527:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c17e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0186 expref: 22 pid: 26216 timeout: 1143 lvb_type: 1 00010000:00010000:0.0:1763334978.970542:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c17e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0186 expref: 22 pid: 26216 timeout: 1143 lvb_type: 1 00010000:00010000:0.0:1763334978.970565:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c17e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0186 expref: 22 pid: 26216 timeout: 1143 lvb_type: 1 00010000:00010000:0.0:1763334978.970609:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334978.970612:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334978.970617:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.970626:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334978.970660:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334978.970707:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334978.970722:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334978.971779:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694574592:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1297us (2447us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334978.971794:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2616 00000001:00080000:3.0:1763334979.064628:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871195 is committed 00000001:00080000:3.0:1763334979.064656:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871193 is committed 00002000:00010000:1.0:1763334979.064870:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb size from disk: 73013 -> 221184 00002000:00010000:1.0:1763334979.064876:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb mtime from disk: 1763334976 -> 1763334979 00002000:00010000:1.0:1763334979.064879:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb ctime from disk: 1763334977 -> 1763334979 00002000:00010000:1.0:1763334979.064881:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb blocks from disk: 259 -> 515 00010000:00010000:1.0:1763334979.064898:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.064910:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.064919:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.064926:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334979.064930:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.064939:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.064966:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.064973:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c4cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334979.065103:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694574464:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 104423us (104841us total) trans 17179871195 rc 0/0 00000100:00100000:1.0:1763334979.065113:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1854 00000001:00080000:3.0:1763334979.065236:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871194 is committed 00000100:00100000:2.0:1763334979.072446:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.073491:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694574720 00000100:00100000:1.0:1763334979.073510:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694574720 00000100:00080000:3.0:1763334979.073782:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1763334979.074785:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1855 00000100:00100000:1.0:1763334979.074804:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694574720:12345-192.168.201.60@tcp:4:lfs.0 00002000:00010000:1.0:1763334979.074877:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 161659, mtime: 0x691a5b41, atime: 0x691a5b40, ctime: 0x691a5b42, blocks: 0x203 00010000:00010000:1.0:1763334979.074889:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c4d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.074908:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.074910:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.074917:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c4d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.074933:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c4d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1763334979.138432:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838450 is committed 00002000:00010000:1.0:1763334979.138761:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 161659 -> 221184 00002000:00010000:1.0:1763334979.138767:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334977 -> 1763334979 00002000:00010000:1.0:1763334979.138771:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334978 -> 1763334979 00010000:00010000:1.0:1763334979.138791:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c4d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.138804:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c4d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.138813:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c4d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.138820:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334979.138825:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c4d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.138835:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c4d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.138861:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c4d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.138869:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c4d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334979.138994:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694574720:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 64191us (66559us total) trans 21474838457 rc 0/0 00000100:00100000:1.0:1763334979.139019:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1855 00000001:00080000:1.0:1763334979.139063:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838457 is committed 00000001:00080000:1.0:1763334979.139076:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838456 is committed 00000100:00100000:2.0:1763334979.152200:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.152411:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694574976 00000100:00100000:0.0:1763334979.152427:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694574976 00000100:00080000:3.0:1763334979.152601:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1763334979.152673:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4920 00000100:00100000:0.0:1763334979.152687:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53650:x1848989694574976:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334979.152763:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334979.152798:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c4aa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02cf expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.152821:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334979.152828:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334979.153259:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c4db lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.153278:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c4db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.153291:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c4db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:0.0:1763334979.153362:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939121 00000004:00010000:0.0:1763334979.153395:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000004ed32138 reply state 000000006825909d transno 8589939122 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c4db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334979.153406:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334979.153556:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53650:x1848989694574976:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 871us (1371us total) trans 8589939122 rc 0/0 00000100:00100000:0.0:1763334979.153565:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4920 00000020:00080000:0.0:1763334979.153615:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763334979.157138:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c4db lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334979.157164:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c4db lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334979.157174:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c4db lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334979.157181:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334979.157188:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c4db lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334979.157198:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c4db lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334979.157222:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:1.0:1763334979.157226:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334979.157233:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c4db lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334979.157240:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c4db lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334979.157498:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.159097:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694575104 00000100:00100000:0.0:1763334979.159116:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694575104 00000100:00100000:0.0:1763334979.159225:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4998 00000100:00100000:0.0:1763334979.159239:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:53650:x1848989694575104:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334979.159262:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334979.159290:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c4e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b02eb expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334979.159322:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24d:0x0] initial LVB size: 221184, mtime: 0x691a5b43, atime: 0x691a5b40, ctime: 0x691a5b43, blocks: 0x203 00010000:00010000:0.0:1763334979.159361:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334979.159364:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334979.159374:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c4e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02eb expref: 21 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.159393:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c4e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02eb expref: 21 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.159407:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:0.0:1763334979.159488:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:53650:x1848989694575104:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 252us (1997us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.159496:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4998 00000100:00080000:3.0:1763334979.161001:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1763334979.164407:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.165755:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694575232 00000100:00100000:1.0:1763334979.165774:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694575232 00000100:00100000:0.0:1763334979.165982:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4999 00000100:00100000:0.0:1763334979.165995:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+13:53650:x1848989694575232:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334979.166031:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334979.166060:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c4e9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b02f2 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.166108:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c0b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0132 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.166118:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334979.166121:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334979.166125:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c4e9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f2 expref: 14 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.166173:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c0b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0132 expref: 14 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.166189:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c0b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0132 expref: 14 pid: 6519 timeout: 1143 lvb_type: 0 00000100:00100000:0.0:1763334979.166209:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701870592:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334979.166978:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334979.172669:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.172796:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694575360 00000100:00100000:1.0:1763334979.172809:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694575360 00010000:00010000:1.0:1763334979.172862:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c0b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0132 expref: 15 pid: 6519 timeout: 1143 lvb_type: 0 00000100:00100000:0.0:1763334979.173017:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701870592:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334979.173054:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c4e9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f2 expref: 15 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.173075:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334979.173152:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+15:53650:x1848989694575232:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7159us (8762us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.173162:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4999 00000100:00100000:1.0:1763334979.173809:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2617 00000100:00100000:1.0:1763334979.173821:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694575360:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334979.173841:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334979.173871:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c0b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0132 expref: 14 pid: 6519 timeout: 1143 lvb_type: 0 00010000:00010000:1.0:1763334979.173960:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c0b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0132 expref: 14 pid: 6519 timeout: 1143 lvb_type: 0 00010000:00010000:1.0:1763334979.173993:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c0b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0132 expref: 14 pid: 6519 timeout: 1143 lvb_type: 0 00010000:00010000:1.0:1763334979.174026:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.174029:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.174036:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c4e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f2 expref: 13 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.174049:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c4e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f2 expref: 13 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.174093:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c4e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f2 expref: 13 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334979.174114:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701870720:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334979.174208:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af69b2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334979.179857:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ece00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701870720:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334979.179906:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334979.179982:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694575360:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 6162us (7329us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334979.179998:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2617 00000100:00100000:1.0:1763334979.180710:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.180751:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334979.180814:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694575488 00000100:00100000:3.0:1763334979.180827:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694575488 00000100:00100000:2.0:1763334979.180880:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694575616 00002000:00010000:3.0:1763334979.180886:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/589 (217778->18446744073709551615) 00002000:00100000:3.0:1763334979.180892:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa7ece00 with x1848989694575488 ext(217778->18446744073709551615) 00002000:00010000:3.0:1763334979.180909:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa7ece00. 00000100:00100000:3.0:1763334979.180948:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1856 00000100:00100000:3.0:1763334979.180959:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694575488:12345-192.168.201.60@tcp:10:lfs.0 00000100:00100000:2.0:1763334979.181108:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694575616 00002000:00010000:2.0:1763334979.181139:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/585 (0->18446744073709551615) 00002000:00100000:2.0:1763334979.181144:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa7ed500 with x1848989694575616 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334979.181153:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa7ed500. 00000100:00100000:2.0:1763334979.181183:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1857 00000100:00100000:2.0:1763334979.181192:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2361:x1848989694575616:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:2.0:1763334979.181512:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334979.181516:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb mtime from disk: 1763334976 -> 1763334979 00002000:00010000:2.0:1763334979.181520:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334979.181522:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb ctime from disk: 1763334977 -> 1763334979 00002000:00010000:2.0:1763334979.181524:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334979.181629:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694575616:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 438us (877us total) trans 21474838458 rc 0/0 00000100:00100000:2.0:1763334979.181639:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1857 00002000:00010000:2.0:1763334979.181643:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/585 (0->18446744073709551615) 00002000:00100000:2.0:1763334979.181645:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa7ed500 with x1848989694575616 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334979.181649:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa7ed500. 00002000:00010000:2.0:1763334979.184819:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb size from disk: 221184 -> 217778 00002000:00010000:2.0:1763334979.184834:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334979.184836:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334979.184839:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334979.184842:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1763334979.184954:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694575488:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 3987us (4240us total) trans 17179871196 rc 0/0 00000100:00100000:2.0:1763334979.184968:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1856 00002000:00010000:2.0:1763334979.184976:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/589 (217778->18446744073709551615) 00002000:00100000:2.0:1763334979.184979:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa7ece00 with x1848989694575488 ext(217778->18446744073709551615) 00002000:00010000:2.0:1763334979.184988:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa7ece00. 00000100:00100000:1.0:1763334979.190363:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.190488:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694575744 00000100:00100000:0.0:1763334979.190503:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694575744 00000100:00100000:0.0:1763334979.191793:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4921 00000100:00100000:0.0:1763334979.191816:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53650:x1848989694575744:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334979.191849:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334979.191877:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c4f0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b02f9 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.191984:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c4f7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.192002:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.192027:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334979.192062:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00000004:00200000:0.0:1763334979.192068:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334979.192090:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.192121:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c4f0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f9 expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.192143:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f9 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.192155:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334979.192158:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334979.192163:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334979.192261:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53650:x1848989694575744:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 454us (1910us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.192270:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4921 00000100:00100000:1.0:1763334979.199223:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.199301:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694576000 00000100:00100000:0.0:1763334979.199316:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694576000 00000100:00100000:0.0:1763334979.199392:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4922 00000100:00100000:0.0:1763334979.199403:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53650:x1848989694576000:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334979.199471:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334979.199505:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c4f7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f9 expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.199528:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334979.199534:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334979.199867:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c4fe lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.199885:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c4fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.199896:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c4fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:0.0:1763334979.200325:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939123 00000004:00010000:0.0:1763334979.200358:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f54ae1a0 reply state 000000005b6081e9 transno 8589939124 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c4fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:0.0:1763334979.200369:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334979.200504:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53650:x1848989694576000:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 1101us (1292us total) trans 8589939124 rc 0/0 00000100:00100000:0.0:1763334979.200513:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4922 00000020:00080000:0.0:1763334979.200520:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763334979.207024:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.207116:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694576128 00000100:00100000:1.0:1763334979.207131:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694576128 00000100:00100000:1.0:1763334979.207207:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5000 00000100:00100000:1.0:1763334979.207218:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+14:53650:x1848989694576128:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334979.207241:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334979.207268:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c505 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0300 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334979.207299:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 221184, mtime: 0x691a5b43, atime: 0x691a5b40, ctime: 0x691a5b43, blocks: 0x203 00010000:00010000:1.0:1763334979.207324:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.207326:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.207336:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c505 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0300 expref: 15 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.207353:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c505 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0300 expref: 15 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.207367:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334979.207436:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+15:53650:x1848989694576128:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 221us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334979.207442:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5000 00010000:00010000:3.0:1763334979.208211:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c4fe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.208224:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c4fe lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.208233:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c4fe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.208239:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334979.208244:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c4fe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.208253:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c4fe lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.208271:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:3.0:1763334979.208274:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334979.208279:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c4fe lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.208285:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c4fe lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334979.209830:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.209930:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694576256 00000100:00100000:2.0:1763334979.209941:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694576256 00000100:00100000:2.0:1763334979.210015:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5001 00000100:00100000:2.0:1763334979.210025:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:53650:x1848989694576256:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334979.210047:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334979.210069:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849c50c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0307 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.210103:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c2b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b020b expref: 23 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.210113:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334979.210115:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334979.210120:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849c50c lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0307 expref: 23 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.210156:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c2b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b020b expref: 23 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.210169:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c2b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b020b expref: 23 pid: 32241 timeout: 1143 lvb_type: 0 00000100:00100000:2.0:1763334979.210183:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701870848:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334979.210278:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee480 going to sleep for 11 seconds 00000100:00100000:2.0:1763334979.213908:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701870848:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334979.213957:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849c50c lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0307 expref: 23 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.213982:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430600, rc 0) 00000100:00100000:2.0:1763334979.214874:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:53650:x1848989694576256:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4842us (5047us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334979.214887:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5001 00000100:00100000:0.0:1763334979.215792:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.215969:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694576384 00000100:00100000:1.0:1763334979.215983:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694576384 00010000:00010000:1.0:1763334979.216044:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c2b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b020b expref: 23 pid: 32241 timeout: 1143 lvb_type: 0 00000100:00100000:1.0:1763334979.216085:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2618 00000100:00100000:1.0:1763334979.216096:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694576384:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334979.216114:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334979.216142:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c2b2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b020b expref: 23 pid: 32241 timeout: 1143 lvb_type: 0 00010000:00010000:1.0:1763334979.216158:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c2b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b020b expref: 23 pid: 32241 timeout: 1143 lvb_type: 0 00010000:00010000:1.0:1763334979.216188:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c2b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b020b expref: 23 pid: 32241 timeout: 1143 lvb_type: 0 00010000:00010000:1.0:1763334979.216207:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.216210:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.216217:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849c50c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0307 expref: 22 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.216228:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849c50c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0307 expref: 22 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.216286:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430600/0xcedf0054f849c50c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0307 expref: 22 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334979.216307:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701870976:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334979.216409:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af69b2c00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334979.221205:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.221248:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.221407:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701870976:192.168.201.60@tcp:105: 00010000:00010000:0.0:1763334979.221440:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334979.221527:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694576384:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5431us (5740us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.221542:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2618 00000100:00100000:2.0:1763334979.223421:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694576512 00000100:00100000:2.0:1763334979.223441:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694576512 00002000:00010000:2.0:1763334979.223504:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/586 (217778->18446744073709551615) 00002000:00100000:2.0:1763334979.223511:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa7ec000 with x1848989694576512 ext(217778->18446744073709551615) 00002000:00010000:2.0:1763334979.223530:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa7ec000. 00000100:00100000:3.0:1763334979.223686:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694576640 00000100:00100000:3.0:1763334979.223692:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694576640 00002000:00010000:3.0:1763334979.223715:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/590 (0->18446744073709551615) 00002000:00100000:3.0:1763334979.223719:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa7ec380 with x1848989694576640 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334979.223727:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa7ec380. 00000100:00100000:2.0:1763334979.223878:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1858 00000100:00100000:2.0:1763334979.223891:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694576512:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:2.0:1763334979.224285:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 221184 -> 217778 00002000:00010000:2.0:1763334979.224290:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334979.224293:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334979.224295:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334979.224298:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1763334979.224491:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1859 00000100:00100000:1.0:1763334979.224503:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694576640:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:1.0:1763334979.224711:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334979.224715:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334977 -> 1763334979 00002000:00010000:1.0:1763334979.224717:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334979.224720:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334978 -> 1763334979 00002000:00010000:1.0:1763334979.224722:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334979.225463:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694576512:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 1568us (4267us total) trans 21474838459 rc 0/0 00000100:00100000:2.0:1763334979.225475:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1858 00002000:00010000:2.0:1763334979.225480:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/586 (217778->18446744073709551615) 00002000:00100000:2.0:1763334979.225484:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa7ec000 with x1848989694576512 ext(217778->18446744073709551615) 00002000:00010000:2.0:1763334979.225494:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa7ec000. 00000100:00100000:1.0:1763334979.225665:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694576640:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 1165us (4416us total) trans 17179871197 rc 0/0 00000100:00100000:1.0:1763334979.225673:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1859 00002000:00010000:1.0:1763334979.225677:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/590 (0->18446744073709551615) 00002000:00100000:1.0:1763334979.225680:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa7ec380 with x1848989694576640 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334979.225686:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa7ec380. 00000100:00100000:3.0:1763334979.232414:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.232514:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694576896 00000100:00100000:2.0:1763334979.232529:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694576896 00000100:00100000:2.0:1763334979.232635:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4923 00000100:00100000:2.0:1763334979.232647:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53650:x1848989694576896:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334979.232788:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c513 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.232808:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c513 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.232820:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c513 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:2.0:1763334979.233003:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bf64c331 reply state 000000001a89b7f6 transno 8589939125 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c513 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334979.233028:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334979.233158:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53650:x1848989694576896:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 511us (759us total) trans 8589939125 rc 0/0 00000100:00100000:2.0:1763334979.233166:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4923 00000100:00100000:0.0:1763334979.236998:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334979.237123:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c513 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334979.237139:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c513 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334979.237148:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c513 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334979.237159:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334979.237166:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c513 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334979.237175:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c513 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334979.237197:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:1.0:1763334979.237200:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334979.237205:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c513 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334979.237212:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c513 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334979.237303:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694577024 00000100:00100000:2.0:1763334979.237316:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694577024 00000100:00100000:2.0:1763334979.237379:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5002 00000100:00100000:2.0:1763334979.237390:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694577024:12345-192.168.201.60@tcp:2:lfs.0 00000100:00100000:3.0:1763334979.237875:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334979.237923:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.237973:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694577152 00000100:00100000:0.0:1763334979.237979:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694577152 00000100:00100000:0.0:1763334979.238021:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694577280 00000100:00100000:0.0:1763334979.238024:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694577280 00000100:00100000:0.0:1763334979.238049:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5003 00000100:00100000:0.0:1763334979.238055:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694577152:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334979.238214:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334979.238218:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.238220:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334976 -> 1763334979 00002000:00010000:0.0:1763334979.238223:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.238225:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334979.238287:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694577152:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 231us (414us total) trans 21474838460 rc 0/0 00000100:00100000:0.0:1763334979.238294:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5003 00000100:00100000:0.0:1763334979.238311:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5004 00000100:00100000:0.0:1763334979.238316:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694577280:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334979.238450:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 217778 -> 217778 00002000:00010000:2.0:1763334979.238453:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334979.238455:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334979 00002000:00010000:2.0:1763334979.238458:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334979.238460:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 283 -> 283 00000100:00100000:2.0:1763334979.238483:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694577024:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 1095us (1501us total) trans 17179871199 rc 0/0 00000100:00100000:2.0:1763334979.238488:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5002 00002000:00010000:0.0:1763334979.239694:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334979.239702:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.239706:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334976 -> 1763334979 00002000:00010000:0.0:1763334979.239709:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.239711:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334979.239785:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694577280:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 1464us (1857us total) trans 17179871198 rc 0/0 00000100:00100000:0.0:1763334979.239794:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5004 00000100:00100000:3.0:1763334979.249249:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.249407:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694577536 00000100:00100000:0.0:1763334979.249421:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694577536 00000100:00100000:0.0:1763334979.249501:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1792 00000100:00100000:0.0:1763334979.249515:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53650:x1848989694577536:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:0.0:1763334979.249659:0:29630:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x1ab:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c472 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02c1 expref: 194 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.249731:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334979.249747:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c49c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02c8 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.249758:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334979.249804:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c49c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02c8 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.249820:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c49c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02c8 expref: 194 pid: 30972 timeout: 1143 lvb_type: 0 00000100:00100000:0.0:1763334979.249838:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701871104:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334979.249954:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1763334979.251736:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.251896:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694577664 00000100:00100000:1.0:1763334979.251908:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694577664 00010000:00010000:1.0:1763334979.251958:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c49c lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02c8 expref: 195 pid: 30972 timeout: 1143 lvb_type: 0 00000100:00100000:0.0:1763334979.252091:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701871104:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334979.252120:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:1.0:1763334979.252741:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2619 00000100:00100000:1.0:1763334979.252757:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2359:x1848989694577664:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334979.252780:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334979.252789:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c49c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02c8 expref: 195 pid: 30972 timeout: 1143 lvb_type: 0 00010000:00010000:1.0:1763334979.252804:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c49c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02c8 expref: 195 pid: 30972 timeout: 1143 lvb_type: 0 00010000:00010000:1.0:1763334979.252833:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c49c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02c8 expref: 195 pid: 30972 timeout: 1143 lvb_type: 0 00010000:00010000:1.0:1763334979.252855:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:1.0:1763334979.252861:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334979.252872:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334979.252879:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334979.252904:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334979.253060:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334979.253069:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:1.0:1763334979.253689:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2359:x1848989694577664:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 935us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334979.253701:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2619 00000040:00080000:0.0:1763334979.254226:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1156, 88 off98920 00000004:00080000:0.0:1763334979.254240:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1043887667237ns, next at 1040839994511ns, rc = 0 00000040:00080000:0.0:1763334979.255787:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1145, 88 off97832 00000004:00080000:0.0:1763334979.255805:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1043889232823ns, next at 1040839334561ns, rc = 0 00000040:00080000:0.0:1763334979.256983:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1146, 88 off97920 00000004:00080000:0.0:1763334979.256995:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1043890422738ns, next at 1040839334561ns, rc = 0 00000040:00080000:0.0:1763334979.257030:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1157, 88 off99008 00000004:00080000:0.0:1763334979.257034:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1043890462324ns, next at 1040839994511ns, rc = 0 00000040:00080000:0.0:1763334979.257047:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1158, 88 off99096 00000004:00080000:0.0:1763334979.257050:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1043890478028ns, next at 1040839994511ns, rc = 0 00000040:00080000:0.0:1763334979.257062:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1147, 88 off98008 00000004:00080000:0.0:1763334979.257065:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1043890493219ns, next at 1040839334561ns, rc = 0 00000040:00080000:0.0:1763334979.257077:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1148, 88 off98096 00000004:00080000:0.0:1763334979.257080:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1043890508468ns, next at 1040839334561ns, rc = 0 00000040:00080000:0.0:1763334979.257091:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1159, 88 off99184 00000004:00080000:0.0:1763334979.257094:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1043890521978ns, next at 1040839994511ns, rc = 0 00000001:00080000:0.0:1763334979.297631:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939126 is committed 00000004:00080000:0.0:1763334979.297650:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 771 committed 00000004:00080000:0.0:1763334979.297966:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 759 committed 00000004:00080000:0.0:1763334979.297981:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 758 committed 00000004:00080000:0.0:1763334979.297984:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 770 committed 00000100:00100000:1.0:1763334979.298151:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701871360:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334979.298255:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334979.298309:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763334979.298316:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701871488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334979.298340:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334979.298377:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701871360 00000100:00100000:1.0:1763334979.298387:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701871360 00000100:00100000:1.0:1763334979.298456:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701871488 00000100:00100000:1.0:1763334979.298460:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701871488 00000100:00100000:1.0:1763334979.298486:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5005 00000100:00100000:1.0:1763334979.298498:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1848989701871360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334979.298863:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334979.298868:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:1.0:1763334979.298871:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334979 -> 1763334979 00002000:00010000:1.0:1763334979.298874:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:1.0:1763334979.298877:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334979.298929:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3289:x1848989701871360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 432us (674us total) trans 17179871200 rc 0/0 00000100:00100000:1.0:1763334979.298939:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5005 00000100:00100000:1.0:1763334979.298960:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5006 00000100:00100000:1.0:1763334979.298968:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3289:x1848989701871488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334979.299072:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb size from disk: 217778 -> 217778 00002000:00010000:1.0:1763334979.299076:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:1.0:1763334979.299078:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334979.299081:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:1.0:1763334979.299083:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1763334979.299110:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3289:x1848989701871488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 143us (769us total) trans 17179871201 rc 0/0 00000100:00100000:1.0:1763334979.299116:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5006 00000100:00100000:1.0:1763334979.299163:0:3289:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871194 gen 2 00000004:00080000:1.0:1763334979.299169:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d7800, transno 17179871191 00000004:00080000:1.0:1763334979.299178:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d5180, transno 17179871192 00000004:00080000:1.0:1763334979.299181:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d7b80, transno 17179871193 00000004:00080000:1.0:1763334979.299184:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d5f80, transno 17179871194 00000100:00100000:1.0:1763334979.299190:0:3289:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5b01f2c700 x1848989701871488/t17179871201(17179871201) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334995 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1763334979.299203:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5b01f2c700/2, rc 0, transno 17179871201 00000100:00100000:1.0:1763334979.299209:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701871488:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334979.299222:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa7ed880/2, rc 0, transno 17179871200 00000100:00100000:1.0:1763334979.299226:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701871360:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334979.299429:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 2 in flight, 4 done 00000004:00080000:0.0:1763334979.299537:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 769 committed 00000004:00080000:0.0:1763334979.299542:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 757 committed 00000004:00080000:0.0:1763334979.299545:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 756 committed 00000004:00080000:0.0:1763334979.299547:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 768 committed 00000100:00100000:3.0:1763334979.299666:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701871232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334979.299716:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334979.299755:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334979.299762:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701871616:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334979.299784:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334979.299825:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701871232 00000100:00100000:3.0:1763334979.299831:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701871232 00000100:00100000:3.0:1763334979.299870:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701871616 00000100:00100000:3.0:1763334979.299873:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701871616 00000100:00100000:3.0:1763334979.300767:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5007 00000004:00010000:2.0:1763334979.300854:0:29630:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d3c5f60e reply state 000000008b2e497f transno 8589939126 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:2.0:1763334979.300870:0:29630:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1763334979.300882:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:2.0:1763334979.300886:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334979.300895:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c472 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02c1 expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00080000:2.0:1763334979.301061:0:29630:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1763334979.301076:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53650:x1848989694577536:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 51565us (51842us total) trans 8589939126 rc 0/0 00000100:00100000:2.0:1763334979.301086:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1792 00000100:00100000:2.0:1763334979.301123:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5008 00000100:00100000:2.0:1763334979.301132:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3292:x1848989701871616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763334979.301338:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334979.301342:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334979.301345:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334979.301347:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334979.301349:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334979.301407:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701871616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 277us (1621us total) trans 17179871202 rc 0/0 00000100:00100000:2.0:1763334979.301413:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5008 00010000:00010000:2.0:1763334979.301566:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334979.301620:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334979.301629:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334979.301635:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334979.301641:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334979.301650:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334979.301668:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:2.0:1763334979.301670:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334979.301676:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334979.301683:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c51a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00000004:00080000:2.0:1763334979.301746:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6bed180/2, rc 0, transno 17179871202 00000100:00100000:2.0:1763334979.301755:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701871616:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1763334979.303795:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763334979.303935:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701871744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334979.304038:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334979.304388:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701871744 00000100:00100000:3.0:1763334979.304399:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701871744 00000100:00100000:3.0:1763334979.304471:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5009 00000100:00100000:3.0:1763334979.304480:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3292:x1848989701871744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334979.304773:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334979.304778:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334979.304781:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334979.304783:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334979.304785:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334979.305718:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb344850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3292:x1848989701871744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1234us (1675us total) trans 21474838461 rc 0/0 00000100:00100000:3.0:1763334979.305731:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5009 00000100:00080000:3.0:1763334979.305780:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763334979.305796:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701872000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334979.305840:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334979.305865:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763334979.305869:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701871872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334979.305884:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334979.305904:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701872000 00000100:00100000:3.0:1763334979.305910:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701872000 00000100:00100000:3.0:1763334979.305939:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701871872 00000100:00100000:3.0:1763334979.305943:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701871872 00000100:00100000:3.0:1763334979.305967:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5010 00000100:00100000:3.0:1763334979.305975:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3290:x1848989701872000:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334979.306174:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334979.306178:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334979.306180:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334979.306183:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334979.306187:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334979.306223:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3290:x1848989701872000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 248us (382us total) trans 21474838462 rc 0/0 00000100:00100000:3.0:1763334979.306230:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5010 00000100:00100000:3.0:1763334979.306243:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5011 00000100:00100000:3.0:1763334979.306249:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+7:3290:x1848989701871872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334979.306346:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334979.306349:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334979.306351:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334979.306353:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334979.306355:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334979.306379:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3290:x1848989701871872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 130us (493us total) trans 21474838463 rc 0/0 00000100:00100000:3.0:1763334979.306386:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5011 00000100:00100000:3.0:1763334979.306438:0:3290:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838456 gen 2 00000004:00080000:3.0:1763334979.306445:0:3290:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474838444 committed transno 21474838456 00000004:00080000:3.0:1763334979.306503:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeecebb80, transno 21474838445 00000004:00080000:3.0:1763334979.306508:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa766d80, transno 21474838446 00000004:00080000:3.0:1763334979.306512:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa766680, transno 21474838447 00000004:00080000:3.0:1763334979.306514:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeeceb100, transno 21474838448 00000004:00080000:3.0:1763334979.306517:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d4700, transno 21474838453 00000004:00080000:3.0:1763334979.306520:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeec5b100, transno 21474838454 00000004:00080000:3.0:1763334979.306523:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d6300, transno 21474838455 00000004:00080000:3.0:1763334979.306526:0:3290:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeec5bb80, transno 21474838456 00000100:00100000:3.0:1763334979.306533:0:3290:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5ad81fce00 x1848989701871872/t21474838463(21474838463) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334995 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763334979.306546:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81fce00/2, rc 0, transno 21474838463 00000100:00100000:3.0:1763334979.306553:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701871872:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334979.306566:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81ff480/2, rc 0, transno 21474838462 00000100:00100000:3.0:1763334979.306599:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701872000:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334979.306618:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701872128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334979.306648:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334979.306681:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701872128 00000100:00100000:3.0:1763334979.306685:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701872128 00000100:00100000:3.0:1763334979.306710:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5012 00000100:00100000:3.0:1763334979.306717:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701872128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334979.306810:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 217778 -> 217778 00002000:00010000:3.0:1763334979.306813:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334979.306815:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334979.306817:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334979.306819:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334979.306852:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701872128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 135us (203us total) trans 21474838464 rc 0/0 00000100:00100000:3.0:1763334979.306858:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5012 00000004:00080000:3.0:1763334979.306884:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81fd500/2, rc 0, transno 21474838464 00000100:00100000:3.0:1763334979.306890:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701872128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334979.306906:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3292:x1848989701871232:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334979.307071:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 217778 -> 217778 00002000:00010000:3.0:1763334979.307075:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334979.307077:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334979.307079:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334979.307082:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 283 -> 283 00000100:00100000:3.0:1763334979.307113:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701871232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2792us (7397us total) trans 17179871203 rc 0/0 00000100:00100000:3.0:1763334979.307120:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5007 00000004:00080000:2.0:1763334979.308055:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 1 in flight, 8 done 00000004:00080000:0.0:1763334979.308275:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81fc380/2, rc 0, transno 21474838461 00000100:00100000:0.0:1763334979.308284:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701871744:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334979.308301:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa7ee300/2, rc 0, transno 17179871203 00000100:00100000:0.0:1763334979.308305:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701871232:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334979.310472:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.312277:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694577792 00000100:00100000:0.0:1763334979.312297:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694577792 00000100:00100000:0.0:1763334979.312396:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4924 00000100:00100000:0.0:1763334979.312410:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53650:x1848989694577792:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334979.312443:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334979.312476:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c521 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b030e expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.312553:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c521 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b030e expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.312587:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c521 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b030e expref: 188 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.312609:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:0.0:1763334979.312614:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334979.312618:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334979.312698:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53650:x1848989694577792:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 291us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.312705:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4924 00000100:00100000:3.0:1763334979.316685:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.316737:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694578048 00000100:00100000:2.0:1763334979.316754:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694578048 00000100:00100000:1.0:1763334979.317401:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1793 00000100:00100000:1.0:1763334979.317419:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53650:x1848989694578048:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334979.318139:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53650:x1848989694578048:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 724us (1466us total) trans 8589939127 rc 0/0 00000100:00100000:1.0:1763334979.318148:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1793 00000100:00100000:3.0:1763334979.330668:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.330777:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694578176 00000100:00100000:2.0:1763334979.330792:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694578176 00000100:00100000:2.0:1763334979.330877:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4925 00000100:00100000:2.0:1763334979.330890:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53651:x1848989694578176:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334979.330918:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334979.330946:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c528 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0315 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.331050:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c52f lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331068:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c52f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331082:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c52f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331098:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c536 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331105:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c536 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331111:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c536 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331255:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c53d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331264:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c53d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331272:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c53d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334979.331315:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00000004:00200000:2.0:1763334979.331321:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334979.331344:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c53d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331357:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c53d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331367:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c52f lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331375:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c52f lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331383:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c52f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331390:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334979.331395:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c52f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331405:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c52f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331419:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334979.331423:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334979.331429:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c52f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331435:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c52f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331450:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c536 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331456:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c536 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331461:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c536 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331466:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334979.331468:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c536 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331474:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c536 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331480:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334979.331483:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334979.331485:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c536 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331491:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c536 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.331525:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c528 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0315 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.331540:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c53d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0315 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.331547:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:2.0:1763334979.331549:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334979.331551:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431000, rc 0) 00000100:00100000:2.0:1763334979.331662:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53651:x1848989694578176:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 775us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334979.331671:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4925 00000100:00100000:2.0:1763334979.334568:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.334737:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694578432 00000100:00100000:0.0:1763334979.334752:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694578432 00000100:00100000:0.0:1763334979.334819:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4926 00000100:00100000:0.0:1763334979.334828:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53651:x1848989694578432:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334979.334852:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334979.334876:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c544 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b031c expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.334992:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c54b lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.335019:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c54b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.335033:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c54b lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334979.335047:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00010000:00010000:0.0:1763334979.335201:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c544 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b031c expref: 193 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.335219:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c54b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b031c expref: 192 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.335228:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:0.0:1763334979.335232:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763334979.335236:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334979.335313:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53651:x1848989694578432:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 486us (758us total) trans 8589939128 rc 0/0 00000100:00100000:0.0:1763334979.335320:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4926 00000100:00100000:3.0:1763334979.339979:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.340602:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694578688 00000100:00100000:2.0:1763334979.340617:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694578688 00000100:00100000:2.0:1763334979.340686:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4927 00000100:00100000:2.0:1763334979.340699:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53651:x1848989694578688:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334979.340730:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334979.340758:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c559 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0323 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.340895:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c560 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.340914:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c560 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.340929:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c560 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334979.340945:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00010000:00010000:2.0:1763334979.341128:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c559 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0323 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.341151:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c560 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0323 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.341161:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:2.0:1763334979.341165:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334979.341169:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431c00, rc 0) 00000100:00100000:2.0:1763334979.341319:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53651:x1848989694578688:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 621us (1357us total) trans 8589939129 rc 0/0 00000100:00100000:2.0:1763334979.341328:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4927 00000100:00100000:3.0:1763334979.382306:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.382447:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694578816 00000100:00100000:2.0:1763334979.382462:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694578816 00000100:00100000:2.0:1763334979.382559:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1860 00000100:00100000:2.0:1763334979.382611:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694578816:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334979.382661:0:25999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c56e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.382680:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334979.382682:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334979.382689:0:25999:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c56e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.382710:0:25999:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c56e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.389500:0:25999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c56e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.389524:0:25999:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c56e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.389534:0:25999:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c56e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.389543:0:25999:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334979.389547:0:25999:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c56e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.389557:0:25999:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c56e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.389610:0:25999:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c56e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.389619:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c56e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334979.389726:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694578816:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 7149us (7428us total) trans 0 rc 217778/217778 00000100:00100000:2.0:1763334979.389739:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1860 00000100:00100000:3.0:1763334979.393456:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.393693:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694578944 00000100:00100000:2.0:1763334979.393707:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694578944 00000100:00100000:2.0:1763334979.393817:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1861 00000100:00100000:2.0:1763334979.393828:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694578944:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334979.393876:0:25999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.393898:0:25999:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c4e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02eb expref: 25 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.393907:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334979.393909:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334979.393913:0:25999:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.393958:0:25999:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c4e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02eb expref: 25 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.393973:0:25999:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c4e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02eb expref: 25 pid: 21625 timeout: 1144 lvb_type: 0 00000100:00100000:2.0:1763334979.393989:0:25999:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0001_UUID:25999:1848989701872256:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334979.394122:0:25999:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8eecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334979.397560:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.397985:0:25999:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0001_UUID:25999:1848989701872256:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334979.398039:0:25999:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334979.399041:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694579072 00000100:00100000:1.0:1763334979.399054:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694579072 00010000:00010000:1.0:1763334979.399109:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c4e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02eb expref: 26 pid: 21625 timeout: 1144 lvb_type: 0 00000100:00100000:1.0:1763334979.399166:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2620 00000100:00100000:1.0:1763334979.399178:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694579072:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334979.399200:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334979.399231:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c4e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02eb expref: 26 pid: 21625 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334979.399247:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c4e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02eb expref: 26 pid: 21625 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334979.399290:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c4e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02eb expref: 26 pid: 21625 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334979.399311:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.399313:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.399319:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.399330:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.399365:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334979.399605:0:25999:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.399619:0:25999:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334979.400597:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694579072:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1395us (3026us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334979.400611:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2620 00010000:00010000:2.0:1763334979.406037:0:25999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.406062:0:25999:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.406072:0:25999:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.406080:0:25999:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334979.406084:0:25999:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.406093:0:25999:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.406116:0:25999:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.406123:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c575 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334979.406491:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694578944:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 12656us (13043us total) trans 0 rc 217778/217778 00000100:00100000:2.0:1763334979.406505:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1861 00000100:00100000:0.0:1763334979.411039:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.411436:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694579200 00000100:00100000:2.0:1763334979.411451:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694579200 00000100:00100000:2.0:1763334979.411746:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1862 00000100:00100000:2.0:1763334979.411759:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2361:x1848989694579200:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334979.411809:0:25999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.411833:0:25999:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c505 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0300 expref: 17 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.411842:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334979.411844:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334979.411849:0:25999:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.411895:0:25999:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c505 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0300 expref: 17 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.411910:0:25999:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c505 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0300 expref: 17 pid: 26564 timeout: 1144 lvb_type: 0 00000100:00100000:2.0:1763334979.411928:0:25999:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0000_UUID:25999:1848989701872384:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334979.412767:0:25999:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8eecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334979.415886:0:25999:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0000_UUID:25999:1848989701872384:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334979.415929:0:25999:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334979.417765:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.421776:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694579328 00000100:00100000:1.0:1763334979.421801:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694579328 00010000:00010000:1.0:1763334979.421898:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c505 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0300 expref: 18 pid: 26564 timeout: 1144 lvb_type: 0 00000100:00100000:1.0:1763334979.421955:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2621 00000100:00100000:1.0:1763334979.421967:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694579328:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334979.421989:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334979.422026:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c505 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0300 expref: 18 pid: 26564 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334979.422042:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c505 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0300 expref: 18 pid: 26564 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334979.422074:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c505 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0300 expref: 18 pid: 26564 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334979.422095:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.422098:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.422103:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.422114:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.422149:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334979.422237:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694579328:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 273us (4485us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334979.422246:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2621 00010000:00010000:2.0:1763334979.422709:0:25999:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.422723:0:25999:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.429985:0:25999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.430021:0:25999:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.430030:0:25999:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.430038:0:25999:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334979.430043:0:25999:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.430053:0:25999:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.430076:0:25999:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.430084:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c57c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.430287:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334979.430685:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694579200:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 18919us (19654us total) trans 0 rc 217778/217778 00000100:00100000:2.0:1763334979.430699:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1862 00000100:00100000:3.0:1763334979.447771:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.447892:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694579456 00000100:00100000:0.0:1763334979.447905:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694579456 00000100:00100000:0.0:1763334979.447996:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 401 00000100:00100000:0.0:1763334979.448037:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53651:x1848989694579456:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:0.0:1763334979.448059:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334979.448092:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c560 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0323 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.448117:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:0.0:1763334979.448123:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334979.449563:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53651:x1848989694579456:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 1514us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.449591:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 401 00000100:00100000:1.0:1763334979.453504:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.453630:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694579712 00000100:00100000:2.0:1763334979.453645:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694579712 00000100:00100000:2.0:1763334979.453720:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1794 00000100:00100000:2.0:1763334979.453732:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37a8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53651:x1848989694579712:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334979.454062:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37a8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53651:x1848989694579712:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 331us (573us total) trans 8589939130 rc 0/0 00000100:00100000:2.0:1763334979.454071:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1794 00000100:00100000:2.0:1763334979.459654:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.459817:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694579968 00000100:00100000:0.0:1763334979.459831:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694579968 00000100:00100000:0.0:1763334979.459928:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4928 00000100:00100000:0.0:1763334979.459940:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53644:x1848989694579968:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334979.459973:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334979.460018:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c583 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b032a expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.460163:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.460181:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c53d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0315 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.460191:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.460239:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c53d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0315 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.460271:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c53d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0315 expref: 195 pid: 30972 timeout: 1144 lvb_type: 0 00000100:00100000:0.0:1763334979.460288:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701872512:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334979.460402:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334979.464024:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701872512:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334979.464064:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334979.464992:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.465088:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694580096 00000100:00100000:0.0:1763334979.465099:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694580096 00010000:00010000:0.0:1763334979.465149:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c53d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0315 expref: 196 pid: 30972 timeout: 1144 lvb_type: 0 00000100:00100000:0.0:1763334979.465201:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2622 00000100:00100000:0.0:1763334979.465212:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2360:x1848989694580096:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334979.465234:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334979.465241:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c53d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0315 expref: 196 pid: 30972 timeout: 1144 lvb_type: 0 00010000:00010000:0.0:1763334979.465269:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c53d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0315 expref: 196 pid: 30972 timeout: 1144 lvb_type: 0 00010000:00010000:0.0:1763334979.465300:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849c53d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0315 expref: 196 pid: 30972 timeout: 1144 lvb_type: 0 00010000:00010000:0.0:1763334979.465320:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:0.0:1763334979.465326:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.465338:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.465347:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.465387:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334979.465463:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2360:x1848989694580096:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 252us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.465472:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2622 00010000:00010000:2.0:1763334979.465668:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.465676:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334979.465700:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00010000:00010000:2.0:1763334979.465918:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c583 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b032a expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.465938:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b032a expref: 195 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.465946:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:2.0:1763334979.465949:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334979.465953:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:2.0:1763334979.466799:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694579968:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 6854us (7156us total) trans 8589939131 rc 0/0 00000100:00100000:2.0:1763334979.466810:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4928 00000100:00100000:2.0:1763334979.472116:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.472565:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694580224 00000100:00100000:0.0:1763334979.472657:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694580224 00000100:00100000:0.0:1763334979.472909:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4929 00000100:00100000:0.0:1763334979.472921:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694580224:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334979.472952:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334979.472983:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c598 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0331 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.473109:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.473128:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b032a expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.473139:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.473185:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b032a expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.473201:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b032a expref: 196 pid: 32232 timeout: 1144 lvb_type: 0 00000100:00100000:0.0:1763334979.473218:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701872640:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334979.473347:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334979.482240:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701872640:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334979.482285:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334979.485211:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.485411:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694580352 00000100:00100000:1.0:1763334979.485426:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694580352 00010000:00010000:1.0:1763334979.485484:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b032a expref: 197 pid: 32232 timeout: 1144 lvb_type: 0 00000100:00100000:1.0:1763334979.485542:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2623 00000100:00100000:1.0:1763334979.485556:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694580352:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334979.485616:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334979.485625:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b032a expref: 197 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334979.485641:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b032a expref: 197 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334979.485671:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c58a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b032a expref: 197 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334979.485699:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:1.0:1763334979.485705:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334979.485717:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334979.485725:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334979.485763:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334979.485843:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694580352:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 290us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334979.485852:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2623 00010000:00010000:2.0:1763334979.486036:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.486045:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334979.486103:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00000004:00200000:2.0:1763334979.486109:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334979.486139:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.486186:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c598 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0331 expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.486203:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0331 expref: 195 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.486210:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:2.0:1763334979.486213:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334979.486216:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:2.0:1763334979.487708:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694580224:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 14777us (15598us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334979.487722:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4929 00000100:00100000:2.0:1763334979.495795:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.496712:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694580480 00000100:00100000:0.0:1763334979.496729:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694580480 00002000:00100000:0.0:1763334979.496806:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (151552->155647) req@ffff9a5ad809ed80 x1848989694580480/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:25/0 lens 488/0 e 0 to 0 dl 1763334990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334979.496819:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809ed80 with x1848989694580480 ext(151552->155647) 00002000:00010000:0.0:1763334979.496827:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad809ed80 00000100:00100000:0.0:1763334979.497038:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1863 00000100:00100000:0.0:1763334979.497050:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694580480:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:0.0:1763334979.497565:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694580480:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 515us (1783us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334979.497835:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1863 00002000:00100000:0.0:1763334979.497846:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (151552->155647) req@ffff9a5ad809ed80 x1848989694580480/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:25/0 lens 488/4536 e 0 to 0 dl 1763334990 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334979.497857:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809ed80 with x1848989694580480 ext(151552->155647) 00002000:00010000:0.0:1763334979.497863:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad809ed80 00000100:00100000:1.0:1763334979.503428:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.503744:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694580608 00000100:00100000:0.0:1763334979.503759:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694580608 00002000:00100000:0.0:1763334979.503834:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (155648->159743) req@ffff9a5af6bef800 x1848989694580608/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:25/0 lens 488/0 e 0 to 0 dl 1763334990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334979.503847:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bef800 with x1848989694580608 ext(155648->159743) 00002000:00010000:0.0:1763334979.503856:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6bef800 00000100:00100000:0.0:1763334979.503899:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1864 00000100:00100000:0.0:1763334979.503911:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694580608:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:0.0:1763334979.504209:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694580608:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 299us (796us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334979.504219:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1864 00002000:00100000:0.0:1763334979.504226:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (155648->159743) req@ffff9a5af6bef800 x1848989694580608/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:25/0 lens 488/4536 e 0 to 0 dl 1763334990 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334979.504235:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bef800 with x1848989694580608 ext(155648->159743) 00002000:00010000:0.0:1763334979.504239:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6bef800 00000100:00100000:1.0:1763334979.508211:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.508350:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694580736 00000100:00100000:2.0:1763334979.508367:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694580736 00002000:00100000:2.0:1763334979.508443:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (131072->196607) req@ffff9a5af6bef100 x1848989694580736/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:25/0 lens 504/0 e 0 to 0 dl 1763334990 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334979.508456:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bef100 with x1848989694580736 ext(131072->196607) 00002000:00010000:2.0:1763334979.508464:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6bef100 00000100:00100000:2.0:1763334979.508507:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1865 00000100:00100000:2.0:1763334979.508516:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694580736:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:1.0:1763334979.511775:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694580736:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 3241us (3567us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1763334979.511794:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1865 00002000:00100000:1.0:1763334979.511812:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (131072->196607) req@ffff9a5af6bef100 x1848989694580736/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:25/0 lens 504/440 e 0 to 0 dl 1763334990 ref 1 fl Complete:/600/0 rc 57344/57344 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334979.511826:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bef100 with x1848989694580736 ext(131072->196607) 00002000:00010000:1.0:1763334979.511834:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6bef100 00000100:00100000:1.0:1763334979.515342:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.515452:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694580992 00000100:00100000:0.0:1763334979.515467:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694580992 00000100:00100000:0.0:1763334979.515539:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1795 00000100:00100000:0.0:1763334979.515551:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694580992:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:0.0:1763334979.516147:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53644:x1848989694580992:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 594us (816us total) trans 8589939132 rc 0/0 00000100:00100000:0.0:1763334979.516157:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1795 00000100:00100000:2.0:1763334979.533555:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.533746:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694581120 00000100:00100000:0.0:1763334979.533768:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694581120 00000100:00100000:0.0:1763334979.533851:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4930 00000100:00100000:0.0:1763334979.533863:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53652:x1848989694581120:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334979.533898:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334979.533928:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c5a6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0338 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.534034:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c5ad lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.534052:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c5ad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.534065:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c5ad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.534082:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c5b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.534090:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.534101:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.534258:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849c5bb lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.534267:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849c5bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.534274:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849c5bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334979.534321:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00000004:00200000:0.0:1763334979.534326:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334979.534353:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849c5bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535019:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849c5bb lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535035:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c5ad lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535043:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c5ad lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535051:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c5ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535058:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334979.535063:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c5ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535071:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c5ad lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535098:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:0.0:1763334979.535102:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334979.535110:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c5ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535116:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c5ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535131:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535137:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c5b4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535143:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535147:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334979.535150:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535155:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c5b4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535162:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac7d60c00) 00010000:00010000:0.0:1763334979.535164:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334979.535166:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c5b4 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535171:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c5b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.535208:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c5a6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0338 expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.535223:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849c5bb lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0338 expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.535230:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:0.0:1763334979.535232:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334979.535234:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c314b400, rc 0) 00000100:00100000:0.0:1763334979.536819:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53652:x1848989694581120:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2941us (3263us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.536835:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4930 00000100:00100000:3.0:1763334979.547946:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.548087:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694581248 00000100:00100000:0.0:1763334979.548102:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694581248 00000100:00100000:0.0:1763334979.548187:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 402 00000100:00100000:0.0:1763334979.548199:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694581248:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334979.548220:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334979.548254:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849c5bb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0338 expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.548277:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:0.0:1763334979.548283:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334979.548361:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694581248:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 164us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.548370:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 402 00000100:00100000:1.0:1763334979.550207:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.550294:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694581504 00000100:00100000:0.0:1763334979.550304:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694581504 00000100:00100000:0.0:1763334979.550369:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4931 00000100:00100000:0.0:1763334979.550380:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53652:x1848989694581504:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334979.550405:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334979.550429:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849c5c2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b033f expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.550561:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.550619:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0331 expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.550631:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.550677:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0331 expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.550694:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0331 expref: 197 pid: 32232 timeout: 1144 lvb_type: 0 00000100:00100000:0.0:1763334979.550712:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701872768:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334979.550823:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0f780 going to sleep for 11 seconds 00000100:00100000:2.0:1763334979.566115:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.569220:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701872768:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334979.569263:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334979.570042:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694581632 00000100:00100000:1.0:1763334979.570056:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694581632 00010000:00010000:1.0:1763334979.570115:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0331 expref: 198 pid: 32232 timeout: 1144 lvb_type: 0 00000100:00100000:1.0:1763334979.570162:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2624 00000100:00100000:1.0:1763334979.570171:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+198:2359:x1848989694581632:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334979.570190:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334979.570196:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0331 expref: 198 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334979.570210:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0331 expref: 198 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334979.570242:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c59f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0331 expref: 198 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334979.570272:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:1.0:1763334979.570278:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334979.570290:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334979.570298:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:1.0:1763334979.570336:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334979.570430:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694581632:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 258us (4330us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334979.570438:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2624 00010000:00010000:2.0:1763334979.570553:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.570561:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334979.570613:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00010000:00010000:2.0:1763334979.570816:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b600/0xcedf0054f849c5c2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b033f expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.570835:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b033f expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.570844:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:2.0:1763334979.570847:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334979.570850:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c314b800, rc 0) 00000100:00100000:2.0:1763334979.570895:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53652:x1848989694581504:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 20517us (20698us total) trans 8589939133 rc 0/0 00000100:00100000:2.0:1763334979.570906:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4931 00000100:00100000:2.0:1763334979.577703:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.577817:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694581760 00000100:00100000:0.0:1763334979.577832:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694581760 00000100:00100000:0.0:1763334979.577912:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4932 00000100:00100000:0.0:1763334979.577927:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53652:x1848989694581760:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334979.577962:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334979.577992:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849c5d7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0346 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.578122:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.578140:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b033f expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.578150:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.578193:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b033f expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.578208:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b033f expref: 198 pid: 32232 timeout: 1144 lvb_type: 0 00000100:00100000:0.0:1763334979.578224:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701872896:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334979.578944:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334979.583897:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701872896:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334979.583935:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334979.584030:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.584097:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694581888 00000100:00100000:0.0:1763334979.584106:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694581888 00010000:00010000:0.0:1763334979.584148:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b033f expref: 199 pid: 32232 timeout: 1144 lvb_type: 0 00000100:00100000:0.0:1763334979.584336:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2625 00000100:00100000:0.0:1763334979.584348:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+199:2359:x1848989694581888:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334979.584372:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334979.584380:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b033f expref: 199 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:0.0:1763334979.584395:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b033f expref: 199 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:0.0:1763334979.584425:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849c5c9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b033f expref: 199 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:0.0:1763334979.584443:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:0.0:1763334979.584448:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.584458:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.584466:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334979.584884:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334979.585048:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.585057:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334979.585114:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00000004:00200000:2.0:1763334979.585119:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334979.585140:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.585182:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849c5d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0346 expref: 199 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.585198:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0346 expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.585205:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:2.0:1763334979.585207:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334979.585210:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334979.585263:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+198:2359:x1848989694581888:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 916us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.585272:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2625 00000100:00100000:2.0:1763334979.585873:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53652:x1848989694581760:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7946us (8184us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334979.585882:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4932 00000100:00100000:1.0:1763334979.589302:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334979.589439:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694582016 00000100:00100000:3.0:1763334979.589453:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694582016 00000100:00100000:3.0:1763334979.589988:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4933 00000100:00100000:3.0:1763334979.590013:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53652:x1848989694582016:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334979.590040:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334979.590069:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849c5e5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b034d expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.590161:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c5ec lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.590180:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c5ec lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.590193:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c5ec lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.590209:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c5f3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.590216:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.590224:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.590364:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c5fa lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.590374:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c5fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.590382:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c5fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:3.0:1763334979.593734:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00000004:00200000:3.0:1763334979.593747:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334979.593812:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c5fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593835:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c5fa lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593847:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c5ec lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593854:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c5ec lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593861:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c5ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593868:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334979.593873:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c5ec lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593882:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c5ec lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593900:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:3.0:1763334979.593903:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334979.593909:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c5ec lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593915:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c5ec lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593932:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593937:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c5f3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593942:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c5f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593946:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334979.593948:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c5f3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593952:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c5f3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593958:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5af66deb00) 00010000:00010000:3.0:1763334979.593961:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334979.593963:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c5f3 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.593967:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c5f3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334979.594035:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849c5e5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b034d expref: 199 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.594052:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c5fa lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b034d expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.594060:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:3.0:1763334979.594062:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334979.594064:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:3.0:1763334979.594166:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53652:x1848989694582016:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4166us (4877us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334979.594177:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4933 00000100:00100000:1.0:1763334979.596906:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.596960:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694582144 00000100:00100000:1.0:1763334979.596978:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694582144 00000100:00100000:1.0:1763334979.597068:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 403 00000100:00100000:1.0:1763334979.597080:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6befb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+198:2361:x1848989694582144:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334979.597104:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334979.597141:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c5fa lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b034d expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.597163:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:1.0:1763334979.597168:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334979.597236:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6befb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2361:x1848989694582144:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 158us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334979.597243:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 403 00000100:00100000:1.0:1763334979.599991:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334979.600098:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694582400 00000100:00100000:3.0:1763334979.600113:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694582400 00000100:00100000:2.0:1763334979.600537:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4934 00000100:00100000:2.0:1763334979.600554:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53652:x1848989694582400:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334979.600845:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334979.600879:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c601 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0354 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.601022:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c608 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.601040:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c608 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.601052:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c608 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334979.601067:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00010000:00010000:2.0:1763334979.601225:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c601 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0354 expref: 200 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.601244:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c608 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0354 expref: 199 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.601315:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:2.0:1763334979.601320:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334979.601324:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430400, rc 0) 00000100:00100000:2.0:1763334979.601417:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53652:x1848989694582400:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 867us (1440us total) trans 8589939134 rc 0/0 00000100:00100000:2.0:1763334979.601426:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4934 00000100:00100000:1.0:1763334979.638019:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.640376:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694582528 00000100:00100000:2.0:1763334979.640396:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694582528 00000100:00100000:3.0:1763334979.640622:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1866 00000100:00100000:3.0:1763334979.640635:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694582528:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:3.0:1763334979.640685:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c616 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.640705:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334979.640708:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334979.640715:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c616 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.640732:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c616 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.648206:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c616 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.648233:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c616 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.648244:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c616 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.648251:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334979.648256:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c616 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.648266:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c616 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.648292:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c616 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.648300:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849c616 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334979.649044:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694582528:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 8398us (11038us total) trans 0 rc 217778/217778 00000100:00100000:2.0:1763334979.649059:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1866 00000100:00100000:1.0:1763334979.655513:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.656099:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694582656 00000100:00100000:2.0:1763334979.656115:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694582656 00000100:00100000:2.0:1763334979.656208:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1867 00000100:00100000:2.0:1763334979.656220:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694582656:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:2.0:1763334979.656288:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24d:0x0] initial LVB size: 217778, mtime: 0x691a5b43, atime: 0x691a5b40, ctime: 0x691a5b43, blocks: 0x203 00010000:00010000:2.0:1763334979.656299:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c61d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.656322:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334979.656325:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334979.656332:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c61d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.656348:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c61d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.660236:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c61d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.660265:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c61d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.660278:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c61d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.660286:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334979.660291:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c61d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.660301:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c61d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.660328:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c61d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.660336:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849c61d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334979.661125:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694582656:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 4895us (5614us total) trans 0 rc 217778/217778 00000100:00100000:2.0:1763334979.661141:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1867 00000100:00100000:1.0:1763334979.665524:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.665652:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694582784 00000100:00100000:2.0:1763334979.665668:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694582784 00000100:00100000:2.0:1763334979.665763:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1868 00000100:00100000:2.0:1763334979.665776:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694582784:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:2.0:1763334979.665843:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 217778, mtime: 0x691a5b43, atime: 0x691a5b40, ctime: 0x691a5b43, blocks: 0x203 00010000:00010000:2.0:1763334979.665856:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c624 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.665874:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334979.665876:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334979.665883:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c624 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.665898:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c624 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.670282:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c624 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.670310:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c624 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.670321:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c624 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.670334:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334979.670340:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c624 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.670351:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c624 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.670377:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c624 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.670385:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c624 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334979.671100:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694582784:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 5315us (5580us total) trans 0 rc 217778/217778 00000100:00100000:2.0:1763334979.671115:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1868 00000100:00100000:1.0:1763334979.683453:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.683623:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694582912 00000100:00100000:0.0:1763334979.683637:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694582912 00000100:00100000:0.0:1763334979.683714:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 404 00000100:00100000:0.0:1763334979.683727:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53652:x1848989694582912:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:0.0:1763334979.683748:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334979.683781:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c608 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0354 expref: 199 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.683806:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:0.0:1763334979.683813:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334979.686060:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53652:x1848989694582912:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 2316us (2603us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.686081:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 404 00000100:00100000:1.0:1763334979.691201:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.691296:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694583168 00000100:00100000:2.0:1763334979.691310:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694583168 00000100:00100000:2.0:1763334979.691401:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1796 00000100:00100000:2.0:1763334979.691414:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53652:x1848989694583168:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334979.691792:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53652:x1848989694583168:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 379us (607us total) trans 8589939135 rc 0/0 00000100:00100000:2.0:1763334979.691801:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1796 00000100:00100000:2.0:1763334979.695837:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.695921:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694583424 00000100:00100000:0.0:1763334979.695936:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694583424 00000100:00100000:0.0:1763334979.696019:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1797 00000100:00100000:0.0:1763334979.696032:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53652:x1848989694583424:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334979.701646:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53652:x1848989694583424:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 5544us (5750us total) trans 8589939136 rc 0/0 00000100:00100000:0.0:1763334979.701668:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1797 00000100:00100000:1.0:1763334979.728255:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.728511:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694583680 00000100:00100000:2.0:1763334979.728527:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694583680 00000100:00100000:2.0:1763334979.728647:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4935 00000100:00100000:2.0:1763334979.728659:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53653:x1848989694583680:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334979.728695:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334979.728728:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c62b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b035b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.728862:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c632 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.728882:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c632 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.728896:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c632 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334979.728912:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00010000:00010000:2.0:1763334979.729098:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c62b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b035b expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.729122:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c632 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b035b expref: 202 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.729134:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:2.0:1763334979.729137:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334979.729142:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:2.0:1763334979.729219:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53653:x1848989694583680:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 561us (984us total) trans 8589939137 rc 0/0 00000100:00100000:2.0:1763334979.729228:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4935 00000100:00100000:1.0:1763334979.769394:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.769539:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694583808 00000100:00100000:2.0:1763334979.769555:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694583808 00000100:00100000:2.0:1763334979.769703:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1869 00000100:00100000:2.0:1763334979.769715:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694583808:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334979.769770:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c640 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.769789:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334979.769792:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334979.769800:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c640 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.769817:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c640 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.774102:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c640 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.774125:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c640 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.774135:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c640 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.774142:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334979.774147:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c640 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.774156:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c640 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.774179:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c640 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.774187:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430800/0xcedf0054f849c640 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334979.776428:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694583808:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 6695us (7037us total) trans 0 rc 217778/217778 00000100:00100000:2.0:1763334979.776448:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1869 00000100:00100000:1.0:1763334979.781464:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.781694:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694583936 00000100:00100000:2.0:1763334979.781709:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694583936 00000100:00100000:0.0:1763334979.782426:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1870 00000100:00100000:0.0:1763334979.782445:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694583936:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:0.0:1763334979.782524:0:25999:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24d:0x0] initial LVB size: 217778, mtime: 0x691a5b43, atime: 0x691a5b40, ctime: 0x691a5b43, blocks: 0x203 00010000:00010000:0.0:1763334979.782536:0:25999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849c647 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.782554:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334979.782558:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334979.782565:0:25999:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849c647 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.782602:0:25999:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849c647 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.787870:0:25999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849c647 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.787893:0:25999:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849c647 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.787902:0:25999:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849c647 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.787908:0:25999:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334979.787913:0:25999:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849c647 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.787922:0:25999:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849c647 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.787943:0:25999:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849c647 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.787949:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849c647 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334979.788151:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694583936:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 5703us (6696us total) trans 0 rc 217778/217778 00000100:00100000:0.0:1763334979.788165:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1870 00000100:00100000:1.0:1763334979.792725:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.792858:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694584064 00000100:00100000:0.0:1763334979.792871:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694584064 00000100:00100000:0.0:1763334979.792971:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1871 00000100:00100000:0.0:1763334979.792983:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aefad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694584064:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:0.0:1763334979.793062:0:25999:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 217778, mtime: 0x691a5b43, atime: 0x691a5b40, ctime: 0x691a5b43, blocks: 0x203 00010000:00010000:0.0:1763334979.793074:0:25999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c64e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.793093:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334979.793095:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334979.793102:0:25999:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c64e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.793117:0:25999:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c64e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.799796:0:25999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c64e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.799822:0:25999:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c64e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.799831:0:25999:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c64e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.799839:0:25999:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334979.799844:0:25999:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c64e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.799855:0:25999:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c64e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.799879:0:25999:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c64e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.799887:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c64e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->221183] (req 0->221183) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334979.800403:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aefad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694584064:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 7413us (7684us total) trans 0 rc 217778/217778 00000100:00100000:0.0:1763334979.800417:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1871 00000100:00100000:3.0:1763334979.815478:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.817919:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694584192 00000100:00100000:0.0:1763334979.817942:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694584192 00000100:00100000:0.0:1763334979.818060:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 405 00000100:00100000:0.0:1763334979.818073:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53653:x1848989694584192:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:0.0:1763334979.818097:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334979.818131:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c632 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b035b expref: 202 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.818156:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:0.0:1763334979.818163:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334979.818251:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53653:x1848989694584192:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 180us (2788us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.818259:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 405 00000100:00100000:1.0:1763334979.821530:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.821735:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694584448 00000100:00100000:0.0:1763334979.821750:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694584448 00000100:00100000:0.0:1763334979.821809:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1798 00000100:00100000:0.0:1763334979.821820:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53653:x1848989694584448:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334979.822168:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53653:x1848989694584448:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 348us (654us total) trans 8589939138 rc 0/0 00000100:00100000:0.0:1763334979.822177:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1798 00000100:00100000:3.0:1763334979.827352:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.828504:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694584704 00000100:00100000:2.0:1763334979.828521:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694584704 00000100:00100000:2.0:1763334979.828833:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4936 00000100:00100000:2.0:1763334979.828847:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53644:x1848989694584704:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334979.828881:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334979.828910:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c655 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0362 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.829061:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.829077:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0346 expref: 203 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.829087:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.829133:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0346 expref: 203 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.829156:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0346 expref: 203 pid: 32232 timeout: 1144 lvb_type: 0 00000100:00100000:2.0:1763334979.829174:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701873024:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334979.830101:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334979.837068:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.837203:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694584832 00000100:00100000:0.0:1763334979.837216:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694584832 00010000:00010000:0.0:1763334979.837366:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0346 expref: 204 pid: 32232 timeout: 1144 lvb_type: 0 00000100:00100000:0.0:1763334979.837418:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2626 00000100:00100000:0.0:1763334979.837431:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2359:x1848989694584832:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334979.837452:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334979.837460:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0346 expref: 204 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:0.0:1763334979.837475:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0346 expref: 204 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:0.0:1763334979.837507:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:0.0:1763334979.837514:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334979.837526:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334979.837535:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334979.837561:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334979.837721:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c5de lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0346 expref: 204 pid: 32232 timeout: 1144 lvb_type: 0 00000100:00100000:2.0:1763334979.837740:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701873024:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334979.837765:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.837775:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.837780:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334979.837801:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00010000:00010000:2.0:1763334979.837989:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c655 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0362 expref: 205 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.838016:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0362 expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.838023:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:2.0:1763334979.838026:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334979.838030:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:0.0:1763334979.839954:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2359:x1848989694584832:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 2511us (2888us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.839972:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2626 00000100:00100000:2.0:1763334979.841981:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694584704:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 13119us (14628us total) trans 8589939139 rc 0/0 00000100:00100000:2.0:1763334979.842008:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4936 00000100:00100000:0.0:1763334979.844141:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.844238:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694584960 00000100:00100000:2.0:1763334979.844375:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694584960 00000100:00100000:2.0:1763334979.844440:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4937 00000100:00100000:2.0:1763334979.844450:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694584960:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334979.844482:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334979.844509:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c66a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0369 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.844641:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c671 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.844660:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0362 expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.844670:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c671 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.844715:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0362 expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.844731:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0362 expref: 204 pid: 30972 timeout: 1144 lvb_type: 0 00000100:00100000:2.0:1763334979.844746:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701873152:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334979.844850:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334979.849809:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701873152:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334979.849851:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c671 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334979.850053:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.850755:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694585088 00000100:00100000:2.0:1763334979.850769:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694585088 00010000:00010000:2.0:1763334979.850825:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0362 expref: 205 pid: 30972 timeout: 1144 lvb_type: 0 00000100:00100000:2.0:1763334979.850876:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2627 00000100:00100000:2.0:1763334979.850888:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+205:2360:x1848989694585088:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334979.850911:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334979.850920:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0362 expref: 205 pid: 30972 timeout: 1144 lvb_type: 0 00010000:00010000:2.0:1763334979.850933:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0362 expref: 205 pid: 30972 timeout: 1144 lvb_type: 0 00010000:00010000:2.0:1763334979.850962:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c65c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0362 expref: 205 pid: 30972 timeout: 1144 lvb_type: 0 00010000:00010000:2.0:1763334979.850984:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:2.0:1763334979.850990:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c671 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.851014:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c671 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.851023:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c671 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334979.851064:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334979.851135:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2360:x1848989694585088:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 248us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334979.851144:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2627 00010000:00010000:3.0:1763334979.851615:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c671 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334979.851626:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c671 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334979.851685:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00000004:00200000:3.0:1763334979.851691:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334979.851716:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c671 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334979.851758:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c66a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0369 expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.851774:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c671 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0369 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.851782:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:3.0:1763334979.851784:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334979.851787:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430400, rc 0) 00000100:00100000:3.0:1763334979.851838:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694584960:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 7389us (7709us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334979.851846:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4937 00000100:00100000:0.0:1763334979.858018:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334979.858104:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694585344 00000100:00100000:3.0:1763334979.858119:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694585344 00000100:00100000:3.0:1763334979.858747:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4938 00000100:00100000:3.0:1763334979.858763:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694585344:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:3.0:1763334979.858850:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334979.858895:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c671 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0369 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.858922:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:3.0:1763334979.858928:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334979.859354:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c678 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334979.859377:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c678 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334979.859392:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c678 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:3.0:1763334979.859467:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939140 00000004:00010000:3.0:1763334979.859500:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007833ab64 reply state 00000000d4284418 transno 8589939141 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c678 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334979.859510:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334979.859682:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694585344:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 922us (1686us total) trans 8589939141 rc 0/0 00000100:00100000:3.0:1763334979.859691:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4938 00000020:00080000:3.0:1763334979.859698:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763334979.864708:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c678 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334979.864738:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c678 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334979.864747:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c678 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334979.864754:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334979.864761:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c678 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334979.864771:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c678 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334979.864796:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:1.0:1763334979.864801:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334979.864808:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c678 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334979.864815:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c678 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334979.865386:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.865498:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694585600 00000100:00100000:1.0:1763334979.865513:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694585600 00000100:00100000:1.0:1763334979.865897:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1799 00000100:00100000:1.0:1763334979.865910:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53644:x1848989694585600:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:1.0:1763334979.866409:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694585600:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 498us (1031us total) trans 8589939142 rc 0/0 00000100:00100000:1.0:1763334979.866419:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1799 00000100:00100000:0.0:1763334979.869111:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334979.869191:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694585856 00000100:00100000:3.0:1763334979.869206:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694585856 00000100:00100000:3.0:1763334979.869279:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4939 00000100:00100000:3.0:1763334979.869289:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694585856:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334979.869318:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334979.869321:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1763334979.869355:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c54b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b031c expref: 205 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.869383:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849c521 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b030e expref: 204 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.869394:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60600) 00010000:00010000:3.0:1763334979.869406:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334979.869425:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c67f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0370 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.869487:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c686 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334979.869502:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c686 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334979.869513:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c686 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:3.0:1763334979.870093:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1160, 88 off99272 00000004:00080000:3.0:1763334979.870104:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1044503531734ns, next at 1040839994511ns, rc = 0 00000040:00080000:3.0:1763334979.870167:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1149, 88 off98184 00000004:00080000:3.0:1763334979.870174:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1044503602391ns, next at 1040839334561ns, rc = 0 00000040:00080000:3.0:1763334979.870207:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1150, 88 off98272 00000004:00080000:3.0:1763334979.870211:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1044503639676ns, next at 1040839334561ns, rc = 0 00000040:00080000:3.0:1763334979.870229:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1161, 88 off99360 00000004:00080000:3.0:1763334979.870233:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1044503661222ns, next at 1040839994511ns, rc = 0 00000040:00080000:3.0:1763334979.870249:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1162, 88 off99448 00000004:00080000:3.0:1763334979.870253:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1044503680964ns, next at 1040839994511ns, rc = 0 00000040:00080000:3.0:1763334979.870317:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1152, 88 off98392 00000004:00080000:3.0:1763334979.870323:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1044503751029ns, next at 1040839334561ns, rc = 0 00000040:00080000:3.0:1763334979.870341:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1153, 88 off98480 00000004:00080000:3.0:1763334979.870345:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1044503773528ns, next at 1040839334561ns, rc = 0 00000040:00080000:3.0:1763334979.870362:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1163, 88 off99536 00000004:00080000:3.0:1763334979.870366:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1044503794534ns, next at 1040839994511ns, rc = 0 00000001:00080000:0.0:1763334979.905924:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939138 is committed 00000001:00080000:0.0:1763334979.905954:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939142 is committed 00000001:00080000:0.0:1763334979.905987:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939143 is committed 00000004:00080000:0.0:1763334979.905992:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 775 committed 00000004:00080000:0.0:1763334979.906014:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 763 committed 00000004:00080000:0.0:1763334979.906022:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 762 committed 00000004:00080000:0.0:1763334979.906024:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 774 committed 00000004:00080000:0.0:1763334979.906026:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 773 committed 00000004:00080000:0.0:1763334979.906028:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 761 committed 00000004:00080000:0.0:1763334979.906031:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 760 committed 00000004:00080000:0.0:1763334979.906033:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 772 committed 00000100:00100000:0.0:1763334979.906261:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701873280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334979.906356:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334979.906407:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763334979.906414:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701873664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334979.906438:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334979.906468:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701873408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334979.906491:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334979.906509:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1763334979.906515:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701873536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334979.906532:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334979.906565:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701873280 00000100:00100000:0.0:1763334979.906602:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701873280 00000100:00100000:0.0:1763334979.906658:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701873664 00000100:00100000:0.0:1763334979.906661:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701873664 00000100:00100000:0.0:1763334979.906679:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701873408 00000100:00100000:0.0:1763334979.906681:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701873408 00000100:00100000:0.0:1763334979.906696:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701873536 00000100:00100000:0.0:1763334979.906698:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701873536 00000100:00100000:0.0:1763334979.906721:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5013 00000100:00100000:0.0:1763334979.906731:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3292:x1848989701873280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334979.906962:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334979.906966:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334979.906983:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334979.906986:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334979.906988:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334979.907041:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3292:x1848989701873280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 311us (685us total) trans 21474838465 rc 0/0 00000100:00100000:0.0:1763334979.907049:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5013 00000100:00100000:0.0:1763334979.907066:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5014 00000100:00100000:0.0:1763334979.907071:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3292:x1848989701873664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334979.907153:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3292:x1848989701873664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 81us (714us total) trans 21474838466 rc 0/0 00000100:00100000:0.0:1763334979.907158:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5014 00000100:00100000:0.0:1763334979.907170:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5015 00000100:00100000:0.0:1763334979.907175:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701873408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334979.907247:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334979.907264:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.907267:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.907269:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.907271:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334979.907300:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701873408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (807us total) trans 21474838467 rc 0/0 00000100:00100000:0.0:1763334979.907306:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5015 00000100:00100000:0.0:1763334979.907318:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5016 00000100:00100000:0.0:1763334979.907325:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701873536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334979.907406:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334979.907409:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.907411:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334979.907413:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.907416:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334979.907442:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701873536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (908us total) trans 21474838468 rc 0/0 00000100:00100000:0.0:1763334979.907449:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5016 00000100:00100000:0.0:1763334979.907566:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701874048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334979.907626:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334979.907649:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1763334979.907655:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701873920:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334979.907673:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334979.907692:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701874048 00000100:00100000:0.0:1763334979.907697:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701874048 00000100:00100000:0.0:1763334979.907719:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701873920 00000100:00100000:0.0:1763334979.907722:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701873920 00000100:00100000:0.0:1763334979.907734:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5017 00000100:00100000:0.0:1763334979.907739:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3290:x1848989701874048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334979.907858:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3290:x1848989701874048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (232us total) trans 17179871204 rc 0/0 00000100:00100000:0.0:1763334979.907864:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5017 00000100:00100000:0.0:1763334979.907875:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5018 00000100:00100000:0.0:1763334979.907879:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3290:x1848989701873920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334979.907943:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334979.907946:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.907949:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.907951:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.907953:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334979.907972:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3290:x1848989701873920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (298us total) trans 17179871205 rc 0/0 00000100:00100000:0.0:1763334979.907977:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5018 00000100:00100000:0.0:1763334979.908008:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701874176:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334979.908032:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334979.908047:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1763334979.908051:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa77ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701873792:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334979.908065:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334979.908081:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701874176 00000100:00100000:0.0:1763334979.908083:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701874176 00000100:00100000:0.0:1763334979.908098:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701873792 00000100:00100000:0.0:1763334979.908100:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701873792 00000100:00100000:0.0:1763334979.908111:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5019 00000100:00100000:0.0:1763334979.908116:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3291:x1848989701874176:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334979.908194:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334979.908197:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.908199:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334979.908201:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.908204:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334979.908233:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3291:x1848989701874176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (199us total) trans 17179871206 rc 0/0 00000100:00100000:0.0:1763334979.908240:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5019 00000100:00100000:0.0:1763334979.908253:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5020 00000100:00100000:0.0:1763334979.908259:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3291:x1848989701873792:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334979.908332:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 217778 -> 217778 00002000:00010000:0.0:1763334979.908336:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.908338:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.908340:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.908343:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 283 -> 283 00000100:00100000:0.0:1763334979.908366:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3291:x1848989701873792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (299us total) trans 17179871207 rc 0/0 00000100:00100000:0.0:1763334979.908372:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5020 00000004:00080000:0.0:1763334979.908419:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77dc00/2, rc 0, transno 21474838468 00000100:00100000:0.0:1763334979.908427:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701873536:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334979.908436:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77e300/2, rc 0, transno 21474838467 00000100:00100000:0.0:1763334979.908440:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701873408:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334979.908455:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77ed80/2, rc 0, transno 17179871207 00000100:00100000:0.0:1763334979.908458:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701873792:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334979.908466:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad81ff100/2, rc 0, transno 17179871206 00000100:00100000:0.0:1763334979.908469:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701874176:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334979.908480:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77c000/2, rc 0, transno 17179871205 00000100:00100000:0.0:1763334979.908482:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701873920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334979.908489:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77d880/2, rc 0, transno 17179871204 00000100:00100000:0.0:1763334979.908491:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701874048:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334979.908505:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77ea00/2, rc 0, transno 21474838466 00000100:00100000:0.0:1763334979.908508:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701873664:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334979.908516:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa77f800/2, rc 0, transno 21474838465 00000100:00100000:0.0:1763334979.908519:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa77f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701873280:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1763334979.908838:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c686 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0370 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.908856:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66deb00) 00010000:00010000:3.0:1763334979.908859:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334979.908881:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c67f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0370 expref: 189 pid: 30972 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763334979.908902:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c686 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0370 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.908938:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66deb00) 00010000:00010000:3.0:1763334979.908940:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334979.908943:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:3.0:1763334979.909023:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694585856:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 39735us (39925us total) trans 8589939143 rc 0/0 00000100:00100000:3.0:1763334979.909031:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4939 00000100:00100000:2.0:1763334979.912670:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.912801:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694585984 00000100:00100000:1.0:1763334979.912816:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694585984 00000100:00100000:1.0:1763334979.912895:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5021 00000100:00100000:1.0:1763334979.912907:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+24:53644:x1848989694585984:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334979.912931:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334979.912961:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c68d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0377 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.913014:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c4b1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02d6 expref: 25 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334979.913024:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.913026:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.913032:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c68d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0377 expref: 25 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.913079:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c4b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02d6 expref: 25 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334979.913095:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c4b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02d6 expref: 25 pid: 6518 timeout: 1144 lvb_type: 1 00000100:00100000:1.0:1763334979.913110:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701874304:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334979.913224:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334979.919361:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701874304:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334979.919407:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c68d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0377 expref: 25 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.919438:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334979.919513:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+25:53644:x1848989694585984:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 6608us (6862us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334979.919524:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5021 00000100:00100000:2.0:1763334979.920493:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334979.920777:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694586112 00000100:00100000:3.0:1763334979.920791:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694586112 00010000:00010000:3.0:1763334979.920842:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c4b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02d6 expref: 25 pid: 6518 timeout: 1144 lvb_type: 1 00000100:00100000:3.0:1763334979.920894:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2628 00000100:00100000:3.0:1763334979.920907:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694586112:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334979.920925:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334979.920952:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c4b1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02d6 expref: 25 pid: 6518 timeout: 1144 lvb_type: 1 00010000:00010000:3.0:1763334979.920965:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c4b1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02d6 expref: 25 pid: 6518 timeout: 1144 lvb_type: 1 00010000:00010000:3.0:1763334979.921005:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c4b1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02d6 expref: 25 pid: 6518 timeout: 1144 lvb_type: 1 00010000:00010000:3.0:1763334979.921024:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334979.921026:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334979.921036:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c68d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0377 expref: 24 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.921046:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c68d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0377 expref: 24 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.921093:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c68d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0377 expref: 24 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334979.921109:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5501180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701874432:192.168.201.60@tcp:105: 00000100:00100000:3.0:1763334979.921194:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530d80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334979.924711:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334979.924810:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694586240 00000100:00100000:1.0:1763334979.924823:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694586240 00000100:00100000:0.0:1763334979.925008:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5501180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701874432:192.168.201.60@tcp:105: 00010000:00010000:0.0:1763334979.925040:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334979.925121:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694586112:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4215us (4635us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334979.925135:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2628 00000100:00100000:1.0:1763334979.925385:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5022 00000100:00100000:1.0:1763334979.925397:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+16:53644:x1848989694586240:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334979.925425:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334979.925455:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c694 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b037e expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.925493:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c4b8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02dd expref: 17 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334979.925502:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.925505:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334979.925509:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c694 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b037e expref: 17 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.925549:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c4b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02dd expref: 17 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334979.925564:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c4b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02dd expref: 17 pid: 21625 timeout: 1144 lvb_type: 1 00000100:00100000:1.0:1763334979.925638:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701874560:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334979.925724:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334979.929483:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:32241:1848989701874560:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334979.929540:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c694 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b037e expref: 17 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334979.929566:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334979.930134:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+17:53644:x1848989694586240:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 4735us (5432us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334979.930146:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5022 00000100:00100000:3.0:1763334979.931009:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.931180:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694586368 00000100:00100000:0.0:1763334979.931193:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694586368 00010000:00010000:0.0:1763334979.931238:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c4b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02dd expref: 17 pid: 21625 timeout: 1144 lvb_type: 1 00000100:00100000:0.0:1763334979.931546:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2629 00000100:00100000:0.0:1763334979.931559:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694586368:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334979.931602:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334979.931635:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c4b8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02dd expref: 17 pid: 21625 timeout: 1144 lvb_type: 1 00010000:00010000:0.0:1763334979.931652:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c4b8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02dd expref: 17 pid: 21625 timeout: 1144 lvb_type: 1 00010000:00010000:0.0:1763334979.931684:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c4b8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02dd expref: 17 pid: 21625 timeout: 1144 lvb_type: 1 00010000:00010000:0.0:1763334979.931701:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334979.931703:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334979.931712:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c694 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b037e expref: 16 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.931725:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b037e expref: 16 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334979.931777:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b037e expref: 16 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334979.931794:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701874688:192.168.201.60@tcp:105: 00000100:00100000:0.0:1763334979.931890:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334979.935851:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701874688:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334979.935895:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334979.936333:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694586368:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4773us (5333us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334979.936351:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2629 00000100:00100000:1.0:1763334979.937442:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334979.937877:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694586496 00000100:00100000:3.0:1763334979.937891:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694586496 00000100:00100000:3.0:1763334979.937963:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5023 00000100:00100000:3.0:1763334979.937975:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+24:53644:x1848989694586496:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334979.938010:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334979.938036:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c69b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0385 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.938074:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c4bf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02e4 expref: 25 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334979.938083:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334979.938086:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334979.938090:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c69b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0385 expref: 25 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.938138:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c4bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02e4 expref: 25 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334979.938154:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c4bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02e4 expref: 25 pid: 21625 timeout: 1144 lvb_type: 1 00000100:00100000:3.0:1763334979.938172:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5502680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701874816:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334979.938286:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530d80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334979.946229:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5502680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701874816:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334979.946296:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c69b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0385 expref: 25 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.946322:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:3.0:1763334979.946402:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+25:53644:x1848989694586496:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 8428us (8965us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334979.946413:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5023 00000100:00100000:0.0:1763334979.955770:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334979.955818:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694586624 00000100:00100000:3.0:1763334979.955832:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694586624 00010000:00010000:3.0:1763334979.955889:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c4bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02e4 expref: 25 pid: 21625 timeout: 1144 lvb_type: 1 00000100:00100000:3.0:1763334979.955948:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2630 00000100:00100000:3.0:1763334979.955962:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694586624:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334979.955984:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334979.956028:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c4bf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02e4 expref: 25 pid: 21625 timeout: 1144 lvb_type: 1 00010000:00010000:3.0:1763334979.956046:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c4bf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02e4 expref: 25 pid: 21625 timeout: 1144 lvb_type: 1 00010000:00010000:3.0:1763334979.956084:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c4bf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02e4 expref: 25 pid: 21625 timeout: 1144 lvb_type: 1 00010000:00010000:3.0:1763334979.956111:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334979.956114:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334979.956121:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c69b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0385 expref: 24 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.956134:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c69b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0385 expref: 24 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.956190:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c69b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0385 expref: 24 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334979.956207:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5502680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701874944:192.168.201.60@tcp:105: 00000100:00100000:3.0:1763334979.956326:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334979.964148:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334979.964252:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694586752 00000100:00100000:0.0:1763334979.964267:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694586752 00002000:00010000:0.0:1763334979.964329:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (60901->18446744073709551615) 00002000:00100000:0.0:1763334979.964334:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d7800 with x1848989694586752 ext(60901->18446744073709551615) 00002000:00010000:0.0:1763334979.964351:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d7800. 00000100:00100000:0.0:1763334979.964394:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1872 00000100:00100000:0.0:1763334979.964405:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694586752:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334979.965095:0:25999:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 217778 -> 60901 00002000:00010000:0.0:1763334979.965101:0:25999:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334979 -> 1763334980 00002000:00010000:0.0:1763334979.965104:0:25999:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334979.965107:0:25999:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334979 -> 1763334980 00002000:00010000:0.0:1763334979.965110:0:25999:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 283 -> 283 00000100:00100000:0.0:1763334979.965194:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694586752:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 788us (1063us total) trans 17179871208 rc 0/0 00000100:00100000:0.0:1763334979.965203:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1872 00002000:00010000:0.0:1763334979.965210:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (60901->18446744073709551615) 00002000:00100000:0.0:1763334979.965212:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d7800 with x1848989694586752 ext(60901->18446744073709551615) 00002000:00010000:0.0:1763334979.965218:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d7800. 00000100:00100000:3.0:1763334979.965811:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5502680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701874944:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334979.965841:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334979.965887:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694586624:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 9929us (10132us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334979.965898:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2630 00000100:00100000:2.0:1763334979.965954:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.966054:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.966081:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694587008 00000100:00100000:2.0:1763334979.966088:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694587008 00002000:00010000:2.0:1763334979.966119:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00000100:00100000:3.0:1763334979.966120:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694586880 00002000:00100000:2.0:1763334979.966124:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809e680 with x1848989694587008 ext(0->18446744073709551615) 00000100:00100000:3.0:1763334979.966125:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694586880 00002000:00010000:2.0:1763334979.966133:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad809e680. 00002000:00010000:3.0:1763334979.966138:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:3.0:1763334979.966141:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809dc00 with x1848989694586880 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334979.966149:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ad809dc00. 00000100:00100000:2.0:1763334979.966163:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1873 00000100:00100000:3.0:1763334979.966168:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1874 00000100:00100000:2.0:1763334979.966172:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694587008:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:3.0:1763334979.966174:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694586880:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334979.966343:0:25999:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334979.966343:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334979.966347:0:25999:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334979 -> 1763334980 00002000:00010000:2.0:1763334979.966347:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334979 -> 1763334980 00002000:00010000:3.0:1763334979.966350:0:25999:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334979.966350:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334979.966353:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334979 -> 1763334980 00002000:00010000:3.0:1763334979.966354:0:25999:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334979 -> 1763334980 00002000:00010000:3.0:1763334979.966357:0:25999:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1763334979.966357:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334979.966384:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694587008:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 213us (432us total) trans 17179871209 rc 0/0 00000100:00100000:2.0:1763334979.966391:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1873 00002000:00010000:2.0:1763334979.966394:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:2.0:1763334979.966397:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809e680 with x1848989694587008 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334979.966402:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad809e680. 00000100:00100000:2.0:1763334979.967981:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694586880:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 1791us (1911us total) trans 21474838469 rc 0/0 00000100:00100000:2.0:1763334979.968008:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1874 00002000:00010000:2.0:1763334979.968017:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:2.0:1763334979.968020:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809dc00 with x1848989694586880 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334979.968031:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ad809dc00. 00000100:00100000:0.0:1763334979.973946:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334979.974052:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694587136 00000100:00100000:3.0:1763334979.974066:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694587136 00000100:00100000:3.0:1763334979.974149:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4940 00000100:00100000:3.0:1763334979.974162:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694587136:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334979.974198:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334979.974230:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c6a2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b038c expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.974350:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c6a9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334979.974368:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334979.974383:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334979.974417:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 217778 00000004:00200000:3.0:1763334979.974422:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334979.974444:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334979.974476:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c6a2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b038c expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.974504:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b038c expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.974513:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66deb00) 00010000:00010000:3.0:1763334979.974517:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334979.974521:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:3.0:1763334979.974671:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694587136:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 511us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334979.974680:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4940 00000100:00100000:1.0:1763334979.978059:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334979.979264:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694587392 00000100:00100000:2.0:1763334979.979284:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694587392 00000100:00100000:2.0:1763334979.979380:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4941 00000100:00100000:2.0:1763334979.979392:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694587392:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334979.979468:0:32232:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1763334979.979507:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c6a9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b038c expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.979533:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c686 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0370 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334979.979546:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66deb00) 00010000:00010000:2.0:1763334979.979558:0:32232:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334979.979990:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6b0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.980021:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6b0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.980033:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6b0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000001:00080000:2.0:1763334979.980110:0:32232:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939144 00000004:00010000:2.0:1763334979.980143:0:32232:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b408c3e0 reply state 0000000067a4f7c2 transno 8589939145 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6b0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:2.0:1763334979.980153:0:32232:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334979.980291:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694587392:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 899us (2247us total) trans 8589939145 rc 0/0 00000100:00100000:2.0:1763334979.980300:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4941 00000020:00080000:2.0:1763334979.980306:0:32232:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1763334979.988607:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6b0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.988630:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6b0 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.988638:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6b0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.988644:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334979.988650:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6b0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.988658:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6b0 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.988679:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334979.988682:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334979.988688:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6b0 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334979.988694:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6b0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00000100:00100000:1.0:1763334979.996417:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334979.996507:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694587520 00000100:00100000:3.0:1763334979.996523:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694587520 00000100:00100000:3.0:1763334979.996621:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4942 00000100:00100000:3.0:1763334979.996634:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694587520:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334979.996667:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334979.996702:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c6b7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0393 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.996785:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c6b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0393 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.996802:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c6b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0393 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334979.996826:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de200) 00010000:00010000:3.0:1763334979.996832:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334979.996837:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:3.0:1763334979.996919:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694587520:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 284us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334979.996927:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4942 00000100:00100000:1.0:1763334980.002784:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.002836:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.002871:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.002928:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694587648 00000100:00100000:0.0:1763334980.002943:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694587648 00000100:00100000:3.0:1763334980.002962:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694587776 00000100:00100000:3.0:1763334980.002968:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694587776 00002000:00010000:3.0:1763334980.003012:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00010000:0.0:1763334980.003012:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (158406->18446744073709551615) 00002000:00100000:0.0:1763334980.003021:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d5f80 with x1848989694587648 ext(158406->18446744073709551615) 00002000:00100000:3.0:1763334980.003022:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d4e00 with x1848989694587776 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334980.003042:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aee9d4e00. 00002000:00010000:0.0:1763334980.003042:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d5f80. 00000100:00100000:0.0:1763334980.003096:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694587904 00000100:00100000:0.0:1763334980.003101:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694587904 00002000:00010000:0.0:1763334980.003116:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334980.003126:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d5880 with x1848989694587904 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334980.003133:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d5880. 00000100:00100000:3.0:1763334980.003152:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1875 00000100:00100000:0.0:1763334980.003162:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1876 00000100:00100000:3.0:1763334980.003168:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694587648:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:0.0:1763334980.003176:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694587776:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334980.003527:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 60901 -> 158406 00002000:00010000:0.0:1763334980.003527:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334980.003535:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334980.003536:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334980.003544:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334979 -> 1763334979 00002000:00010000:0.0:1763334980.003544:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334980.003549:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334980.003550:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334980.003554:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 283 -> 283 00002000:00010000:0.0:1763334980.003555:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334980.003676:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694587648:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 511us (906us total) trans 17179871210 rc 0/0 00000100:00100000:3.0:1763334980.003686:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1875 00002000:00010000:3.0:1763334980.003691:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (158406->18446744073709551615) 00002000:00100000:3.0:1763334980.003694:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d5f80 with x1848989694587648 ext(158406->18446744073709551615) 00000100:00100000:1.0:1763334980.003699:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1877 00002000:00010000:3.0:1763334980.003702:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d5f80. 00000100:00100000:1.0:1763334980.003714:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694587904:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334980.003837:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334980.003841:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334980.003843:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334979 -> 1763334979 00002000:00010000:1.0:1763334980.003846:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334980.003849:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334980.003953:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694587776:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 781us (1115us total) trans 21474838470 rc 0/0 00000100:00100000:0.0:1763334980.003961:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1876 00002000:00010000:0.0:1763334980.003965:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334980.003967:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d4e00 with x1848989694587776 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334980.003972:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aee9d4e00. 00000100:00100000:1.0:1763334980.004451:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694587904:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 738us (1576us total) trans 17179871211 rc 0/0 00000100:00100000:1.0:1763334980.004461:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1877 00002000:00010000:1.0:1763334980.004466:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763334980.004469:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d5880 with x1848989694587904 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334980.004474:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d5880. 00000100:00100000:1.0:1763334980.011426:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.011567:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694588032 00000100:00100000:2.0:1763334980.011601:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694588032 00002000:00100000:2.0:1763334980.011670:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (122880->126975) req@ffff9a5aee9d7480 x1848989694588032/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:26/0 lens 488/0 e 0 to 0 dl 1763334991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334980.011685:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d7480 with x1848989694588032 ext(122880->126975) 00002000:00010000:2.0:1763334980.011693:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d7480 00000100:00100000:0.0:1763334980.012284:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1878 00000100:00100000:0.0:1763334980.012302:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694588032:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:0.0:1763334980.012686:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694588032:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 389us (1272us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334980.012695:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1878 00002000:00100000:0.0:1763334980.012705:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (122880->126975) req@ffff9a5aee9d7480 x1848989694588032/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:26/0 lens 488/4536 e 0 to 0 dl 1763334991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334980.012715:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d7480 with x1848989694588032 ext(122880->126975) 00002000:00010000:0.0:1763334980.012720:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d7480 00000100:00100000:2.0:1763334980.016926:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.017627:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694588160 00000100:00100000:1.0:1763334980.017643:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694588160 00002000:00100000:1.0:1763334980.017720:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (126976->131071) req@ffff9a5ad809ea00 x1848989694588160/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:26/0 lens 488/0 e 0 to 0 dl 1763334991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334980.017733:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809ea00 with x1848989694588160 ext(126976->131071) 00002000:00010000:1.0:1763334980.017741:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad809ea00 00000100:00100000:1.0:1763334980.018003:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1879 00000100:00100000:1.0:1763334980.018015:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694588160:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:1.0:1763334980.018739:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694588160:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 721us (1822us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763334980.018751:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1879 00002000:00100000:1.0:1763334980.018760:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (126976->131071) req@ffff9a5ad809ea00 x1848989694588160/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:26/0 lens 488/4536 e 0 to 0 dl 1763334991 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334980.018771:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809ea00 with x1848989694588160 ext(126976->131071) 00002000:00010000:1.0:1763334980.018776:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad809ea00 00000100:00100000:1.0:1763334980.022979:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.023200:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694588288 00000100:00100000:2.0:1763334980.023214:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694588288 00002000:00100000:2.0:1763334980.023284:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (102400->159743) req@ffff9a5aee9d7100 x1848989694588288/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:26/0 lens 504/0 e 0 to 0 dl 1763334991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334980.023297:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d7100 with x1848989694588288 ext(102400->159743) 00002000:00010000:2.0:1763334980.023305:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d7100 00000100:00100000:2.0:1763334980.023554:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1880 00000100:00100000:2.0:1763334980.023566:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694588288:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:1.0:1763334980.027025:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694588288:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 3444us (4045us total) trans 0 rc 49152/49152 00000100:00100000:1.0:1763334980.027043:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1880 00002000:00100000:1.0:1763334980.027057:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (102400->159743) req@ffff9a5aee9d7100 x1848989694588288/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:26/0 lens 504/440 e 0 to 0 dl 1763334991 ref 1 fl Complete:/600/0 rc 49152/49152 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334980.027068:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d7100 with x1848989694588288 ext(102400->159743) 00002000:00010000:1.0:1763334980.027075:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d7100 00000100:00100000:1.0:1763334980.031428:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.031664:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694588416 00000100:00100000:2.0:1763334980.031679:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694588416 00002000:00100000:2.0:1763334980.031752:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (122880->158405) req@ffff9a5aee9d5500 x1848989694588416/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:26/0 lens 488/0 e 0 to 0 dl 1763334991 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334980.031765:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d5500 with x1848989694588416 ext(122880->158405) 00002000:00010000:2.0:1763334980.031773:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d5500 00000100:00100000:2.0:1763334980.032736:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1881 00000100:00100000:2.0:1763334980.032757:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694588416:12345-192.168.201.60@tcp:4:lfs.0 00000100:00100000:2.0:1763334980.036211:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694588416:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 3442us (4778us total) trans 17179871212 rc 0/0 00000100:00100000:2.0:1763334980.036230:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1881 00002000:00100000:2.0:1763334980.036246:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (122880->158405) req@ffff9a5aee9d5500 x1848989694588416/t17179871212(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:26/0 lens 488/448 e 0 to 0 dl 1763334991 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334980.036259:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee9d5500 with x1848989694588416 ext(122880->158405) 00002000:00010000:2.0:1763334980.036267:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee9d5500 00000100:00100000:1.0:1763334980.038969:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.039148:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694588544 00000100:00100000:3.0:1763334980.039161:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694588544 00000100:00100000:3.0:1763334980.039332:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5024 00000100:00100000:3.0:1763334980.039345:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694588544:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:3.0:1763334980.080606:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871208 is committed 00000100:00100000:2.0:1763334980.080619:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694588544:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 41231us (41620us total) trans 0 rc 0/0 00000001:00080000:3.0:1763334980.080627:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871207 is committed 00000100:00100000:2.0:1763334980.080637:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5024 00000001:00080000:3.0:1763334980.080649:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871211 is committed 00000001:00080000:3.0:1763334980.080679:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871212 is committed 00000100:00100000:1.0:1763334980.084043:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.085292:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694588672 00000100:00100000:3.0:1763334980.085315:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694588672 00000100:00100000:3.0:1763334980.085412:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4943 00000100:00100000:3.0:1763334980.085426:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694588672:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334980.085454:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334980.085487:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c6be lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b039a expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.085662:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c6c5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334980.085680:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334980.085693:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334980.085730:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 158406 00000004:00200000:3.0:1763334980.085736:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334980.085761:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c6c5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334980.085797:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c6be lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b039a expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.085822:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c6c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b039a expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.085831:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de200) 00010000:00010000:3.0:1763334980.085836:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334980.085840:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:3.0:1763334980.085935:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694588672:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 512us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334980.085945:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4943 00000100:00100000:1.0:1763334980.094141:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.095337:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694588928 00000100:00100000:2.0:1763334980.095354:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694588928 00000100:00100000:0.0:1763334980.095868:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1800 00000100:00100000:1.0:1763334980.096044:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694588928:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:1.0:1763334980.096856:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37a9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53644:x1848989694588928:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 972us (2726us total) trans 8589939146 rc 0/0 00000100:00100000:1.0:1763334980.096867:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1800 00000100:00100000:1.0:1763334980.113210:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.113367:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694589184 00000100:00100000:2.0:1763334980.113382:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694589184 00000100:00100000:2.0:1763334980.113455:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4944 00000100:00100000:2.0:1763334980.113466:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53654:x1848989694589184:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334980.113499:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334980.113529:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c6cc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03a1 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.113677:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c6d3 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.113700:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c6d3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.113713:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c6d3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.113730:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c6da lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.113739:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c6da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.113745:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c6da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.113930:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6e1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.113941:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.113948:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:2.0:1763334980.113959:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 158406 00010000:00010000:2.0:1763334980.114404:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c6d3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114413:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c6d3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114420:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c6d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114426:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334980.114431:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c6d3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114439:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c6d3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114452:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334980.114456:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334980.114461:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c6d3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114468:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c6d3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114483:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c6da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114489:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c6da lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114495:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c6da lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114500:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334980.114502:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c6da lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114508:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c6da lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114515:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334980.114518:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334980.114520:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c6da lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114526:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c6da lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:2.0:1763334980.114631:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c6cc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03a1 expref: 195 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.114653:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6e1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03a1 expref: 194 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.114660:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de200) 00010000:00010000:2.0:1763334980.114663:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334980.114666:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334980.114750:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53654:x1848989694589184:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1284us (1552us total) trans 8589939147 rc 0/0 00000100:00100000:2.0:1763334980.114759:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4944 00000100:00100000:2.0:1763334980.119812:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.119853:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.119933:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694589568 00000100:00100000:0.0:1763334980.119955:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694589568 00000100:00100000:0.0:1763334980.120036:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4945 00000100:00100000:0.0:1763334980.120047:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53654:x1848989694589568:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334980.120078:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334980.120103:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c6ef lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03a8 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334980.120606:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694589312 00000100:00100000:3.0:1763334980.120614:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694589312 00000100:00100000:3.0:1763334980.120661:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 406 00000100:00100000:3.0:1763334980.120670:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2360:x1848989694589312:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334980.120681:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334980.120705:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c6e1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03a1 expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.120726:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de200) 00010000:00010000:3.0:1763334980.120731:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334980.120810:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2360:x1848989694589312:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 142us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334980.120818:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 406 00010000:00010000:0.0:1763334980.121509:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c6f6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.121526:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.121537:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334980.121548:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b1:0x0]: returning size 0 00010000:00010000:0.0:1763334980.121627:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c6ef lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03a8 expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.121643:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03a8 expref: 195 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.121651:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b1:0x0].0x0 (ffff9a5ac7d60d00) 00010000:00010000:0.0:1763334980.121653:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334980.121656:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:0.0:1763334980.121701:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53654:x1848989694589568:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1656us (1846us total) trans 8589939148 rc 0/0 00000100:00100000:0.0:1763334980.121709:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4945 00000100:00100000:2.0:1763334980.127799:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.127876:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694589824 00000100:00100000:0.0:1763334980.127890:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694589824 00000100:00100000:0.0:1763334980.127970:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4946 00000100:00100000:0.0:1763334980.127981:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53654:x1848989694589824:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334980.128023:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334980.128050:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c704 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03af expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.128180:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.128197:0:32232:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c6f6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03a8 expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.128208:0:32232:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.128251:0:32232:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03a8 expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.128267:0:32232:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c6f6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03a8 expref: 196 pid: 32232 timeout: 1144 lvb_type: 0 00000100:00100000:0.0:1763334980.128284:0:32232:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701875072:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334980.128398:0:32232:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac6e7c240 going to sleep for 11 seconds 00000100:00100000:1.0:1763334980.133744:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.133962:0:32232:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fc000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:32232:1848989701875072:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334980.134010:0:32232:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000100:00100000:3.0:1763334980.134174:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694589952 00000100:00100000:3.0:1763334980.134186:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694589952 00010000:00010000:3.0:1763334980.134234:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c6f6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03a8 expref: 197 pid: 32232 timeout: 1144 lvb_type: 0 00000100:00100000:3.0:1763334980.134271:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2631 00000100:00100000:3.0:1763334980.134283:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694589952:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334980.134301:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334980.134308:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c6f6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03a8 expref: 197 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:3.0:1763334980.134322:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03a8 expref: 197 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:3.0:1763334980.134350:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c6f6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03a8 expref: 197 pid: 32232 timeout: 1144 lvb_type: 0 00010000:00010000:3.0:1763334980.134368:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b1:0x0].0x0 (ffff9a5ac7d60d00) 00010000:00010000:3.0:1763334980.134374:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334980.134384:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334980.134393:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 32232 initiator: MDT0 00010000:00010000:3.0:1763334980.134425:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334980.134505:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694589952:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 224us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334980.134514:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2631 00010000:00010000:0.0:1763334980.135154:0:32232:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.135165:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334980.135196:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b1:0x0]: returning size 0 00000004:00080000:0.0:1763334980.136036:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24f:0x0], index 1: 0 00000004:00080000:0.0:1763334980.136056:0:32232:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24b:0x0], index 0: 0 00010000:00010000:0.0:1763334980.136263:0:32232:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.136275:0:32232:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.136283:0:32232:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.136290:0:32232:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334980.136296:0:32232:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.136305:0:32232:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.136322:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b1:0x0].0x0 (ffff9a5ac7d60d00) 00010000:00010000:0.0:1763334980.136326:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334980.136331:0:32232:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.136338:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c70b lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.136415:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c704 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03af expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.136427:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:0.0:1763334980.136430:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334980.136434:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c704 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03af expref: 196 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.136442:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334980.137311:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53654:x1848989694589824:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 9323us (9518us total) trans 8589939149 rc 301/301 00000100:00100000:0.0:1763334980.137325:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4946 00000100:00100000:1.0:1763334980.139335:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.139902:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694590208 00000100:00100000:2.0:1763334980.139916:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694590208 00000100:00100000:2.0:1763334980.139980:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1801 00000100:00100000:2.0:1763334980.140000:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53654:x1848989694590208:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334980.140473:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53654:x1848989694590208:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 481us (1147us total) trans 8589939150 rc 0/0 00000100:00100000:2.0:1763334980.140482:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1801 00000100:00100000:1.0:1763334980.144210:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.144407:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694590336 00000100:00100000:0.0:1763334980.144422:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694590336 00000100:00100000:0.0:1763334980.144501:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4947 00000100:00100000:0.0:1763334980.144514:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53654:x1848989694590336:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334980.144547:0:32232:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334980.144609:0:32232:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c719 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03b6 expref: -99 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.144707:0:32232:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c720 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.144723:0:32232:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c720 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.144736:0:32232:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c720 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00000004:00200000:0.0:1763334980.144782:0:32232:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b1:0x0]: returning size 0 00000004:00200000:0.0:1763334980.144787:0:32232:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334980.144806:0:32232:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c720 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 32232 initiator: MDT0 00010000:00010000:0.0:1763334980.144844:0:32232:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c719 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03b6 expref: 198 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.144863:0:32232:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c720 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03b6 expref: 197 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.144872:0:32232:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b1:0x0].0x0 (ffff9a5ac7d60d00) 00010000:00010000:0.0:1763334980.144875:0:32232:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763334980.144879:0:32232:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334980.144941:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53654:x1848989694590336:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 430us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.144948:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4947 00000100:00100000:3.0:1763334980.147837:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.148304:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.149030:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694590464 00000100:00100000:2.0:1763334980.149045:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694590464 00000100:00100000:1.0:1763334980.149190:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694590592 00000100:00100000:1.0:1763334980.149195:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694590592 00000100:00100000:1.0:1763334980.149383:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5025 00000100:00100000:1.0:1763334980.149397:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694590464:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334980.149421:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334980.149451:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c727 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03bd expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334980.149489:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334980.149514:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.149517:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.149529:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c727 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03bd expref: 21 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334980.149549:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c727 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03bd expref: 21 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334980.149566:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:1.0:1763334980.149672:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2362:x1848989694590464:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 277us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.149684:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5025 00000100:00100000:1.0:1763334980.149710:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5026 00000100:00100000:1.0:1763334980.149719:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2362:x1848989694590592:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334980.149728:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334980.149742:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c72e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03c4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334980.149760:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334980.149769:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.149771:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.149776:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03c4 expref: 19 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334980.149787:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03c4 expref: 19 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334980.149796:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334980.149817:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694590592:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 100us (1514us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.149824:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5026 00000100:00100000:1.0:1763334980.153036:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.153422:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694590848 00000100:00100000:2.0:1763334980.153436:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694590848 00000100:00100000:2.0:1763334980.155434:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4948 00000100:00100000:2.0:1763334980.155468:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53654:x1848989694590848:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334980.155500:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334980.155532:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c735 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03cb expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.155692:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c73c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.155710:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c73c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.155724:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c73c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334980.155740:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 158406 00010000:00010000:2.0:1763334980.155902:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849c735 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03cb expref: 200 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.155926:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c73c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03cb expref: 199 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.155936:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de200) 00010000:00010000:2.0:1763334980.155939:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334980.155945:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431a00, rc 0) 00000100:00100000:2.0:1763334980.156376:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53654:x1848989694590848:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 922us (3351us total) trans 8589939151 rc 0/0 00000100:00100000:2.0:1763334980.156387:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4948 00000100:00100000:3.0:1763334980.160541:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.160770:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694590976 00000100:00100000:1.0:1763334980.160783:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694590976 00000100:00100000:0.0:1763334980.161771:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5027 00000100:00100000:0.0:1763334980.161794:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694590976:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:0.0:1763334980.161866:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.161892:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c68d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0377 expref: 21 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.161902:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334980.161904:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334980.161909:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.161956:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c68d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0377 expref: 21 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.161972:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c68d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0377 expref: 21 pid: 32241 timeout: 1144 lvb_type: 0 00000100:00100000:0.0:1763334980.162005:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad81fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701875200:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334980.162135:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3f77900 going to sleep for 11 seconds 00000100:00100000:3.0:1763334980.163604:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.163763:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.163809:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694591104 00000100:00100000:3.0:1763334980.163819:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694591104 00000100:00100000:3.0:1763334980.163877:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694591232 00000100:00100000:3.0:1763334980.163880:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694591232 00000100:00100000:3.0:1763334980.163909:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5028 00000100:00100000:3.0:1763334980.163919:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694591104:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:3.0:1763334980.163967:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.164017:0:32239:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c694 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b037e expref: 19 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.164027:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334980.164029:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334980.164035:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.164074:0:32239:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b037e expref: 19 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.164088:0:32239:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c694 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b037e expref: 19 pid: 32241 timeout: 1144 lvb_type: 0 00000100:00100000:3.0:1763334980.164105:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5501500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701875328:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334980.164206:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5029 00000100:00100000:3.0:1763334980.164216:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac382b180 going to sleep for 11 seconds 00000100:00100000:2.0:1763334980.164221:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694591232:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334980.164248:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.164263:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c69b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0385 expref: 22 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.164271:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334980.164273:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334980.164275:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.164296:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c69b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0385 expref: 22 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.164307:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c69b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0385 expref: 22 pid: 32241 timeout: 1144 lvb_type: 0 00000100:00100000:2.0:1763334980.164319:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701875456:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334980.164354:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee780 going to sleep for 11 seconds 00000100:00100000:2.0:1763334980.169695:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701875456:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334980.169738:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334980.170239:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.170282:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.170332:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694591488 00000100:00100000:3.0:1763334980.170613:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5501500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701875328:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334980.170634:0:32239:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334980.170709:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad81fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701875200:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334980.170727:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334980.170926:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694591488 00010000:00010000:1.0:1763334980.170983:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c69b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0385 expref: 23 pid: 32241 timeout: 1144 lvb_type: 0 00000100:00100000:2.0:1763334980.171058:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694591360 00000100:00100000:2.0:1763334980.171064:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694591360 00000100:00100000:1.0:1763334980.171072:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2632 00010000:00010000:2.0:1763334980.171088:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c68d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0377 expref: 24 pid: 32241 timeout: 1144 lvb_type: 0 00000100:00100000:1.0:1763334980.171088:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694591488:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334980.171114:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1763334980.171132:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2633 00000100:00100000:2.0:1763334980.171142:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694591360:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334980.171145:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c69b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0385 expref: 24 pid: 32241 timeout: 1144 lvb_type: 0 00010000:00010000:2.0:1763334980.171155:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334980.171162:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c69b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0385 expref: 24 pid: 32241 timeout: 1144 lvb_type: 0 00010000:00010000:2.0:1763334980.171172:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c68d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0377 expref: 24 pid: 32241 timeout: 1144 lvb_type: 0 00010000:00010000:2.0:1763334980.171185:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c68d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0377 expref: 24 pid: 32241 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334980.171193:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c69b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0385 expref: 24 pid: 32241 timeout: 1144 lvb_type: 0 00010000:00010000:2.0:1763334980.171204:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c68d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0377 expref: 24 pid: 32241 timeout: 1144 lvb_type: 0 00010000:00010000:2.0:1763334980.171231:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.171231:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.171235:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.171237:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.171242:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.171244:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.171268:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.171269:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.171314:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334980.171335:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.171347:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.171376:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334980.171383:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694591360:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 243us (1100us total) trans 0 rc 0/0 00010000:00010000:3.0:1763334980.171385:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334980.171392:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2633 00010000:00010000:3.0:1763334980.171394:0:25383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.171401:0:25383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334980.171406:0:25383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.171415:0:25383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.171431:0:25383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.171437:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334980.171440:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849c74a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334980.171452:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.171461:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694591488:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 379us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.171470:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2632 00000100:00100000:1.0:1763334980.171483:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694591616 00000100:00100000:1.0:1763334980.171492:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694591616 00010000:00010000:1.0:1763334980.171506:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c694 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b037e expref: 20 pid: 32241 timeout: 1144 lvb_type: 0 00000100:00100000:1.0:1763334980.171533:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2634 00000100:00100000:1.0:1763334980.171540:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694591616:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334980.171547:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334980.171562:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c694 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b037e expref: 20 pid: 32241 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334980.171593:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c694 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b037e expref: 20 pid: 32241 timeout: 1144 lvb_type: 0 00010000:00010000:1.0:1763334980.171615:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c694 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b037e expref: 20 pid: 32241 timeout: 1144 lvb_type: 0 00000100:00100000:2.0:1763334980.171621:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694590976:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 9835us (11147us total) trans 0 rc 0/0 00010000:00010000:1.0:1763334980.171634:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1763334980.171636:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5027 00010000:00010000:1.0:1763334980.171639:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.171645:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.171653:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.171724:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334980.171762:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694591616:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 221us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.171769:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2634 00010000:00010000:1.0:1763334980.171825:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.171834:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.171852:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.171859:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.171870:0:21625:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.171876:0:21625:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334980.171879:0:21625:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.171886:0:21625:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.171895:0:21625:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.171901:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c758 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334980.171953:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694591232:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 7738us (8191us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.171960:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5029 00010000:00010000:0.0:1763334980.172114:0:32239:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.172123:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.172142:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.172149:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.172156:0:32239:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.172162:0:32239:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334980.172165:0:32239:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.172178:0:32239:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.172190:0:32239:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.172197:0:32239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c751 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334980.172249:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694591104:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 8331us (8657us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.172256:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5028 00000100:00100000:1.0:1763334980.180121:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.181355:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694591744 00000100:00100000:0.0:1763334980.181373:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694591744 00000100:00100000:0.0:1763334980.181463:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5030 00000100:00100000:0.0:1763334980.181476:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694591744:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334980.181499:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334980.181529:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c75f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03d2 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334980.181562:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 158406, mtime: 0x691a5b44, atime: 0x691a5b43, ctime: 0x691a5b44, blocks: 0x79 00010000:00010000:0.0:1763334980.181616:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334980.181619:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334980.181633:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c75f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d2 expref: 20 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334980.181661:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c75f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d2 expref: 20 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334980.181679:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:0.0:1763334980.181771:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694591744:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 298us (1665us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.181779:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5030 00000100:00100000:1.0:1763334980.183050:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.183721:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.183798:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694591872 00000100:00100000:2.0:1763334980.183812:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694591872 00000100:00100000:2.0:1763334980.183875:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5031 00000100:00100000:2.0:1763334980.183885:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2362:x1848989694591872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334980.183907:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334980.183935:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c766 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03d9 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334980.183963:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x248:0x0] initial LVB size: 0, mtime: 0x691a5b44, atime: 0x691a5b43, ctime: 0x691a5b44, blocks: 0x3 00010000:00010000:2.0:1763334980.183986:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.183997:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.184011:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c766 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d9 expref: 19 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.184029:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c766 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d9 expref: 19 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.184043:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430800, rc 0) 00000100:00100000:2.0:1763334980.184117:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694591872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 232us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.184124:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5031 00000100:00100000:0.0:1763334980.184558:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694592000 00000100:00100000:0.0:1763334980.184564:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694592000 00000100:00100000:0.0:1763334980.184622:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5032 00000100:00100000:0.0:1763334980.184631:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694592000:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334980.184641:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334980.184656:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c76d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03e0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334980.184676:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x691a5b44, atime: 0x691a5b43, ctime: 0x691a5b44, blocks: 0x3 00010000:00010000:0.0:1763334980.184688:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334980.184690:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334980.184695:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c76d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e0 expref: 21 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334980.184709:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c76d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e0 expref: 21 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334980.184719:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334980.184746:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2362:x1848989694592000:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 117us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.184753:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5032 00000100:00100000:1.0:1763334980.184894:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.185039:0:29623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694592128 00000100:00100000:0.0:1763334980.185043:0:29623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694592128 00000100:00100000:0.0:1763334980.185114:0:29623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 142 00000100:00100000:0.0:1763334980.185122:0:29623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1264d40-158f-4e44-9f7a-49909c525321+9:2361:x1848989694592128:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1763334980.185418:0:29623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9bfd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b1264d40-158f-4e44-9f7a-49909c525321+9:2361:x1848989694592128:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 295us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.185426:0:29623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 142 00000100:00100000:1.0:1763334980.222238:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.222431:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694592256 00000100:00100000:2.0:1763334980.222445:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694592256 00000100:00100000:2.0:1763334980.222543:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1882 00000100:00100000:2.0:1763334980.222555:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694592256:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334980.222638:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849c774 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.222664:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.222667:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.222674:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849c774 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.222690:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849c774 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.226292:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849c774 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.226319:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849c774 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.226328:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849c774 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.226336:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334980.226341:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849c774 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.226351:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849c774 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.226376:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849c774 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.226385:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849c774 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334980.226509:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694592256:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 3948us (4279us total) trans 0 rc 158406/158406 00000100:00100000:2.0:1763334980.226521:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1882 00000100:00100000:1.0:1763334980.229656:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.229719:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694592384 00000100:00100000:2.0:1763334980.229742:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694592384 00000100:00100000:2.0:1763334980.229843:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1883 00000100:00100000:2.0:1763334980.229857:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2362:x1848989694592384:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:2.0:1763334980.229911:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.229941:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c727 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03bd expref: 21 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.229950:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.229953:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.229957:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.230015:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c727 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03bd expref: 21 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.230032:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c727 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03bd expref: 21 pid: 6517 timeout: 1144 lvb_type: 1 00000100:00100000:2.0:1763334980.230051:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701875584:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334980.231466:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee780 going to sleep for 11 seconds 00000100:00100000:1.0:1763334980.235469:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.235627:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694592512 00000100:00100000:3.0:1763334980.235642:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694592512 00000100:00100000:2.0:1763334980.235848:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701875584:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334980.235888:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.236065:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c727 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03bd expref: 22 pid: 6517 timeout: 1144 lvb_type: 1 00000100:00100000:3.0:1763334980.236114:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2635 00000100:00100000:3.0:1763334980.236125:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694592512:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334980.236145:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334980.236178:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c727 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03bd expref: 22 pid: 6517 timeout: 1144 lvb_type: 1 00010000:00010000:3.0:1763334980.236192:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c727 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03bd expref: 22 pid: 6517 timeout: 1144 lvb_type: 1 00010000:00010000:3.0:1763334980.236222:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c727 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03bd expref: 22 pid: 6517 timeout: 1144 lvb_type: 1 00010000:00010000:3.0:1763334980.236241:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334980.236243:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334980.236248:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.236259:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.236294:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334980.236383:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694592512:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 258us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334980.236392:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2635 00010000:00010000:2.0:1763334980.237969:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.238002:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1763334980.294557:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871213 is committed 00002000:00010000:1.0:1763334980.294843:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 0 -> 158406 00002000:00010000:1.0:1763334980.294849:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 0 -> 1763334980 00002000:00010000:1.0:1763334980.294851:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 0 -> 1763334980 00002000:00010000:1.0:1763334980.294854:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 1 -> 515 00010000:00010000:1.0:1763334980.294873:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.294885:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.294893:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.294901:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334980.294906:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.294916:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.294938:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.294946:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c77b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334980.295469:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694592384:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 65606us (65818us total) trans 17179871213 rc 0/0 00000100:00100000:1.0:1763334980.295483:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1883 00000100:00100000:3.0:1763334980.297712:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.297800:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694592640 00000100:00100000:2.0:1763334980.297819:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694592640 00000100:00100000:2.0:1763334980.297907:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4949 00000100:00100000:2.0:1763334980.297919:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53654:x1848989694592640:12345-192.168.201.60@tcp:44:lfs.0 00000100:00100000:3.0:1763334980.326532:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1848989701875968:0@lo:400:kworker.0 00000100:00100000:3.0:1763334980.326651:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334980.326703:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1763334980.326709:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5501880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:53c3ae04-da5d-4a5f-b9b8-469954a64a68:3290:1848989701875840:0@lo:400:kworker.0 00000100:00100000:3.0:1763334980.326737:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334980.326778:0:29623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701875840 00000100:00100000:3.0:1763334980.326788:0:29623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701875840 00000100:00100000:3.0:1763334980.326847:0:29623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1763334980.326856:0:29623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:53c3ae04-da5d-4a5f-b9b8-469954a64a68+18:3290:x1848989701875840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763334980.326907:0:29623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9bfd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:53c3ae04-da5d-4a5f-b9b8-469954a64a68+18:3290:x1848989701875840:12345-0@lo:400:kworker.0 Request processed in 51us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334980.326914:0:29623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1763334980.326968:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5501880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:53c3ae04-da5d-4a5f-b9b8-469954a64a68:3290:1848989701875840:0@lo:400:kworker.0 00000100:00100000:0.0:1763334980.327118:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701875712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1763334980.327159:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334980.327709:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1848989701876224:0@lo:400:kworker.0 00000100:00100000:0.0:1763334980.327744:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334980.328079:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763334980.328086:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1848989701876096:0@lo:400:kworker.0 00000100:00100000:0.0:1763334980.328110:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334980.328178:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701875712 00000100:00100000:1.0:1763334980.328186:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701875712 00000100:00100000:1.0:1763334980.328235:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1763334980.328244:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3292:x1848989701875712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1763334980.328287:0:6521:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 49086464 pending 0 free 3855613952 avail 3853516800 00000100:00100000:1.0:1763334980.328335:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+13:3292:x1848989701875712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.328343:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1763334980.328443:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701875712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1763334980.328566:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701876352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1763334980.328615:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334980.328647:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701876352 00000100:00100000:3.0:1763334980.328651:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701876352 00000100:00100000:3.0:1763334980.328678:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1763334980.328685:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1848989701876352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1763334980.328698:0:6520:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 77922304 pending 0 free 3856662528 avail 3847225344 00000100:00100000:3.0:1763334980.328731:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3289:x1848989701876352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334980.328738:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1763334980.328764:0:3289:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871207 gen 2 00000004:00080000:3.0:1763334980.328771:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa7ed880, transno 17179871200 00000004:00080000:3.0:1763334980.328783:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5b01f2c700, transno 17179871201 00000004:00080000:3.0:1763334980.328786:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6bed180, transno 17179871202 00000004:00080000:3.0:1763334980.328789:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa7ee300, transno 17179871203 00000004:00080000:3.0:1763334980.328792:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77d880, transno 17179871204 00000004:00080000:3.0:1763334980.328795:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77c000, transno 17179871205 00000004:00080000:3.0:1763334980.328799:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81ff100, transno 17179871206 00000004:00080000:3.0:1763334980.328801:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77ed80, transno 17179871207 00000100:00100000:3.0:1763334980.328810:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701876352:0@lo:13:osp-pre-1-0.0 00000004:00080000:3.0:1763334980.329124:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:2.0:1763334980.329344:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701875968 00000100:00100000:2.0:1763334980.329351:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701875968 00000100:00100000:2.0:1763334980.329392:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701876224 00000100:00100000:2.0:1763334980.329396:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701876224 00000100:00100000:2.0:1763334980.329406:0:29629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701876096 00000100:00100000:2.0:1763334980.329409:0:29629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701876096 00000100:00100000:2.0:1763334980.329423:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1763334980.329430:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1848989701875968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334980.329477:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1848989701875968:12345-0@lo:400:kworker.0 Request processed in 47us (2827us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.329483:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1763334980.329496:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1763334980.329502:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1848989701876224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334980.329529:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1848989701876224:12345-0@lo:400:kworker.0 Request processed in 28us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.329535:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1763334980.329543:0:29629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1763334980.329548:0:29629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1848989701876096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334980.329583:0:29629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1848989701876096:12345-0@lo:400:kworker.0 Request processed in 22us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.329588:0:29629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1763334980.329673:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1848989701876096:0@lo:400:kworker.0 00000100:00100000:0.0:1763334980.329683:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1848989701876224:0@lo:400:kworker.0 00000100:00080000:3.0:1763334980.330869:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1763334980.330920:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1848989701875968:0@lo:400:kworker.0 00000001:00080000:0.0:1763334980.340061:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939149 is committed 00000001:00080000:2.0:1763334980.340193:0:32484:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939151 is committed 00000100:00100000:3.0:1763334980.340566:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53654:x1848989694592640:12345-192.168.201.60@tcp:44:lfs.0 Request processed in 42624us (42842us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334980.340598:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4949 00000100:00100000:0.0:1763334980.347965:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.348098:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.349089:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694592896 00000100:00100000:2.0:1763334980.349107:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694592896 00000100:00100000:2.0:1763334980.349181:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694592768 00000100:00100000:2.0:1763334980.349184:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694592768 00000100:00100000:2.0:1763334980.349216:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5033 00000100:00100000:2.0:1763334980.349227:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694592896:12345-192.168.201.60@tcp:16:lfs.0 00000100:00100000:1.0:1763334980.349385:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5034 00000100:00100000:1.0:1763334980.349397:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694592768:12345-192.168.201.60@tcp:16:lfs.0 00000100:00100000:2.0:1763334980.350031:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694592896:12345-192.168.201.60@tcp:16:lfs.0 Request processed in 802us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.350042:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5033 00000100:00100000:1.0:1763334980.350118:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694592768:12345-192.168.201.60@tcp:16:lfs.0 Request processed in 725us (2020us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.350125:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5034 00000100:00100000:1.0:1763334980.367043:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.367090:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.367256:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694593024 00000100:00100000:3.0:1763334980.367271:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694593024 00000100:00100000:2.0:1763334980.367375:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694593152 00000100:00100000:2.0:1763334980.367380:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694593152 00000100:00100000:2.0:1763334980.367446:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5035 00000100:00100000:2.0:1763334980.367458:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694593152:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334980.367516:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c782 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.367537:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.367540:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.367547:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c782 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.367607:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c782 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.367654:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c782 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.367675:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c782 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.367686:0:25383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c782 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.367694:0:25383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334980.367699:0:25383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c782 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.367711:0:25383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c782 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.367733:0:25383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c782 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.367742:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c782 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334980.367843:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694593152:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 387us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.367853:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5035 00000100:00100000:2.0:1763334980.368003:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.368101:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694593280 00000100:00100000:2.0:1763334980.368107:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694593280 00000100:00100000:2.0:1763334980.368133:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5036 00000100:00100000:2.0:1763334980.368140:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694593280:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334980.368165:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c789 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.368175:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.368177:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.368181:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c789 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.368195:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c789 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.368217:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c789 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.368226:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c789 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.368234:0:25383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.368241:0:25383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334980.368245:0:25383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c789 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.368254:0:25383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c789 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.368265:0:25383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c789 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.368274:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c789 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334980.368329:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694593280:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 188us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.368336:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5036 00000100:00100000:2.0:1763334980.369856:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5037 00000100:00100000:2.0:1763334980.370540:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694593024:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334980.370628:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c790 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.370647:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.370649:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.370656:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c790 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.371815:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c790 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.371871:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c790 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.371882:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c790 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.371892:0:32239:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c790 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.371899:0:32239:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334980.371903:0:32239:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c790 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.371915:0:32239:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c790 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.371933:0:32239:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c790 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.371942:0:32239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c790 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334980.372079:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694593024:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 1543us (5047us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.372090:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5037 00000100:00100000:1.0:1763334980.376739:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.376830:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694593536 00000100:00100000:3.0:1763334980.376845:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694593536 00000100:00100000:3.0:1763334980.377019:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4950 00000100:00100000:3.0:1763334980.377032:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53654:x1848989694593536:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:3.0:1763334980.377108:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334980.377219:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c720 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1b1:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03b6 expref: 191 pid: 32232 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.377245:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b1:0x0].0x0 (ffff9a5ac7d60d00) 00010000:00010000:3.0:1763334980.377269:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334980.377330:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c797 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334980.377345:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c797 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334980.377356:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c797 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:3.0:1763334980.377630:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d461cdaa reply state 0000000003f008ba transno 8589939152 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c797 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334980.377641:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334980.377776:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53654:x1848989694593536:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 745us (1050us total) trans 8589939152 rc 0/0 00000100:00100000:3.0:1763334980.377785:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4950 00010000:00010000:1.0:1763334980.379872:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c797 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334980.379897:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c797 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334980.379906:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c797 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334980.379912:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334980.379917:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c797 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334980.379931:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c797 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334980.379949:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b1:0x0].0x0 (ffff9a5af66def00) 00010000:00010000:1.0:1763334980.379953:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334980.379958:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c797 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334980.379965:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c797 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334980.380314:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.380469:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694593664 00000100:00100000:3.0:1763334980.381444:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694593664 00000100:00100000:3.0:1763334980.381854:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4951 00000100:00100000:3.0:1763334980.381867:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53654:x1848989694593664:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334980.381899:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334980.381929:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849c79e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03e7 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.382018:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849c79e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e7 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.382035:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849c79e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e7 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.382056:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b1:0x0].0x0 (ffff9a5af66de300) 00010000:00010000:3.0:1763334980.382060:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334980.382064:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:3.0:1763334980.383041:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53654:x1848989694593664:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1171us (2726us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334980.383051:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4951 00000100:00100000:0.0:1763334980.391359:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.391919:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694593792 00000100:00100000:2.0:1763334980.391934:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694593792 00000100:00100000:2.0:1763334980.392019:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5038 00000100:00100000:2.0:1763334980.392032:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+20:53654:x1848989694593792:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334980.392058:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334980.392090:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c7a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03ee expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334980.392123:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 158406, mtime: 0x691a5b44, atime: 0x0, ctime: 0x691a5b44, blocks: 0x203 00010000:00010000:2.0:1763334980.392153:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.392156:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.392166:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c7a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03ee expref: 21 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.392187:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c7a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03ee expref: 21 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.392202:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:2.0:1763334980.392291:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+21:53654:x1848989694593792:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 262us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.392301:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5038 00000100:00100000:2.0:1763334980.395884:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.397443:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694593920 00000100:00100000:0.0:1763334980.397461:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694593920 00000100:00100000:1.0:1763334980.397640:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5039 00000100:00100000:1.0:1763334980.397654:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+19:53654:x1848989694593920:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334980.397679:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334980.397704:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c7ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03f5 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.397744:0:32239:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c72e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03c4 expref: 20 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334980.397755:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.397757:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.397763:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c7ac lrc: 4/0,0 mode: --/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03f5 expref: 20 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.397806:0:32239:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03c4 expref: 20 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334980.397824:0:32239:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c72e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03c4 expref: 20 pid: 6517 timeout: 1145 lvb_type: 1 00000100:00100000:1.0:1763334980.397839:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa745500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701876480:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334980.397945:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334980.405193:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa745500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701876480:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334980.405247:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c7ac lrc: 3/0,0 mode: --/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03f5 expref: 20 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.405272:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:2.0:1763334980.405351:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+20:53654:x1848989694593920:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7699us (9488us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.405362:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5039 00000100:00100000:1.0:1763334980.406061:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.407422:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694594048 00000100:00100000:0.0:1763334980.407437:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694594048 00010000:00010000:0.0:1763334980.407487:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c72e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03c4 expref: 20 pid: 6517 timeout: 1145 lvb_type: 1 00000100:00100000:0.0:1763334980.407535:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2636 00000100:00100000:0.0:1763334980.407546:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694594048:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334980.407565:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334980.407608:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c72e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03c4 expref: 20 pid: 6517 timeout: 1145 lvb_type: 1 00010000:00010000:0.0:1763334980.407623:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c72e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03c4 expref: 20 pid: 6517 timeout: 1145 lvb_type: 1 00010000:00010000:0.0:1763334980.407654:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c72e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03c4 expref: 20 pid: 6517 timeout: 1145 lvb_type: 1 00010000:00010000:0.0:1763334980.407674:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334980.407677:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334980.407685:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c7ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03f5 expref: 19 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.407697:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c7ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03f5 expref: 19 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.407747:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c7ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03f5 expref: 19 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334980.407765:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701876608:192.168.201.60@tcp:105: 00000100:00100000:0.0:1763334980.407857:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad830c540 going to sleep for 11 seconds 00000100:00100000:0.0:1763334980.415681:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.415734:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.415996:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bed180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701876608:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334980.416031:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334980.416113:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694594048:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 8567us (10056us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.416127:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2636 00000100:00100000:3.0:1763334980.416282:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694594304 00000100:00100000:3.0:1763334980.416293:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694594304 00000100:00100000:3.0:1763334980.416350:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694594176 00000100:00100000:3.0:1763334980.416354:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694594176 00000100:00100000:3.0:1763334980.416382:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5040 00000100:00100000:3.0:1763334980.416392:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694594304:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:3.0:1763334980.416775:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334980.416780:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 0 -> 1763334980 00002000:00010000:3.0:1763334980.416782:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 0 -> 1763334980 00002000:00010000:3.0:1763334980.416784:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 0 -> 1763334981 00002000:00010000:3.0:1763334980.416787:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334980.416819:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694594304:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 428us (1153us total) trans 21474838471 rc 0/0 00000100:00100000:3.0:1763334980.416827:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5040 00000100:00100000:3.0:1763334980.416842:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5041 00000100:00100000:3.0:1763334980.416849:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694594176:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:3.0:1763334980.419494:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 158406 -> 158406 00002000:00010000:3.0:1763334980.419507:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334980.419510:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 0 -> 1763334980 00002000:00010000:3.0:1763334980.419513:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334980 -> 1763334981 00002000:00010000:3.0:1763334980.419515:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334980.421760:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694594176:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 4889us (6004us total) trans 17179871214 rc 0/0 00000100:00100000:3.0:1763334980.421781:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5041 00000100:00100000:0.0:1763334980.427379:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.428305:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694594560 00000100:00100000:3.0:1763334980.428321:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694594560 00000100:00100000:2.0:1763334980.429230:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4952 00000100:00100000:2.0:1763334980.429245:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53654:x1848989694594560:12345-192.168.201.60@tcp:55:lfs.0 00010000:00010000:2.0:1763334980.429339:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7b3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.429361:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.429374:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.429405:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.429412:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7b3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.429419:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7b3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.429424:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334980.429428:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7b3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.429436:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7b3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.429448:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b1:0x0].0x0 (ffff9a5af66de300) 00010000:00010000:2.0:1763334980.429451:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1763334980.429456:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7b3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.429462:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7b3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334980.430398:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53654:x1848989694594560:12345-192.168.201.60@tcp:55:lfs.0 Request processed in 1150us (3027us total) trans 0 rc -22/-22 00000100:00100000:2.0:1763334980.430410:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4952 00000100:00100000:1.0:1763334980.434954:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.435127:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694594816 00000100:00100000:2.0:1763334980.435141:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694594816 00000100:00100000:2.0:1763334980.435222:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4953 00000100:00100000:2.0:1763334980.435234:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53654:x1848989694594816:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334980.435318:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334980.435361:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849c6c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b039a expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.435386:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de200) 00010000:00010000:2.0:1763334980.435392:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334980.435455:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7ba lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.435473:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.435486:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:2.0:1763334980.438502:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000092b51cf3 reply state 00000000b36423c2 transno 8589939153 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334980.438526:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334980.438729:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53654:x1848989694594816:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 3492us (3787us total) trans 8589939153 rc 0/0 00000100:00100000:2.0:1763334980.438741:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4953 00000100:00100000:0.0:1763334980.445280:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334980.445380:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7ba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.445397:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7ba lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.445407:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7ba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.445414:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334980.445421:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7ba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.445431:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7ba lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.445454:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de200) 00010000:00010000:2.0:1763334980.445459:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334980.445466:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7ba lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334980.445473:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7ba lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334980.446371:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694594944 00000100:00100000:3.0:1763334980.446389:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694594944 00000100:00100000:1.0:1763334980.446552:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5042 00000100:00100000:1.0:1763334980.446566:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:53654:x1848989694594944:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334980.446612:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334980.446637:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c7c1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b03fc expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.446675:0:6517:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c75f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d2 expref: 23 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334980.446685:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.446688:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.446692:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c7c1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03fc expref: 23 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.446740:0:6517:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c75f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d2 expref: 23 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334980.446756:0:6517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c75f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d2 expref: 23 pid: 32239 timeout: 1145 lvb_type: 1 00000100:00100000:1.0:1763334980.446773:0:6517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6517:1848989701876736:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334980.446890:0:6517:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0f840 going to sleep for 11 seconds 00000100:00100000:1.0:1763334980.452248:0:6517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6517:1848989701876736:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334980.452309:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c7c1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03fc expref: 23 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.452338:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334980.452407:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+23:53654:x1848989694594944:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5845us (7147us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.452417:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5042 00010000:00010000:2.0:1763334980.453710:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334980.454156:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.454250:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694595072 00000100:00100000:1.0:1763334980.454269:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694595072 00010000:00010000:1.0:1763334980.454315:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c75f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d2 expref: 23 pid: 32239 timeout: 1145 lvb_type: 1 00000100:00100000:1.0:1763334980.454360:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2637 00000100:00100000:1.0:1763334980.454371:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694595072:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334980.454389:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334980.454418:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c75f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d2 expref: 23 pid: 32239 timeout: 1145 lvb_type: 1 00010000:00010000:1.0:1763334980.454434:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c75f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d2 expref: 23 pid: 32239 timeout: 1145 lvb_type: 1 00010000:00010000:1.0:1763334980.454467:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849c75f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d2 expref: 23 pid: 32239 timeout: 1145 lvb_type: 1 00010000:00010000:1.0:1763334980.454486:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.454488:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.454497:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c7c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03fc expref: 22 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.454509:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c7c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03fc expref: 22 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.454555:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c7c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03fc expref: 22 pid: 6517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334980.454620:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa747b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701876864:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334980.454723:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0f840 going to sleep for 11 seconds 00000100:00100000:1.0:1763334980.459418:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa747b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701876864:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334980.459456:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334980.459533:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694595072:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5162us (5384us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.459545:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2637 00000100:00100000:0.0:1763334980.459956:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.460059:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694595200 00000100:00100000:2.0:1763334980.460070:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694595200 00000100:00100000:2.0:1763334980.460133:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5043 00000100:00100000:2.0:1763334980.460143:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:53654:x1848989694595200:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334980.460164:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334980.460188:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0403 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.460222:0:6517:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c766 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d9 expref: 21 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.460231:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.460233:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.460238:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7c8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0403 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.460275:0:6517:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c766 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d9 expref: 21 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.460297:0:6517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c766 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d9 expref: 21 pid: 21625 timeout: 1145 lvb_type: 1 00000100:00100000:2.0:1763334980.460311:0:6517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6517:1848989701876992:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334980.460378:0:6517:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1763334980.463712:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.463832:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694595328 00000100:00100000:1.0:1763334980.463846:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694595328 00010000:00010000:1.0:1763334980.463901:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c766 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d9 expref: 22 pid: 21625 timeout: 1145 lvb_type: 1 00000100:00100000:1.0:1763334980.463948:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2638 00000100:00100000:1.0:1763334980.463961:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694595328:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1763334980.463974:0:6517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6517:1848989701876992:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334980.463997:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334980.464031:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7c8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 5 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0403 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.464032:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c766 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d9 expref: 22 pid: 21625 timeout: 1145 lvb_type: 1 00010000:00010000:1.0:1763334980.464062:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c766 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d9 expref: 22 pid: 21625 timeout: 1145 lvb_type: 1 00010000:00010000:1.0:1763334980.464526:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c766 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03d9 expref: 22 pid: 21625 timeout: 1145 lvb_type: 1 00010000:00010000:2.0:1763334980.464527:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.464531:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.464544:0:6517:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0403 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.464565:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0403 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.464717:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334980.464752:0:6517:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0403 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334980.464769:0:6517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6517:1848989701877120:192.168.201.60@tcp:105: 00000100:00100000:2.0:1763334980.464873:0:6517:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334980.464977:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694595328:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1017us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.464998:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2638 00000100:00100000:1.0:1763334980.469256:0:6517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6517:1848989701877120:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334980.469295:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430400, rc 0) 00000100:00100000:1.0:1763334980.469378:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:53654:x1848989694595200:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 9235us (9422us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.469390:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5043 00000100:00100000:3.0:1763334980.472490:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.472617:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694595456 00000100:00100000:1.0:1763334980.472632:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694595456 00000100:00100000:1.0:1763334980.472709:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5044 00000100:00100000:1.0:1763334980.472722:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:53654:x1848989694595456:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334980.472748:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334980.472774:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849c7cf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b040a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.472813:0:6517:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c76d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e0 expref: 23 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334980.472823:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.472825:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.472830:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849c7cf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b040a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.472879:0:6517:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c76d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e0 expref: 23 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334980.472895:0:6517:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c76d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e0 expref: 23 pid: 32239 timeout: 1145 lvb_type: 1 00000100:00100000:1.0:1763334980.472912:0:6517:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6517:1848989701877248:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334980.473698:0:6517:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0f840 going to sleep for 11 seconds 00000100:00100000:1.0:1763334980.476897:0:6517:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6517:1848989701877248:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334980.476948:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849c7cf lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b040a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.476979:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478800, rc 0) 00000100:00100000:1.0:1763334980.477075:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+23:53654:x1848989694595456:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4354us (4599us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.477087:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5044 00000100:00100000:3.0:1763334980.477260:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.477405:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694595584 00000100:00100000:1.0:1763334980.477414:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694595584 00010000:00010000:1.0:1763334980.477451:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c76d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e0 expref: 23 pid: 32239 timeout: 1145 lvb_type: 1 00000100:00100000:1.0:1763334980.477489:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2639 00000100:00100000:1.0:1763334980.477500:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694595584:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334980.477519:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334980.477545:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c76d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e0 expref: 23 pid: 32239 timeout: 1145 lvb_type: 1 00010000:00010000:1.0:1763334980.477666:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c76d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e0 expref: 23 pid: 32239 timeout: 1145 lvb_type: 1 00010000:00010000:1.0:1763334980.477976:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849c76d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e0 expref: 23 pid: 32239 timeout: 1145 lvb_type: 1 00010000:00010000:1.0:1763334980.478003:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.478006:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.478012:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849c7cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b040a expref: 22 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.478028:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849c7cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b040a expref: 22 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.478072:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849c7cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b040a expref: 22 pid: 6517 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334980.478089:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa747b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701877376:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334980.478260:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0f840 going to sleep for 11 seconds 00000100:00100000:3.0:1763334980.481790:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.481835:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.481869:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.482296:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694595712 00000100:00100000:2.0:1763334980.482311:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694595712 00000100:00100000:2.0:1763334980.482377:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694595840 00000100:00100000:2.0:1763334980.482381:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694595840 00000100:00100000:2.0:1763334980.482405:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694595968 00000100:00100000:2.0:1763334980.482407:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694595968 00000100:00100000:2.0:1763334980.482431:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5045 00000100:00100000:2.0:1763334980.482442:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694595712:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334980.482767:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 158406 -> 158406 00002000:00010000:2.0:1763334980.482772:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334980.482774:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334979 -> 1763334980 00002000:00010000:2.0:1763334980.482777:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334980 -> 1763334981 00002000:00010000:2.0:1763334980.482779:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 121 -> 121 00000100:00100000:2.0:1763334980.482854:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694595712:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 413us (1079us total) trans 17179871215 rc 0/0 00000100:00100000:2.0:1763334980.482862:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5045 00000100:00100000:2.0:1763334980.482884:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5046 00000100:00100000:2.0:1763334980.482892:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694595840:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334980.483012:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334980.483016:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334980.483018:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334979 -> 1763334980 00002000:00010000:2.0:1763334980.483021:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334980 -> 1763334981 00002000:00010000:2.0:1763334980.483023:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334980.483044:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694595840:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 153us (1209us total) trans 21474838472 rc 0/0 00000100:00100000:2.0:1763334980.483051:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5046 00000100:00100000:2.0:1763334980.483065:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5047 00000100:00100000:2.0:1763334980.483071:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694595968:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334980.483145:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334980.483149:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334980.483151:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334979 -> 1763334980 00002000:00010000:2.0:1763334980.483153:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334980 -> 1763334981 00002000:00010000:2.0:1763334980.483156:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334980.483178:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694595968:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 106us (1308us total) trans 17179871216 rc 0/0 00000100:00100000:2.0:1763334980.483185:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5047 00000100:00100000:1.0:1763334980.484816:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa747b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701877376:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334980.484851:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334980.484921:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694595584:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 7422us (7668us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.484932:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2639 00000100:00100000:3.0:1763334980.487525:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.488512:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694596224 00000100:00100000:1.0:1763334980.488529:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694596224 00000100:00100000:0.0:1763334980.489157:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1802 00000100:00100000:0.0:1763334980.489171:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53654:x1848989694596224:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:0.0:1763334980.489367:0:29631:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1ab:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c73c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03cb expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.489420:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.489435:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c6b7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0393 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.489446:0:29631:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.489488:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c6b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0393 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.489503:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c6b7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0393 expref: 192 pid: 30972 timeout: 1145 lvb_type: 0 00000100:00100000:0.0:1763334980.489522:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701877504:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334980.489782:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad830c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334980.493223:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bed880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701877504:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334980.493616:0:29631:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:2.0:1763334980.494125:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.494318:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694596352 00000100:00100000:1.0:1763334980.494329:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694596352 00010000:00010000:1.0:1763334980.494381:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c6b7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0393 expref: 193 pid: 30972 timeout: 1145 lvb_type: 0 00000100:00100000:1.0:1763334980.494424:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2640 00000100:00100000:1.0:1763334980.494436:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2360:x1848989694596352:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334980.494455:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334980.494463:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c6b7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0393 expref: 193 pid: 30972 timeout: 1145 lvb_type: 0 00010000:00010000:1.0:1763334980.494483:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c6b7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0393 expref: 193 pid: 30972 timeout: 1145 lvb_type: 0 00010000:00010000:1.0:1763334980.494512:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849c6b7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0393 expref: 193 pid: 30972 timeout: 1145 lvb_type: 0 00010000:00010000:1.0:1763334980.494532:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de200) 00010000:00010000:1.0:1763334980.494539:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334980.494552:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334980.494560:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334980.494643:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334980.494715:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694596352:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 280us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.494723:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2640 00010000:00010000:0.0:1763334980.495087:0:29631:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.495097:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.495127:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.495141:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849c79e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e7 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.495150:0:29631:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.495190:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849c79e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e7 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.495205:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849c79e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e7 expref: 191 pid: 30972 timeout: 1145 lvb_type: 0 00000100:00100000:0.0:1763334980.495221:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701877632:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334980.495304:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad830cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334980.501956:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bed500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701877632:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334980.502006:0:29631:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:2.0:1763334980.503095:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.503197:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694596480 00000100:00100000:3.0:1763334980.503213:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694596480 00010000:00010000:3.0:1763334980.503271:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849c79e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e7 expref: 192 pid: 30972 timeout: 1145 lvb_type: 0 00000100:00100000:1.0:1763334980.503925:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2641 00000100:00100000:0.0:1763334980.504027:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2359:x1848989694596480:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334980.504051:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334980.504062:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849c79e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e7 expref: 192 pid: 30972 timeout: 1145 lvb_type: 0 00010000:00010000:0.0:1763334980.504079:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849c79e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e7 expref: 192 pid: 30972 timeout: 1145 lvb_type: 0 00010000:00010000:0.0:1763334980.504109:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849c79e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1b1:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03e7 expref: 192 pid: 30972 timeout: 1145 lvb_type: 0 00010000:00010000:0.0:1763334980.504131:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b1:0x0].0x0 (ffff9a5af66de300) 00010000:00010000:0.0:1763334980.504137:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.504149:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.504158:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.504196:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334980.504279:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:2359:x1848989694596480:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 342us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.504288:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2641 00010000:00010000:2.0:1763334980.504416:0:29631:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334980.504426:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:2.0:1763334980.505116:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701877760:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334980.505180:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334980.505231:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701877760 00000100:00100000:2.0:1763334980.505238:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701877760 00000100:00100000:2.0:1763334980.505283:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1763334980.505291:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701877760:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334980.505369:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701877760:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 78us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.505377:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1763334980.505401:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee300 going to sleep for 11 seconds 00000100:00100000:2.0:1763334980.505432:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701877760:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334980.505476:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701877888:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334980.505502:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334980.505518:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee300 going to sleep for 11 seconds 00000100:00100000:2.0:1763334980.505532:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701877888 00000100:00100000:2.0:1763334980.505536:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701877888 00000100:00100000:2.0:1763334980.505561:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1763334980.505567:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:29631:x1848989701877888:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334980.505650:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:29631:x1848989701877888:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 83us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.505657:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1763334980.505690:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701877888:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334980.505734:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334980.505766:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334980.505786:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701878016 00000100:00100000:2.0:1763334980.505790:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701878016 00000100:00100000:3.0:1763334980.506378:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c1df5240 going to sleep for 11 seconds 00000100:00100000:2.0:1763334980.507975:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1763334980.508017:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:29631:x1848989701878016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334980.508902:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:29631:x1848989701878016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 897us (3129us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.508915:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1763334980.509022:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763334980.509130:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763334980.509186:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334980.509280:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac57b50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334980.509327:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701878144 00000100:00100000:2.0:1763334980.509335:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701878144 00000100:00100000:0.0:1763334980.514517:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1763334980.514559:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701878144:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.514786:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701878144:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 250us (5598us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.514796:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1763334980.514900:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878144:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515051:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515105:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334980.515134:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2ffccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334980.515150:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701878272 00000100:00100000:0.0:1763334980.515157:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701878272 00000100:00100000:0.0:1763334980.515198:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1763334980.515206:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701878272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515253:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6beea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701878272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 48us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.515260:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1763334980.515289:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515322:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515345:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334980.515358:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c3217480 going to sleep for 11 seconds 00000100:00100000:0.0:1763334980.515372:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701878400 00000100:00100000:0.0:1763334980.515376:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701878400 00000100:00100000:0.0:1763334980.515399:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1763334980.515406:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:29631:x1848989701878400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515458:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:29631:x1848989701878400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.515465:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1763334980.515491:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515523:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515544:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334980.515557:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2ffccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334980.515567:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701878528 00000100:00100000:0.0:1763334980.515599:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701878528 00000100:00100000:0.0:1763334980.515620:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1763334980.515626:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:29631:x1848989701878528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515667:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:29631:x1848989701878528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 41us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.515673:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1763334980.515698:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515726:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515749:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334980.515762:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c3217480 going to sleep for 11 seconds 00000100:00100000:0.0:1763334980.515773:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701878656 00000100:00100000:0.0:1763334980.515777:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701878656 00000100:00100000:0.0:1763334980.515795:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1763334980.515801:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701878656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515846:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701878656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 45us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.515853:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1763334980.515878:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515910:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.515936:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334980.515949:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2ffccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334980.515960:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701878784 00000100:00100000:0.0:1763334980.515964:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701878784 00000100:00100000:0.0:1763334980.515997:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1763334980.516004:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701878784:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.516047:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701878784:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 43us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.516053:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1763334980.516079:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.516113:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878912:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.516136:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334980.516149:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c3217480 going to sleep for 11 seconds 00000100:00100000:0.0:1763334980.516159:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701878912 00000100:00100000:0.0:1763334980.516163:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701878912 00000100:00100000:0.0:1763334980.516183:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1763334980.516190:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:29631:x1848989701878912:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.516235:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6beca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:29631:x1848989701878912:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 46us (99us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.516241:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1763334980.516266:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701878912:0@lo:1000:mdt_rdpg00_001.0 00000040:00080000:0.0:1763334980.516733:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].11, 640 off37192 00000001:00080000:0.0:1763334980.516748:0:29631:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939154 00000100:00100000:0.0:1763334980.516818:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701879040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.516850:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334980.516866:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2ffccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334980.516880:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701879040 00000100:00100000:0.0:1763334980.516883:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701879040 00000100:00100000:0.0:1763334980.516904:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1763334980.516910:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701879040:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.517146:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29631:x1848989701879040:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 234us (293us total) trans 17179871217 rc 0/0 00000100:00100000:0.0:1763334980.517153:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1763334980.517196:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bedc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701879040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.517221:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6bed880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701879168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.517245:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334980.517260:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac9456d80 going to sleep for 11 seconds 00000100:00100000:0.0:1763334980.517271:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701879168 00000100:00100000:0.0:1763334980.517274:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701879168 00000100:00100000:0.0:1763334980.517294:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1763334980.517300:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+13:29631:x1848989701879168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334980.517465:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+14:29631:x1848989701879168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 164us (219us total) trans 21474838473 rc 0/0 00000100:00100000:0.0:1763334980.517471:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1763334980.517502:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6bed880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701879168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1763334980.517636:0:29631:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939155 00010000:00010000:0.0:1763334980.517669:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517681:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517690:0:29631:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517697:0:29631:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334980.517703:0:29631:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517713:0:29631:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517733:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b1:0x0].0x0 (ffff9a5af66de300) 00010000:00010000:0.0:1763334980.517737:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1763334980.517743:0:29631:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517749:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c7dd lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1b1:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517771:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517778:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517784:0:29631:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517789:0:29631:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334980.517792:0:29631:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517797:0:29631:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517805:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de200) 00010000:00010000:0.0:1763334980.517807:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1763334980.517810:0:29631:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517815:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c7d6 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334980.517828:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de200) 00010000:00010000:0.0:1763334980.517830:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334980.517839:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c73c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03cb expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334980.517947:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53654:x1848989694596224:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 28779us (30435us total) trans 8589939156 rc 0/0 00000100:00100000:0.0:1763334980.517956:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1802 00000020:00080000:0.0:1763334980.517961:0:29631:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1763334980.523164:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.524068:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694596608 00000100:00100000:0.0:1763334980.524086:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694596608 00000100:00100000:0.0:1763334980.524170:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4954 00000100:00100000:0.0:1763334980.524183:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53654:x1848989694596608:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334980.524215:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334980.524258:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c7e4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0411 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.524343:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c7e4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0411 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.524359:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c7e4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0411 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.524380:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334980.524384:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334980.524388:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334980.524478:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53654:x1848989694596608:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 297us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.524487:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4954 00000100:00100000:0.0:1763334980.530361:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.530460:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694596864 00000100:00100000:2.0:1763334980.530475:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694596864 00000100:00100000:2.0:1763334980.530555:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1803 00000100:00100000:2.0:1763334980.530568:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53654:x1848989694596864:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334980.530949:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53654:x1848989694596864:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 382us (602us total) trans 8589939157 rc 0/0 00000100:00100000:2.0:1763334980.530957:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1803 00000100:00100000:2.0:1763334980.536218:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.536353:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694597120 00000100:00100000:1.0:1763334980.536367:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694597120 00000100:00100000:1.0:1763334980.536448:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1804 00000100:00100000:1.0:1763334980.536461:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53654:x1848989694597120:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:1.0:1763334980.537065:0:29630:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x1b1:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1763334980.537740:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c7eb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334980.537765:0:29630:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c7eb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334980.537778:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c7eb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334980.537787:0:29630:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c7eb lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334980.537794:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c7eb lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334980.537803:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c7eb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334980.538101:0:29630:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334980.538277:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53654:x1848989694597120:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1814us (2069us total) trans 8589939158 rc 0/0 00000100:00100000:0.0:1763334980.538288:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1804 00010000:00010000:1.0:1763334980.538301:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1763334980.538310:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c7eb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334980.538320:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334980.538324:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c7eb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334980.538332:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c7eb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334980.538345:0:8205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b1:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:1.0:1763334980.538348:0:8205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1763334980.538353:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c7eb lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334980.538358:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c7eb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b1:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334980.538379:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334980.538380:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334980.538382:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334980.560686:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.560799:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694597248 00000100:00100000:1.0:1763334980.560813:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694597248 00000100:00100000:1.0:1763334980.560891:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4955 00000100:00100000:1.0:1763334980.560903:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53655:x1848989694597248:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334980.560934:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334980.560962:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c7f2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0418 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.561065:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c7f9 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561084:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c7f9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561096:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c7f9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561113:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c800 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561120:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c800 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561127:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c800 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561261:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c807 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561274:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c807 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561280:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c807 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:1.0:1763334980.561321:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 158406 00000004:00200000:1.0:1763334980.561326:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334980.561346:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c807 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561359:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c807 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561368:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c7f9 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561375:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c7f9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561381:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561387:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334980.561392:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561400:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c7f9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561413:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:1.0:1763334980.561417:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334980.561423:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c7f9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561430:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c7f9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561445:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c800 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561451:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c800 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561457:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c800 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561463:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334980.561466:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c800 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561472:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c800 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561479:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ad28faa00) 00010000:00010000:1.0:1763334980.561481:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334980.561484:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c800 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561490:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c800 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.561522:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c7f2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0418 expref: 197 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.561536:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c807 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0418 expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.561549:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334980.561552:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334980.561554:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334980.561682:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53655:x1848989694597248:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 781us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.561691:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4955 00000100:00100000:2.0:1763334980.565154:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.565269:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694597504 00000100:00100000:0.0:1763334980.565284:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694597504 00000100:00100000:0.0:1763334980.565360:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4956 00000100:00100000:0.0:1763334980.565372:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53655:x1848989694597504:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334980.565399:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334980.565425:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c80e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b041f expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.565552:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c815 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334980.565599:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c815 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334980.565613:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c815 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334980.565628:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 158406 00010000:00010000:0.0:1763334980.565781:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c80e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b041f expref: 199 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.565801:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c815 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b041f expref: 198 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.565817:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334980.565820:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763334980.565823:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334980.565902:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53655:x1848989694597504:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 533us (764us total) trans 8589939159 rc 0/0 00000100:00100000:0.0:1763334980.565909:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4956 00000100:00100000:3.0:1763334980.571508:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.571662:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694597760 00000100:00100000:0.0:1763334980.571677:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694597760 00000100:00100000:0.0:1763334980.571764:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4957 00000100:00100000:0.0:1763334980.571776:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53655:x1848989694597760:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334980.571812:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334980.571840:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c823 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0426 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.571979:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c82a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334980.572013:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c82a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334980.572026:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c82a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334980.572043:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 158406 00010000:00010000:0.0:1763334980.572222:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c823 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0426 expref: 201 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.572246:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c82a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0426 expref: 200 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.572257:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334980.572261:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334980.572266:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334980.572355:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53655:x1848989694597760:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 581us (861us total) trans 8589939160 rc 0/0 00000100:00100000:0.0:1763334980.572364:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4957 00000100:00100000:3.0:1763334980.576909:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.577629:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694597888 00000100:00100000:2.0:1763334980.577646:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694597888 00000100:00100000:2.0:1763334980.577728:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5048 00000100:00100000:2.0:1763334980.577740:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694597888:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334980.577766:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334980.577797:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c838 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b042d expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334980.577831:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24d:0x0] initial LVB size: 217778, mtime: 0x691a5b43, atime: 0x691a5b40, ctime: 0x691a5b43, blocks: 0x203 00010000:00010000:2.0:1763334980.577860:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.577863:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.577876:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b042d expref: 25 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.577899:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b042d expref: 25 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.577914:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430200, rc 0) 00000100:00100000:2.0:1763334980.577993:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb345c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694597888:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 248us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.578001:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5048 00000100:00100000:2.0:1763334980.583439:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.583994:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694598016 00000100:00100000:0.0:1763334980.584011:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694598016 00000100:00100000:0.0:1763334980.584199:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5049 00000100:00100000:0.0:1763334980.584213:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2362:x1848989694598016:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334980.584240:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334980.584386:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c83f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0434 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334980.584421:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 217778, mtime: 0x691a5b43, atime: 0x691a5b40, ctime: 0x691a5b43, blocks: 0x203 00010000:00010000:0.0:1763334980.584453:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334980.584456:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334980.584470:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c83f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0434 expref: 22 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334980.584493:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c83f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0434 expref: 22 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334980.584510:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334980.584618:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694598016:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 407us (1196us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.584628:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5049 00000100:00100000:3.0:1763334980.619656:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.619844:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694598144 00000100:00100000:1.0:1763334980.619858:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694598144 00000100:00100000:1.0:1763334980.619955:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1884 00000100:00100000:1.0:1763334980.619966:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2361:x1848989694598144:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:1.0:1763334980.620026:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.620048:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c7c1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03fc expref: 25 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.620058:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334980.620060:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334980.620065:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.620107:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c7c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03fc expref: 25 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.620123:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c7c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03fc expref: 25 pid: 6517 timeout: 1145 lvb_type: 0 00000100:00100000:1.0:1763334980.620148:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701879296:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334980.620282:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0f840 going to sleep for 11 seconds 00000100:00100000:1.0:1763334980.624801:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701879296:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334980.624843:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334980.625687:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.626248:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694598272 00000100:00100000:0.0:1763334980.626377:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694598272 00010000:00010000:0.0:1763334980.626440:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c7c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03fc expref: 26 pid: 6517 timeout: 1145 lvb_type: 0 00000100:00100000:0.0:1763334980.626501:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2642 00000100:00100000:0.0:1763334980.626514:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694598272:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334980.626537:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334980.626567:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c7c1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03fc expref: 26 pid: 6517 timeout: 1145 lvb_type: 0 00010000:00010000:0.0:1763334980.626623:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c7c1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03fc expref: 26 pid: 6517 timeout: 1145 lvb_type: 0 00010000:00010000:0.0:1763334980.626653:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849c7c1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03fc expref: 26 pid: 6517 timeout: 1145 lvb_type: 0 00010000:00010000:0.0:1763334980.626674:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334980.626676:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334980.626681:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.626693:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.626721:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334980.626804:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694598272:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 291us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.626813:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2642 00010000:00010000:1.0:1763334980.626941:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.626953:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.632687:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.632715:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.632727:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.632735:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334980.632740:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.632750:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.632776:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.632785:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c846 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334980.632907:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694598144:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 12937us (13663us total) trans 0 rc 158406/158406 00000100:00100000:1.0:1763334980.632919:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1884 00000100:00100000:2.0:1763334980.636850:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.637029:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.637175:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694598528 00000100:00100000:0.0:1763334980.637188:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694598528 00000100:00100000:3.0:1763334980.637264:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694598400 00000100:00100000:3.0:1763334980.637269:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694598400 00000100:00100000:3.0:1763334980.637348:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5050 00000100:00100000:3.0:1763334980.637363:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694598528:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334980.637389:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334980.637415:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c84d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0442 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334980.637494:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701879424:192.168.201.60@tcp:106: 00000100:00100000:2.0:1763334980.637687:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5051 00000100:00100000:2.0:1763334980.637698:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694598400:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334980.637708:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334980.637723:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c854 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b043b expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334980.637757:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701879552:192.168.201.60@tcp:106: 00000100:00100000:3.0:1763334980.638392:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac57b5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334980.638684:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bf9000 going to sleep for 11 seconds 00000100:00100000:2.0:1763334980.640966:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701879424:192.168.201.60@tcp:106: 00010000:00010000:2.0:1763334980.641029:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c84d lrc: 1/0,0 mode: --/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0442 expref: 23 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.641059:0:32239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849c84d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0442 expref: 23 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.641075:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:2.0:1763334980.641150:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694598528:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3789us (4313us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334980.641160:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5050 00000100:00100000:0.0:1763334980.641273:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701879552:192.168.201.60@tcp:106: 00010000:00010000:0.0:1763334980.641295:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c854 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b043b expref: 25 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334980.641309:0:32241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c854 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b043b expref: 25 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334980.641319:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430e00, rc 0) 00000100:00100000:0.0:1763334980.641344:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694598400:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3650us (4315us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334980.641351:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5051 00000100:00100000:0.0:1763334980.644708:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.644836:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694598656 00000100:00100000:1.0:1763334980.644851:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694598656 00000100:00100000:1.0:1763334980.644933:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1885 00000100:00100000:1.0:1763334980.644943:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694598656:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:1.0:1763334980.644996:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.645019:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c7a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03ee expref: 24 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.645028:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334980.645031:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334980.645035:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.645076:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c7a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03ee expref: 24 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.645096:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c7a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03ee expref: 24 pid: 32239 timeout: 1145 lvb_type: 0 00000100:00100000:1.0:1763334980.645114:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701879680:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334980.645213:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2c0f840 going to sleep for 11 seconds 00000100:00100000:3.0:1763334980.648218:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.648448:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694598784 00000100:00100000:2.0:1763334980.648460:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694598784 00010000:00010000:2.0:1763334980.648514:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c7a5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03ee expref: 25 pid: 32239 timeout: 1145 lvb_type: 0 00000100:00100000:1.0:1763334980.648680:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa747b80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701879680:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334980.648713:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334980.648911:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2643 00000100:00100000:2.0:1763334980.648924:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694598784:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334980.648946:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334980.648975:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c7a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03ee expref: 25 pid: 32239 timeout: 1145 lvb_type: 0 00010000:00010000:2.0:1763334980.649008:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c7a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03ee expref: 25 pid: 32239 timeout: 1145 lvb_type: 0 00010000:00010000:2.0:1763334980.649038:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c7a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03ee expref: 25 pid: 32239 timeout: 1145 lvb_type: 0 00010000:00010000:2.0:1763334980.649059:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.649061:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.649067:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.649078:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.649105:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334980.649179:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694598784:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 258us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.649187:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2643 00010000:00010000:1.0:1763334980.649327:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.649337:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.653566:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.653618:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.653628:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.653635:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334980.653641:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.653652:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.653678:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.653687:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849c85b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334980.654557:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2361:x1848989694598656:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 9602us (9852us total) trans 0 rc 158406/158406 00000100:00100000:1.0:1763334980.654608:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1885 00000100:00100000:3.0:1763334980.666083:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.668197:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694598912 00000100:00100000:2.0:1763334980.668222:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694598912 00000100:00100000:2.0:1763334980.668350:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 407 00000100:00100000:2.0:1763334980.668364:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53655:x1848989694598912:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:2.0:1763334980.668386:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334980.668420:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c82a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0426 expref: 200 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.668452:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334980.668459:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334980.668639:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53655:x1848989694598912:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 277us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.668648:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 407 00000100:00100000:3.0:1763334980.671922:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.672028:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694599168 00000100:00100000:0.0:1763334980.672040:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694599168 00000100:00100000:0.0:1763334980.672336:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1805 00000100:00100000:0.0:1763334980.672348:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37abc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53655:x1848989694599168:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334980.672731:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37abc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53655:x1848989694599168:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 383us (817us total) trans 8589939161 rc 0/0 00000100:00100000:0.0:1763334980.672741:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1805 00000100:00100000:1.0:1763334980.686165:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.686295:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694599424 00000100:00100000:2.0:1763334980.686309:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694599424 00000100:00100000:2.0:1763334980.686392:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4958 00000100:00100000:2.0:1763334980.686404:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53656:x1848989694599424:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334980.686438:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334980.686468:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c862 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0449 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.686636:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c869 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334980.686657:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c869 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334980.686670:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c869 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334980.686692:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 158406 00010000:00010000:2.0:1763334980.686861:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c862 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0449 expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.686881:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c869 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0449 expref: 202 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.686893:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334980.686896:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334980.686899:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431600, rc 0) 00000100:00100000:2.0:1763334980.686966:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53656:x1848989694599424:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 566us (818us total) trans 8589939162 rc 0/0 00000100:00100000:2.0:1763334980.686972:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4958 00000100:00100000:1.0:1763334980.695886:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.696000:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694599552 00000100:00100000:2.0:1763334980.696019:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694599552 00000100:00100000:2.0:1763334980.696120:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1886 00000100:00100000:2.0:1763334980.696133:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694599552:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334980.696188:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c877 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.696209:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.696212:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.696220:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c877 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.696238:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c877 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.708431:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c877 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.708458:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c877 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.708468:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c877 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.708476:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334980.708481:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c877 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.708559:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c877 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.708609:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c877 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.708619:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c877 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334980.709438:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694599552:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 13296us (13558us total) trans 0 rc 158406/158406 00000100:00100000:1.0:1763334980.709453:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1886 00000100:00100000:1.0:1763334980.717959:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.718207:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694599680 00000100:00100000:2.0:1763334980.718221:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694599680 00000100:00100000:2.0:1763334980.718315:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1887 00000100:00100000:2.0:1763334980.718339:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694599680:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334980.718396:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c87e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.718416:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.718419:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.718426:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c87e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.718442:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c87e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.724857:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c87e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.724881:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c87e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.724891:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c87e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.724898:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334980.724903:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c87e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.724912:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c87e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.724933:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c87e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.724940:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c87e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334980.725061:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694599680:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 6728us (7112us total) trans 0 rc 158406/158406 00000100:00100000:2.0:1763334980.725072:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1887 00000100:00100000:1.0:1763334980.791414:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.792154:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694599808 00000100:00100000:0.0:1763334980.792177:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694599808 00000100:00100000:0.0:1763334980.792272:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5052 00000100:00100000:0.0:1763334980.792286:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694599808:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334980.792311:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334980.792355:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c885 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0450 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334980.792394:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 158406, mtime: 0x691a5b44, atime: 0x691a5b44, ctime: 0x691a5b45, blocks: 0x79 00010000:00010000:0.0:1763334980.792424:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334980.792427:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334980.792440:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c885 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0450 expref: 24 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334980.792467:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c885 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0450 expref: 24 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334980.792484:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334980.792625:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa746680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694599808:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 342us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.792633:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5052 00000100:00100000:1.0:1763334980.797744:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.797854:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694599936 00000100:00100000:2.0:1763334980.797870:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694599936 00000100:00100000:2.0:1763334980.797967:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1888 00000100:00100000:2.0:1763334980.797987:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694599936:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334980.798045:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c88c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.798067:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.798070:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.798078:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c88c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.798095:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c88c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.808442:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c88c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.808468:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c88c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.808478:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c88c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.808486:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334980.808492:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c88c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.808512:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c88c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.808540:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c88c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.808548:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c88c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334980.809855:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694599936:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 11865us (12114us total) trans 0 rc 158406/158406 00000100:00100000:2.0:1763334980.809870:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1888 00000100:00100000:1.0:1763334980.819754:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.819879:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694600064 00000100:00100000:2.0:1763334980.819894:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694600064 00000100:00100000:2.0:1763334980.820019:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1889 00000100:00100000:2.0:1763334980.820033:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694600064:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:2.0:1763334980.820103:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 158406, mtime: 0x691a5b44, atime: 0x691a5b44, ctime: 0x691a5b45, blocks: 0x203 00010000:00010000:2.0:1763334980.820114:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c893 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.820133:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.820136:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.820142:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c893 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.820158:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c893 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.825706:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c893 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.825733:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c893 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.825743:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.825752:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334980.825757:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c893 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.825768:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c893 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.825794:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c893 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.825802:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c893 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->159743] (req 0->159743) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334980.825935:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694600064:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 5898us (6191us total) trans 0 rc 158406/158406 00000100:00100000:2.0:1763334980.825948:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1889 00000100:00100000:1.0:1763334980.838919:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.840765:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694600192 00000100:00100000:0.0:1763334980.840788:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694600192 00000100:00100000:0.0:1763334980.840908:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 408 00000100:00100000:0.0:1763334980.840921:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53656:x1848989694600192:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:0.0:1763334980.840945:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334980.840993:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849c869 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0449 expref: 202 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.841030:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334980.841037:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334980.841133:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53656:x1848989694600192:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 214us (2230us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.841141:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 408 00000100:00100000:1.0:1763334980.847380:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.847605:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694600448 00000100:00100000:0.0:1763334980.847620:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694600448 00000100:00100000:0.0:1763334980.848188:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1806 00000100:00100000:0.0:1763334980.848204:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53656:x1848989694600448:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334980.848608:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53656:x1848989694600448:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 407us (1243us total) trans 8589939163 rc 0/0 00000100:00100000:0.0:1763334980.848618:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1806 00000100:00100000:3.0:1763334980.854031:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.854176:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694600704 00000100:00100000:2.0:1763334980.854190:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694600704 00000100:00100000:2.0:1763334980.854280:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4959 00000100:00100000:2.0:1763334980.854293:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53644:x1848989694600704:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334980.854325:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334980.854354:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c89a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0457 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.854486:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334980.854518:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c807 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0418 expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.854529:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334980.854618:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c807 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0418 expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.854634:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c807 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0418 expref: 203 pid: 29628 timeout: 1145 lvb_type: 0 00000100:00100000:2.0:1763334980.854649:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701879808:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334980.854757:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bf9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334980.862554:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.863070:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701879808:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334980.863112:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:0.0:1763334980.863377:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694600832 00000100:00100000:0.0:1763334980.863388:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694600832 00010000:00010000:0.0:1763334980.863439:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c807 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0418 expref: 204 pid: 29628 timeout: 1145 lvb_type: 0 00000100:00100000:0.0:1763334980.863486:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2644 00000100:00100000:0.0:1763334980.863499:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2359:x1848989694600832:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334980.863517:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334980.863526:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c807 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0418 expref: 204 pid: 29628 timeout: 1145 lvb_type: 0 00010000:00010000:0.0:1763334980.863538:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c807 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0418 expref: 204 pid: 29628 timeout: 1145 lvb_type: 0 00010000:00010000:0.0:1763334980.863595:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849c807 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0418 expref: 204 pid: 29628 timeout: 1145 lvb_type: 0 00010000:00010000:0.0:1763334980.863615:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334980.863620:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334980.863631:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334980.863640:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334980.863674:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334980.863902:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.863910:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:1.0:1763334980.863931:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 158406 00010000:00010000:1.0:1763334980.864124:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c89a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0457 expref: 205 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.864144:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0457 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.864151:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334980.864154:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334980.864157:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430e00, rc 0) 00000100:00100000:0.0:1763334980.866711:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2359:x1848989694600832:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 3195us (4143us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.866730:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2644 00000100:00100000:1.0:1763334980.867319:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694600704:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 13024us (13303us total) trans 8589939164 rc 0/0 00000100:00100000:1.0:1763334980.867330:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4959 00000100:00100000:1.0:1763334980.872962:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.873287:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694600960 00000100:00100000:2.0:1763334980.873300:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694600960 00000100:00100000:2.0:1763334980.873378:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4960 00000100:00100000:2.0:1763334980.873389:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694600960:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334980.873421:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334980.873449:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c8af lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b045e expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.873560:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c8b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334980.873619:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0457 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.873630:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c8b6 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334980.873676:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0457 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.873692:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0457 expref: 204 pid: 29628 timeout: 1145 lvb_type: 0 00000100:00100000:2.0:1763334980.873706:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701879936:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334980.873813:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bf9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334980.880792:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.881712:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809d180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701879936:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334980.881751:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c8b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334980.881916:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694601088 00000100:00100000:1.0:1763334980.881926:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694601088 00010000:00010000:1.0:1763334980.881988:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0457 expref: 205 pid: 29628 timeout: 1145 lvb_type: 0 00000100:00100000:1.0:1763334980.882033:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2645 00000100:00100000:1.0:1763334980.882044:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+205:2360:x1848989694601088:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334980.882065:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334980.882072:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0457 expref: 205 pid: 29628 timeout: 1145 lvb_type: 0 00010000:00010000:1.0:1763334980.882086:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0457 expref: 205 pid: 29628 timeout: 1145 lvb_type: 0 00010000:00010000:1.0:1763334980.882817:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c8a1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0457 expref: 205 pid: 29628 timeout: 1145 lvb_type: 0 00010000:00010000:1.0:1763334980.882849:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334980.882855:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c8b6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.882868:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.882877:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c8b6 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.883022:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334980.883434:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334980.883450:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334980.883591:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 158406 00000004:00200000:2.0:1763334980.883597:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334980.883623:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c8b6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334980.883664:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849c8af lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b045e expref: 205 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.883683:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c8b6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b045e expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.883690:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334980.883693:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334980.883696:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:1.0:1763334980.887463:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2360:x1848989694601088:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5398us (6663us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334980.887485:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2645 00000100:00100000:2.0:1763334980.887781:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694600960:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 14391us (14830us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.887791:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4960 00000100:00100000:0.0:1763334980.893021:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.893717:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.895148:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694601216 00000100:00100000:2.0:1763334980.895166:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694601216 00000100:00100000:2.0:1763334980.895232:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694601344 00000100:00100000:2.0:1763334980.895237:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694601344 00000100:00100000:2.0:1763334980.895286:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5053 00000100:00100000:2.0:1763334980.895298:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694601216:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334980.895322:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334980.895352:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c8bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0465 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334980.895384:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 158406, mtime: 0x691a5b44, atime: 0x691a5b44, ctime: 0x691a5b45, blocks: 0x203 00010000:00010000:2.0:1763334980.895411:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.895413:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334980.895424:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c8bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0465 expref: 25 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.895445:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c8bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0465 expref: 25 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.895460:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431000, rc 0) 00000100:00100000:2.0:1763334980.895540:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694601216:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 244us (2566us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334980.895547:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5053 00000100:00100000:2.0:1763334980.895587:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5054 00000100:00100000:2.0:1763334980.895597:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694601344:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334980.895605:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334980.895618:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c8c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b046c expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334980.895674:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701880064:192.168.201.60@tcp:106: 00000100:00100000:2.0:1763334980.895740:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bf9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334980.899522:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701880064:192.168.201.60@tcp:106: 00010000:00010000:2.0:1763334980.899652:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c8c4 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b046c expref: 23 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.899689:0:32239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c8c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b046c expref: 23 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334980.899704:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431a00, rc 0) 00000100:00100000:2.0:1763334980.899779:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694601344:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 4182us (6064us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334980.899789:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5054 00000100:00100000:2.0:1763334980.903741:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.904857:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694601600 00000100:00100000:1.0:1763334980.904873:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694601600 00000100:00100000:1.0:1763334980.904956:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4961 00000100:00100000:1.0:1763334980.904968:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694601600:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:1.0:1763334980.905053:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334980.905090:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c8b6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b045e expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.905115:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334980.905122:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334980.911504:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c8cb lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.911531:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c8cb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.911545:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c8cb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000001:00080000:1.0:1763334980.911738:0:29628:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939165 00000004:00010000:1.0:1763334980.911804:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fc9db202 reply state 0000000006574267 transno 8589939166 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c8cb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334980.911816:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334980.911961:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694601600:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 6989us (8228us total) trans 8589939166 rc 0/0 00000100:00100000:1.0:1763334980.911971:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4961 00000020:00080000:1.0:1763334980.911990:0:29628:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763334980.916510:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c8cb lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.916539:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c8cb lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.916550:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c8cb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.916557:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334980.916565:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c8cb lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.916629:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c8cb lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.916655:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334980.916660:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334980.916667:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c8cb lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.916679:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849c8cb lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334980.918291:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.918531:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694601856 00000100:00100000:0.0:1763334980.918547:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694601856 00000100:00100000:0.0:1763334980.918653:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1807 00000100:00100000:0.0:1763334980.918667:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53644:x1848989694601856:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:0.0:1763334980.919019:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694601856:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 354us (740us total) trans 8589939167 rc 0/0 00000100:00100000:0.0:1763334980.919028:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1807 00000100:00100000:0.0:1763334980.922147:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334980.922323:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694602112 00000100:00100000:1.0:1763334980.922400:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694602112 00000100:00100000:1.0:1763334980.922475:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4962 00000100:00100000:1.0:1763334980.922486:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694602112:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334980.922515:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334980.922519:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1763334980.922554:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c815 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b041f expref: 205 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.922711:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c7e4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0411 expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.926102:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334980.926131:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334980.926173:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c8d2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0473 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.926260:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c8d9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.926278:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c8d9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334980.926295:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c8d9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000040:00080000:1.0:1763334980.927040:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1164, 88 off99624 00000004:00080000:1.0:1763334980.927059:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1045560486044ns, next at 1040839994511ns, rc = 0 00000040:00080000:1.0:1763334980.927142:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1154, 88 off98568 00000004:00080000:1.0:1763334980.927149:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1045560577299ns, next at 1040839334561ns, rc = 0 00000040:00080000:1.0:1763334980.927186:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1155, 88 off98656 00000004:00080000:1.0:1763334980.927193:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1045560621079ns, next at 1040839334561ns, rc = 0 00000040:00080000:1.0:1763334980.927209:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1165, 88 off99712 00000004:00080000:1.0:1763334980.927214:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1045560642199ns, next at 1040839994511ns, rc = 0 00000040:00080000:1.0:1763334980.927230:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1166, 88 off99800 00000004:00080000:1.0:1763334980.927235:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1045560662629ns, next at 1040839994511ns, rc = 0 00000040:00080000:1.0:1763334980.927250:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1156, 88 off98744 00000004:00080000:1.0:1763334980.927255:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1045560683109ns, next at 1040839334561ns, rc = 0 00000040:00080000:1.0:1763334980.927269:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1157, 88 off98832 00000004:00080000:1.0:1763334980.927274:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1045560701879ns, next at 1040839334561ns, rc = 0 00000040:00080000:1.0:1763334980.927289:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1167, 88 off99888 00000004:00080000:1.0:1763334980.927294:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1045560721899ns, next at 1040839994511ns, rc = 0 00000040:00080000:1.0:1763334980.927309:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1168, 88 off99976 00000004:00080000:1.0:1763334980.927313:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1045560741044ns, next at 1040839994511ns, rc = 0 00000040:00080000:1.0:1763334980.927327:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1158, 88 off98920 00000004:00080000:1.0:1763334980.927330:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1045560758731ns, next at 1040839334561ns, rc = 0 00000001:00080000:1.0:1763334980.971598:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939167 is committed 00000020:00080000:1.0:1763334980.971640:0:29660:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a5afc8ee300 refcount 2 committed 0 result 0 batchid 4294969317 00000020:00080000:1.0:1763334980.971648:0:29660:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5aee99e000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a5ad830c6c0 00000020:00080000:1.0:1763334980.971652:0:29660:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5ac4808500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a5afc8eef00 00000020:00080000:1.0:1763334980.971655:0:29660:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5ac4808200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a59cd21b000 00000020:00080000:1.0:1763334980.971659:0:29660:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].11 00000001:00080000:1.0:1763334980.971681:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939168 is committed 00000004:00080000:1.0:1763334980.971688:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 768 committed 00000004:00080000:1.0:1763334980.971699:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 780 committed 00000020:00080000:0.0:1763334980.971700:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969317 committed batchid 4294969316 00000004:00080000:1.0:1763334980.971707:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 779 committed 00000004:00080000:1.0:1763334980.971709:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 767 committed 00000004:00080000:1.0:1763334980.971711:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 766 committed 00000004:00080000:1.0:1763334980.971713:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 778 committed 00000004:00080000:1.0:1763334980.971715:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 777 committed 00000004:00080000:1.0:1763334980.971717:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 765 committed 00000004:00080000:1.0:1763334980.971721:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 764 committed 00000004:00080000:1.0:1763334980.971724:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 776 committed 00000020:00080000:0.0:1763334980.971911:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969316 00000100:00100000:1.0:1763334980.971932:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701880320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334980.972033:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334980.972083:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701880832:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334980.972090:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701880320 00000100:00100000:0.0:1763334980.972099:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701880320 00000100:00100000:1.0:1763334980.972106:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334980.972120:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701881344:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334980.972136:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1763334980.972229:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c8d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0473 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.972245:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:2.0:1763334980.972248:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334980.972270:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849c8d2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0473 expref: 189 pid: 29628 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1763334980.972289:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c8d9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0473 expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334980.972326:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:2.0:1763334980.972328:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1763334980.972331:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:2.0:1763334980.972390:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694602112:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 49906us (50258us total) trans 8589939168 rc 0/0 00000100:00100000:2.0:1763334980.972399:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4962 00000100:00100000:3.0:1763334980.972634:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701880192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334980.972675:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701880576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334980.977045:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701880832 00000100:00100000:0.0:1763334980.977068:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701880832 00000100:00100000:1.0:1763334980.977107:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1763334980.977126:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701880448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334980.977142:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701881344 00000100:00100000:0.0:1763334980.977146:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701881344 00000100:00100000:0.0:1763334980.977175:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5055 00000100:00100000:0.0:1763334980.977186:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3291:x1848989701880320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334980.977202:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334980.977223:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701880960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334980.977242:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1763334980.977473:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334980.977478:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334980.977481:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334980.977483:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:0.0:1763334980.977485:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334980.977526:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+15:3291:x1848989701880320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 342us (5494us total) trans 21474838474 rc 0/0 00000100:00100000:0.0:1763334980.977534:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5055 00000004:00080000:1.0:1763334980.977874:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa744000/2, rc 0, transno 21474838474 00000100:00100000:1.0:1763334980.977881:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa744000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701880320:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334980.977897:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701880448 00000100:00100000:2.0:1763334980.977901:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701880448 00000100:00100000:0.0:1763334980.977905:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701880960 00000100:00100000:0.0:1763334980.977908:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701880960 00000100:00100000:3.0:1763334980.977952:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5056 00000100:00100000:3.0:1763334980.977962:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701880832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334980.978127:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 158406 -> 158406 00002000:00010000:3.0:1763334980.978130:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334980.978133:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334980.978135:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:3.0:1763334980.978137:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 121 -> 121 00000100:00100000:3.0:1763334980.978170:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701880832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 211us (6063us total) trans 17179871218 rc 0/0 00000100:00100000:3.0:1763334980.978177:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5056 00000100:00100000:3.0:1763334980.978192:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5057 00000100:00100000:3.0:1763334980.978198:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701881344:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334980.978297:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 158406 -> 158406 00002000:00010000:3.0:1763334980.978300:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334980.978302:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334980.978305:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:3.0:1763334980.978307:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334980.978332:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701881344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (6195us total) trans 17179871219 rc 0/0 00000100:00100000:3.0:1763334980.978339:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5057 00000100:00100000:3.0:1763334980.978352:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5058 00000100:00100000:3.0:1763334980.978358:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3291:x1848989701880448:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334980.978442:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334980.978446:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334980.978448:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334980.978450:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334980.978453:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x249:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334980.978477:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701880448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 120us (1276us total) trans 21474838475 rc 0/0 00000100:00100000:3.0:1763334980.978483:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5058 00000100:00100000:3.0:1763334980.978496:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5059 00000100:00100000:3.0:1763334980.978503:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701880960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334980.978606:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334980.978610:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334980.978612:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334980.978614:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:3.0:1763334980.978616:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334980.978642:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701880960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 138us (1397us total) trans 17179871220 rc 0/0 00000100:00100000:3.0:1763334980.978648:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5059 00000100:00100000:3.0:1763334980.978680:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334980.978710:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701881088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334980.978735:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334980.978767:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701880576 00000100:00100000:3.0:1763334980.978772:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701880576 00000100:00100000:3.0:1763334980.978795:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701881088 00000100:00100000:3.0:1763334980.978797:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701881088 00000100:00100000:3.0:1763334980.978807:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5060 00000100:00100000:3.0:1763334980.978812:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3289:x1848989701880576:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334980.978882:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 217778 -> 217778 00002000:00010000:3.0:1763334980.978885:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334980.978887:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334980.978889:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334980.978891:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334980.978916:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701880576:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (235us total) trans 21474838476 rc 0/0 00000100:00100000:3.0:1763334980.978920:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5060 00000100:00100000:3.0:1763334980.978931:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5061 00000100:00100000:3.0:1763334980.978936:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701881088:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334980.979027:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb size from disk: 217778 -> 217778 00002000:00010000:3.0:1763334980.979031:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334980.979033:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334980.979035:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334980.979037:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24d:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334980.979057:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701881088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (321us total) trans 17179871221 rc 0/0 00000100:00100000:3.0:1763334980.979062:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5061 00000100:00100000:3.0:1763334980.979079:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334980.979100:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701880704:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334980.979117:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334980.979124:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701881216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334980.979137:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1763334980.979163:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d6d80/2, rc 0, transno 21474838476 00000100:00100000:3.0:1763334980.979168:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701880576:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334980.979177:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5574e00/2, rc 0, transno 17179871221 00000100:00100000:3.0:1763334980.979181:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5574e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701881088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334980.979190:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701880192 00000100:00100000:3.0:1763334980.979193:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701880192 00000100:00100000:3.0:1763334980.979205:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701880704 00000100:00100000:3.0:1763334980.979207:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701880704 00000100:00100000:3.0:1763334980.979216:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701881216 00000100:00100000:3.0:1763334980.979218:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701881216 00000100:00100000:3.0:1763334980.979230:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5062 00000004:00080000:1.0:1763334980.979503:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d6a00/2, rc 0, transno 17179871218 00000100:00100000:1.0:1763334980.979508:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701880832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334980.979517:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5577800/2, rc 0, transno 17179871219 00000100:00100000:1.0:1763334980.979521:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5577800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701881344:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334980.979534:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d5c00/2, rc 0, transno 21474838475 00000100:00100000:1.0:1763334980.979538:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701880448:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334980.979545:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5576d80/2, rc 0, transno 17179871220 00000100:00100000:1.0:1763334980.979548:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5576d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701880960:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334980.980028:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+18:3290:x1848989701880192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334980.980165:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334980.980168:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334980.980171:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334980.980174:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334980.980176:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334980.980233:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3290:x1848989701880192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (1151us total) trans 21474838477 rc 0/0 00000100:00100000:1.0:1763334980.980493:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5063 00000100:00100000:1.0:1763334980.980504:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3290:x1848989701880704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334980.980528:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5062 00000100:00100000:2.0:1763334980.980553:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5064 00000100:00100000:2.0:1763334980.980564:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+10:3290:x1848989701881216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763334980.980689:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334980.980692:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334980.980694:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334980.980697:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:2.0:1763334980.980699:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:2.0:1763334980.980737:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3290:x1848989701881216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (1598us total) trans 17179871222 rc 0/0 00000100:00100000:2.0:1763334980.980744:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5064 00002000:00010000:1.0:1763334980.980933:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334980.980937:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334980.980939:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334980.980941:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:1.0:1763334980.980943:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334980.980974:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+19:3290:x1848989701880704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 472us (1855us total) trans 21474838478 rc 0/0 00000100:00100000:1.0:1763334980.980993:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5063 00000100:00100000:0.0:1763334980.982321:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000004:00080000:2.0:1763334980.983084:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa745500/2, rc 0, transno 21474838477 00000100:00100000:2.0:1763334980.983095:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701880192:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334980.983107:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d4000/2, rc 0, transno 21474838478 00000100:00100000:2.0:1763334980.983110:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701880704:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334980.983121:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5575f80/2, rc 0, transno 17179871222 00000100:00100000:2.0:1763334980.983126:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5575f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701881216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334980.983274:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694602240 00000100:00100000:3.0:1763334980.983284:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694602240 00000100:00100000:3.0:1763334980.983353:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5065 00000100:00100000:3.0:1763334980.983362:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:53644:x1848989694602240:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334980.983381:0:7819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334980.983404:0:7819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c8e0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b047a expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.983441:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c885 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0450 expref: 26 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334980.983451:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334980.983454:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334980.983459:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c8e0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b047a expref: 26 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.983502:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c885 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0450 expref: 26 pid: 32241 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334980.983517:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c885 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0450 expref: 26 pid: 32241 timeout: 1145 lvb_type: 1 00000100:00100000:3.0:1763334980.983533:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeecea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701881472:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334980.983657:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac57b50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334980.985872:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334980.985971:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeecea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701881472:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334980.986022:0:7819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c8e0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b047a expref: 26 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334980.986044:0:7819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:3.0:1763334980.986102:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:53644:x1848989694602240:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 2741us (3791us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334980.986111:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5065 00000100:00100000:1.0:1763334980.990377:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694602368 00000100:00100000:1.0:1763334980.990399:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694602368 00010000:00010000:1.0:1763334980.990489:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c885 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0450 expref: 26 pid: 32241 timeout: 1145 lvb_type: 1 00000100:00100000:1.0:1763334980.990551:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2646 00000100:00100000:1.0:1763334980.990563:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694602368:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334980.990618:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334980.990645:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c885 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0450 expref: 26 pid: 32241 timeout: 1145 lvb_type: 1 00010000:00010000:1.0:1763334980.990667:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c885 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0450 expref: 26 pid: 32241 timeout: 1145 lvb_type: 1 00010000:00010000:1.0:1763334980.990697:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849c885 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0450 expref: 26 pid: 32241 timeout: 1145 lvb_type: 1 00010000:00010000:1.0:1763334980.990719:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.990721:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334980.990730:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b047a expref: 25 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334980.990740:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c8e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b047a expref: 25 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334980.990848:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c8e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b047a expref: 25 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334980.990865:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a22a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701881600:192.168.201.60@tcp:105: 00000100:00100000:0.0:1763334980.991511:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b980c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334980.994213:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a22a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701881600:192.168.201.60@tcp:105: 00010000:00010000:0.0:1763334980.994248:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334980.994323:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694602368:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 3760us (8459us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334980.994336:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2646 00000100:00100000:2.0:1763334980.995223:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.995259:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334980.995281:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334980.995364:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694602496 00000100:00100000:0.0:1763334980.995374:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694602496 00002000:00010000:0.0:1763334980.995429:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (221333->18446744073709551615) 00002000:00100000:0.0:1763334980.995435:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77f100 with x1848989694602496 ext(221333->18446744073709551615) 00002000:00010000:0.0:1763334980.995463:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77f100. 00000100:00100000:0.0:1763334980.995492:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694602752 00000100:00100000:0.0:1763334980.995496:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694602752 00002000:00010000:0.0:1763334980.995508:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334980.995512:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77d180 with x1848989694602752 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334980.995518:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77d180. 00000100:00100000:0.0:1763334980.995531:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694602624 00000100:00100000:0.0:1763334980.995534:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694602624 00002000:00010000:0.0:1763334980.995546:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334980.995549:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77ce00 with x1848989694602624 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334980.995555:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa77ce00. 00000100:00100000:0.0:1763334980.995603:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1890 00000100:00100000:0.0:1763334980.995613:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694602496:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334980.995903:0:25999:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 158406 -> 221333 00002000:00010000:0.0:1763334980.995908:0:25999:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334980 -> 1763334981 00002000:00010000:0.0:1763334980.995911:0:25999:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334980.995913:0:25999:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:0.0:1763334980.995920:0:25999:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 121 -> 121 00000100:00100000:2.0:1763334980.995966:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1891 00000100:00100000:0.0:1763334980.995993:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694602496:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 378us (773us total) trans 17179871223 rc 0/0 00000100:00100000:2.0:1763334980.995994:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694602752:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:0.0:1763334980.996008:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1890 00002000:00010000:0.0:1763334980.996014:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (221333->18446744073709551615) 00002000:00100000:0.0:1763334980.996017:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77f100 with x1848989694602496 ext(221333->18446744073709551615) 00002000:00010000:0.0:1763334980.996022:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77f100. 00000100:00100000:0.0:1763334980.996045:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1892 00000100:00100000:0.0:1763334980.996053:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694602624:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334980.996152:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334980.996156:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334980 -> 1763334981 00002000:00010000:2.0:1763334980.996160:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334980.996162:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:2.0:1763334980.996165:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334980.996193:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694602752:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 217us (932us total) trans 17179871224 rc 0/0 00000100:00100000:2.0:1763334980.996201:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1891 00002000:00010000:2.0:1763334980.996205:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:2.0:1763334980.996208:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77d180 with x1848989694602752 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334980.996213:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77d180. 00002000:00010000:0.0:1763334980.996226:0:25999:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334980.996231:0:25999:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334980 -> 1763334981 00002000:00010000:0.0:1763334980.996235:0:25999:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334980.996238:0:25999:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:0.0:1763334980.996240:0:25999:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334980.996267:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694602624:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 215us (984us total) trans 21474838479 rc 0/0 00000100:00100000:0.0:1763334980.996275:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1892 00002000:00010000:0.0:1763334980.996279:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334980.996282:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77ce00 with x1848989694602624 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334980.996288:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa77ce00. 00000100:00100000:1.0:1763334981.002393:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.002525:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694602880 00000100:00100000:3.0:1763334981.002540:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694602880 00002000:00100000:3.0:1763334981.002670:0:21629:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x24a:0x0] (180224->184319) req@ffff9a5ac5575880 x1848989694602880/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:27/0 lens 488/0 e 0 to 0 dl 1763334992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334981.002684:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5575880 with x1848989694602880 ext(180224->184319) 00002000:00010000:3.0:1763334981.002691:0:21629:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5575880 00000100:00100000:3.0:1763334981.002723:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1893 00000100:00100000:3.0:1763334981.002735:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694602880:12345-192.168.201.60@tcp:3:lfs.0 00000100:00080000:2.0:1763334981.002849:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1763334981.003055:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694602880:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 322us (673us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763334981.003065:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1893 00002000:00100000:3.0:1763334981.003074:0:21629:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x24a:0x0] (180224->184319) req@ffff9a5ac5575880 x1848989694602880/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:27/0 lens 488/4536 e 0 to 0 dl 1763334992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334981.003082:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5575880 with x1848989694602880 ext(180224->184319) 00002000:00010000:3.0:1763334981.003086:0:21629:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5575880 00000100:00100000:0.0:1763334981.011136:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.011263:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694603008 00000100:00100000:3.0:1763334981.011278:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694603008 00002000:00100000:3.0:1763334981.011344:0:21630:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x24a:0x0] (184320->188415) req@ffff9a5af6a20000 x1848989694603008/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:27/0 lens 488/0 e 0 to 0 dl 1763334992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334981.011356:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a20000 with x1848989694603008 ext(184320->188415) 00002000:00010000:3.0:1763334981.011363:0:21630:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a20000 00000100:00100000:3.0:1763334981.011404:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1894 00000100:00100000:3.0:1763334981.011415:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694603008:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:2.0:1763334981.012826:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694603008:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 1402us (1696us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763334981.012849:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1894 00002000:00100000:2.0:1763334981.012860:0:21630:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x24a:0x0] (184320->188415) req@ffff9a5af6a20000 x1848989694603008/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:27/0 lens 488/4536 e 0 to 0 dl 1763334992 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334981.012871:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a20000 with x1848989694603008 ext(184320->188415) 00002000:00010000:2.0:1763334981.012878:0:21630:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a20000 00000100:00100000:2.0:1763334981.016055:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.016144:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694603136 00000100:00100000:0.0:1763334981.016157:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694603136 00002000:00100000:0.0:1763334981.016220:0:21630:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x24a:0x0] (159744->225279) req@ffff9a5afa77d500 x1848989694603136/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:27/0 lens 504/0 e 0 to 0 dl 1763334992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334981.016231:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77d500 with x1848989694603136 ext(159744->225279) 00002000:00010000:0.0:1763334981.016239:0:21630:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77d500 00000100:00100000:0.0:1763334981.016272:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1895 00000100:00100000:0.0:1763334981.016284:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694603136:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:0.0:1763334981.021358:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694603136:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 5058us (5298us total) trans 0 rc 57344/57344 00000100:00100000:0.0:1763334981.021379:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1895 00002000:00100000:0.0:1763334981.021396:0:21630:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x24a:0x0] (159744->225279) req@ffff9a5afa77d500 x1848989694603136/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:27/0 lens 504/440 e 0 to 0 dl 1763334992 ref 1 fl Complete:/600/0 rc 57344/57344 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334981.021408:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77d500 with x1848989694603136 ext(159744->225279) 00002000:00010000:0.0:1763334981.021417:0:21630:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77d500 00000100:00100000:2.0:1763334981.033001:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.036485:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694603264 00000100:00100000:0.0:1763334981.036510:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694603264 00002000:00100000:0.0:1763334981.036652:0:21630:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x24a:0x0] (180224->221332) req@ffff9a5afa77d880 x1848989694603264/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:27/0 lens 488/0 e 0 to 0 dl 1763334992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334981.036666:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77d880 with x1848989694603264 ext(180224->221332) 00002000:00010000:0.0:1763334981.036675:0:21630:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77d880 00000100:00100000:0.0:1763334981.036731:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1896 00000100:00100000:0.0:1763334981.036743:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694603264:12345-192.168.201.60@tcp:4:lfs.0 00000100:00100000:0.0:1763334981.040228:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694603264:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 3472us (7239us total) trans 17179871225 rc 0/0 00000100:00100000:0.0:1763334981.040245:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1896 00002000:00100000:0.0:1763334981.040260:0:21630:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x24a:0x0] (180224->221332) req@ffff9a5afa77d880 x1848989694603264/t17179871225(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:27/0 lens 488/448 e 0 to 0 dl 1763334992 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334981.040278:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77d880 with x1848989694603264 ext(180224->221332) 00002000:00010000:0.0:1763334981.040286:0:21630:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77d880 00000100:00100000:1.0:1763334981.044642:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.044799:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694603392 00000100:00100000:3.0:1763334981.044815:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694603392 00000100:00100000:3.0:1763334981.044890:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5066 00000100:00100000:3.0:1763334981.044903:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2362:x1848989694603392:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:3.0:1763334981.104895:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871225 is committed 00000001:00080000:3.0:1763334981.104934:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871217 is committed 00000001:00080000:3.0:1763334981.104957:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871222 is committed 00000100:00100000:3.0:1763334981.105154:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694603392:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 60245us (60518us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334981.105170:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5066 00000100:00100000:2.0:1763334981.108073:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.108196:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694603520 00000100:00100000:3.0:1763334981.108212:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694603520 00000100:00100000:3.0:1763334981.108317:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4963 00000100:00100000:3.0:1763334981.108331:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694603520:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334981.108366:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334981.108400:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c8e7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0481 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.108527:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c8ee lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.108546:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c8ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.108561:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c8ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:3.0:1763334981.108625:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 221335 00000004:00200000:3.0:1763334981.108631:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334981.108654:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c8ee lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.108688:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c8e7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0481 expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.108709:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c8ee lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0481 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.108719:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:3.0:1763334981.108723:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334981.108728:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:3.0:1763334981.108804:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694603520:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 477us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334981.108812:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4963 00000100:00080000:2.0:1763334981.108959:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1763334981.116827:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.117523:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694603776 00000100:00100000:0.0:1763334981.117539:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694603776 00000100:00100000:0.0:1763334981.117664:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4964 00000100:00100000:0.0:1763334981.117675:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694603776:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:0.0:1763334981.117745:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1763334981.117777:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849c8ee lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0481 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.117800:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849c8d9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0473 expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.117811:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:0.0:1763334981.117823:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334981.118201:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c8f5 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.118217:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c8f5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.118228:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c8f5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:0.0:1763334981.118291:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939169 00000004:00010000:0.0:1763334981.118320:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000005487b6c4 reply state 0000000099c182cb transno 8589939170 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c8f5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334981.118329:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334981.118457:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694603776:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 781us (1643us total) trans 8589939170 rc 0/0 00000100:00100000:0.0:1763334981.118465:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4964 00000020:00080000:0.0:1763334981.118471:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1763334981.122110:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c8f5 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.122132:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c8f5 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.122140:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c8f5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.122147:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334981.122152:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c8f5 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.122160:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c8f5 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.122182:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60d00) 00010000:00010000:2.0:1763334981.122185:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334981.122191:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c8f5 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.122197:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849c8f5 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334981.122541:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.122655:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694603904 00000100:00100000:3.0:1763334981.122669:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694603904 00000100:00100000:3.0:1763334981.122730:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4965 00000100:00100000:3.0:1763334981.122741:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694603904:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334981.122771:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334981.122795:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c8fc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0488 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.122865:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c8fc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0488 expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.122880:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c8fc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0488 expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.122899:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:3.0:1763334981.122902:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334981.122905:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:3.0:1763334981.122982:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694603904:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 234us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334981.122990:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4965 00000100:00100000:0.0:1763334981.127712:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.127755:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.127791:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.127874:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694604032 00000100:00100000:1.0:1763334981.127898:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694604032 00002000:00010000:1.0:1763334981.127959:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (25972->18446744073709551615) 00002000:00100000:1.0:1763334981.127965:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a22a00 with x1848989694604032 ext(25972->18446744073709551615) 00002000:00010000:1.0:1763334981.127990:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a22a00. 00000100:00100000:1.0:1763334981.128022:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694604160 00000100:00100000:1.0:1763334981.128025:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694604160 00002000:00010000:1.0:1763334981.128053:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334981.128056:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a20a80 with x1848989694604160 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334981.128063:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6a20a80. 00000100:00100000:1.0:1763334981.128075:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694604288 00000100:00100000:1.0:1763334981.128078:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694604288 00002000:00010000:1.0:1763334981.128088:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763334981.128090:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a20380 with x1848989694604288 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334981.128096:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a20380. 00000100:00100000:1.0:1763334981.128116:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1897 00000100:00100000:1.0:1763334981.128126:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694604032:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:3.0:1763334981.128257:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1898 00000100:00100000:3.0:1763334981.128270:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694604160:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:2.0:1763334981.128381:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1899 00000100:00100000:2.0:1763334981.128395:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694604288:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334981.128660:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334981.128665:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:3.0:1763334981.128668:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334981.128671:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:3.0:1763334981.128674:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1763334981.128704:0:21630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334981.128709:0:21630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:2.0:1763334981.128712:0:21630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334981.128715:0:21630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:2.0:1763334981.128717:0:21630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334981.128764:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694604288:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 372us (969us total) trans 17179871226 rc 0/0 00000100:00100000:2.0:1763334981.128773:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1899 00002000:00010000:2.0:1763334981.128779:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:2.0:1763334981.128782:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a20380 with x1848989694604288 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334981.128789:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a20380. 00002000:00010000:1.0:1763334981.129156:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 221333 -> 25972 00002000:00010000:1.0:1763334981.129159:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:1.0:1763334981.129162:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334981.129164:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:1.0:1763334981.129166:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 121 -> 211 00000100:00100000:1.0:1763334981.129202:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694604032:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 1077us (1507us total) trans 17179871227 rc 0/0 00000100:00100000:1.0:1763334981.129209:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1897 00002000:00010000:1.0:1763334981.129211:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (25972->18446744073709551615) 00002000:00100000:1.0:1763334981.129214:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a22a00 with x1848989694604032 ext(25972->18446744073709551615) 00002000:00010000:1.0:1763334981.129218:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a22a00. 00000100:00080000:1.0:1763334981.129238:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763334981.130467:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694604160:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 486us (996us total) trans 21474838480 rc 0/0 00000100:00100000:3.0:1763334981.130483:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1898 00002000:00010000:3.0:1763334981.130490:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:3.0:1763334981.130492:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a20a80 with x1848989694604160 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334981.130504:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6a20a80. 00000100:00100000:0.0:1763334981.135212:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.135329:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694604416 00000100:00100000:2.0:1763334981.135343:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694604416 00000100:00100000:2.0:1763334981.135423:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4966 00000100:00100000:2.0:1763334981.135436:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694604416:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334981.135465:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334981.135496:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c903 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b048f expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.136376:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c90a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.136402:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c90a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.136416:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c90a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334981.136514:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 25972 00000004:00200000:2.0:1763334981.136520:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334981.136543:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c90a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.136610:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c903 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b048f expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.136631:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c90a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b048f expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.136647:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:2.0:1763334981.136650:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334981.136654:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431a00, rc 0) 00000100:00100000:2.0:1763334981.137346:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694604416:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 1908us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334981.137357:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4966 00000100:00100000:2.0:1763334981.143778:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.144818:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694604672 00000100:00100000:0.0:1763334981.144838:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694604672 00000100:00100000:0.0:1763334981.144926:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4967 00000100:00100000:0.0:1763334981.144941:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694604672:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:0.0:1763334981.145023:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334981.145058:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c90a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b048f expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.145082:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:0.0:1763334981.145088:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334981.145462:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c911 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.145479:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c911 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.145490:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c911 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:0.0:1763334981.145550:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939171 00000004:00010000:0.0:1763334981.145632:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000053a9f164 reply state 000000004ba65d24 transno 8589939172 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c911 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334981.145648:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334981.145795:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53644:x1848989694604672:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 856us (2033us total) trans 8589939172 rc 0/0 00000100:00100000:0.0:1763334981.145803:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4967 00000020:00080000:0.0:1763334981.145810:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763334981.150616:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c911 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.150641:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c911 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.150652:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c911 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.150661:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334981.150683:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c911 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.150695:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c911 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.150721:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:1.0:1763334981.150725:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334981.150872:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c911 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.150881:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849c911 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334981.151884:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.152484:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.152816:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.152871:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694604800 00000100:00100000:3.0:1763334981.152884:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694604800 00002000:00010000:3.0:1763334981.152956:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (44229->18446744073709551615) 00002000:00100000:3.0:1763334981.152962:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bec380 with x1848989694604800 ext(44229->18446744073709551615) 00002000:00010000:3.0:1763334981.152993:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6bec380. 00000100:00100000:3.0:1763334981.153028:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694604928 00000100:00100000:3.0:1763334981.153032:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694604928 00000100:00100000:1.0:1763334981.153131:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694605056 00000100:00100000:1.0:1763334981.153136:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694605056 00000100:00100000:1.0:1763334981.153154:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1900 00000100:00100000:1.0:1763334981.153167:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694604800:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334981.154183:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 25972 -> 44229 00002000:00010000:1.0:1763334981.154189:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:1.0:1763334981.154192:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334981.154194:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:1.0:1763334981.154197:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 211 -> 211 00000100:00100000:1.0:1763334981.154268:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694604800:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 1101us (2392us total) trans 17179871228 rc 0/0 00000100:00100000:1.0:1763334981.154278:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1900 00002000:00010000:1.0:1763334981.154284:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (44229->18446744073709551615) 00002000:00100000:1.0:1763334981.154288:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bec380 with x1848989694604800 ext(44229->18446744073709551615) 00002000:00010000:1.0:1763334981.154294:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6bec380. 00002000:00010000:1.0:1763334981.154335:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763334981.154339:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fc000 with x1848989694605056 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334981.154345:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1fc000. 00002000:00010000:3.0:1763334981.154828:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:3.0:1763334981.154834:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bec700 with x1848989694604928 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334981.154842:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6bec700. 00000100:00100000:0.0:1763334981.156251:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1901 00000100:00100000:0.0:1763334981.156287:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694605056:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:1.0:1763334981.156442:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1902 00000100:00100000:1.0:1763334981.156673:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694604928:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334981.156937:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334981.156941:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:1.0:1763334981.156945:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334981.156947:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:1.0:1763334981.156949:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1763334981.157927:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334981.157936:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:0.0:1763334981.157949:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334981.157953:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:0.0:1763334981.157956:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334981.158794:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694605056:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 2513us (5965us total) trans 17179871229 rc 0/0 00000100:00100000:0.0:1763334981.158811:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1901 00002000:00010000:0.0:1763334981.158819:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334981.158823:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fc000 with x1848989694605056 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334981.158835:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1fc000. 00000100:00100000:1.0:1763334981.158935:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694604928:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 2480us (6451us total) trans 21474838481 rc 0/0 00000100:00100000:1.0:1763334981.158945:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1902 00002000:00010000:1.0:1763334981.158949:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334981.158952:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6bec700 with x1848989694604928 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334981.158960:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6bec700. 00000100:00100000:2.0:1763334981.164752:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.164909:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694605184 00000100:00100000:0.0:1763334981.164925:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694605184 00000100:00100000:0.0:1763334981.166061:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4968 00000100:00100000:0.0:1763334981.166084:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53644:x1848989694605184:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334981.166117:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334981.166149:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c918 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0496 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.166266:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c91f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.166284:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c91f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.166296:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c91f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334981.166330:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 44229 00000004:00200000:0.0:1763334981.166335:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334981.166358:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c91f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.166389:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c918 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0496 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.166412:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c91f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0496 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.166422:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:0.0:1763334981.166426:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334981.166430:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334981.166531:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53644:x1848989694605184:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 456us (1794us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334981.166540:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4968 00000100:00100000:3.0:1763334981.172119:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.172219:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694605440 00000100:00100000:0.0:1763334981.172234:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694605440 00000100:00100000:0.0:1763334981.172323:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4969 00000100:00100000:0.0:1763334981.172335:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53644:x1848989694605440:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:0.0:1763334981.172411:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334981.172447:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c91f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0496 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.172473:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:0.0:1763334981.172479:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334981.172829:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c926 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.172845:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c926 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.172856:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c926 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:0.0:1763334981.172919:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939173 00000004:00010000:0.0:1763334981.172946:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000b25c64e6 reply state 00000000e63e126d transno 8589939174 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c926 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334981.172956:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334981.173085:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeecea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694605440:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 751us (982us total) trans 8589939174 rc 0/0 00000100:00100000:0.0:1763334981.173094:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4969 00000020:00080000:0.0:1763334981.173101:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763334981.177234:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c926 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334981.177263:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c926 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334981.177271:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c926 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334981.177278:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334981.177284:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c926 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334981.177293:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c926 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334981.177318:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:3.0:1763334981.177322:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334981.177328:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c926 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334981.177335:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c926 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334981.178761:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.178988:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694605568 00000100:00100000:1.0:1763334981.179003:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694605568 00002000:00010000:1.0:1763334981.179060:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (166468->18446744073709551615) 00002000:00100000:1.0:1763334981.179066:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeeceb100 with x1848989694605568 ext(166468->18446744073709551615) 00002000:00010000:1.0:1763334981.179086:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeeceb100. 00000100:00100000:1.0:1763334981.179122:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1903 00000100:00100000:1.0:1763334981.179133:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694605568:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334981.179465:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 44229 -> 166468 00002000:00010000:1.0:1763334981.179471:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:1.0:1763334981.179474:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334981.179477:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:1.0:1763334981.179480:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 211 -> 211 00000100:00100000:1.0:1763334981.179568:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694605568:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 436us (819us total) trans 17179871230 rc 0/0 00000100:00100000:1.0:1763334981.179624:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1903 00002000:00010000:1.0:1763334981.179630:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (166468->18446744073709551615) 00002000:00100000:1.0:1763334981.179633:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeeceb100 with x1848989694605568 ext(166468->18446744073709551615) 00002000:00010000:1.0:1763334981.179638:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeeceb100. 00000100:00100000:2.0:1763334981.186500:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.187567:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.187622:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694605696 00000100:00100000:0.0:1763334981.187638:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694605696 00002000:00010000:0.0:1763334981.187702:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334981.187709:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fe680 with x1848989694605696 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334981.187727:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afb1fe680. 00000100:00100000:0.0:1763334981.187773:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1904 00000100:00100000:0.0:1763334981.187786:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694605696:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:1.0:1763334981.188148:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694605824 00000100:00100000:1.0:1763334981.188153:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694605824 00002000:00010000:1.0:1763334981.188174:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763334981.188179:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fca80 with x1848989694605824 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334981.188187:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1fca80. 00000100:00100000:3.0:1763334981.188801:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1905 00000100:00100000:3.0:1763334981.188817:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694605824:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334981.189089:0:25999:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334981.189093:0:25999:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:3.0:1763334981.189096:0:25999:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334981.189099:0:25999:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:3.0:1763334981.189102:0:25999:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:0.0:1763334981.189372:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334981.189376:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:0.0:1763334981.189379:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334981.189381:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:0.0:1763334981.189383:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334981.193127:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694605824:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 4293us (5546us total) trans 17179871231 rc 0/0 00000100:00100000:3.0:1763334981.193150:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1905 00002000:00010000:3.0:1763334981.193160:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:3.0:1763334981.193165:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fca80 with x1848989694605824 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334981.193181:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1fca80. 00000100:00100000:0.0:1763334981.193533:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694605696:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 5746us (7048us total) trans 21474838482 rc 0/0 00000100:00100000:0.0:1763334981.193544:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1904 00002000:00010000:0.0:1763334981.193548:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334981.193552:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fe680 with x1848989694605696 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334981.193560:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afb1fe680. 00000100:00100000:2.0:1763334981.197115:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.197217:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694605952 00000100:00100000:3.0:1763334981.197230:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694605952 00000100:00100000:0.0:1763334981.197724:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4970 00000100:00100000:1.0:1763334981.198077:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53644:x1848989694605952:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334981.198113:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334981.198144:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c92d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b049d expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.198260:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c934 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.198278:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c934 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.198292:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c934 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334981.198328:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 166468 00000004:00200000:1.0:1763334981.198335:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334981.198356:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c934 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.198390:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c92d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b049d expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.198412:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c934 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b049d expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.198422:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:1.0:1763334981.198425:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334981.198429:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334981.202232:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694605952:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 4476us (5115us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.202251:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4970 00000100:00100000:2.0:1763334981.214360:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.214550:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694606208 00000100:00100000:1.0:1763334981.214565:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694606208 00000100:00100000:1.0:1763334981.215013:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4971 00000100:00100000:1.0:1763334981.215029:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694606208:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:1.0:1763334981.215115:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334981.215154:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c934 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b049d expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.215180:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:1.0:1763334981.215185:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334981.215494:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c93b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.215512:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c93b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.215523:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c93b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:1.0:1763334981.217048:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939175 00000004:00010000:1.0:1763334981.218589:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d4b92f9a reply state 00000000c6eb4bb8 transno 8589939176 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c93b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334981.218611:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334981.218800:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53644:x1848989694606208:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 3769us (4453us total) trans 8589939176 rc 0/0 00000100:00100000:1.0:1763334981.218810:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4971 00000020:00080000:1.0:1763334981.218818:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763334981.223252:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c93b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.223275:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c93b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.223283:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c93b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.223290:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334981.223295:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c93b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.223304:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c93b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.223326:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:1.0:1763334981.223330:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334981.223336:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c93b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.223347:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c93b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334981.232135:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.232185:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.232220:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.232398:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694606336 00000100:00100000:3.0:1763334981.232410:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694606464 00000100:00100000:1.0:1763334981.232416:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694606336 00000100:00100000:3.0:1763334981.232419:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694606464 00000100:00100000:0.0:1763334981.232510:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694606592 00000100:00100000:0.0:1763334981.232516:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694606592 00002000:00010000:3.0:1763334981.232784:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:3.0:1763334981.232791:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1ff480 with x1848989694606464 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334981.232808:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afb1ff480. 00000100:00100000:3.0:1763334981.232853:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1906 00000100:00100000:3.0:1763334981.232864:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694606464:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334981.233194:0:25999:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334981.233198:0:25999:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:3.0:1763334981.233201:0:25999:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334981.233203:0:25999:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:3.0:1763334981.233205:0:25999:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334981.233285:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694606464:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 423us (1100us total) trans 21474838483 rc 0/0 00000100:00100000:3.0:1763334981.233294:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1906 00002000:00010000:3.0:1763334981.233299:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:3.0:1763334981.233301:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1ff480 with x1848989694606464 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334981.233306:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afb1ff480. 00002000:00010000:1.0:1763334981.240529:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (28883->18446744073709551615) 00002000:00100000:1.0:1763334981.240545:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fc700 with x1848989694606336 ext(28883->18446744073709551615) 00002000:00010000:1.0:1763334981.240563:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1fc700. 00000100:00100000:1.0:1763334981.240633:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1907 00000100:00100000:1.0:1763334981.240653:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694606336:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334981.241039:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 166468 -> 28883 00002000:00010000:1.0:1763334981.241044:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:1.0:1763334981.241047:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334981.241049:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:1.0:1763334981.241052:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 211 -> 211 00000100:00100000:1.0:1763334981.241139:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694606336:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 496us (9021us total) trans 17179871232 rc 0/0 00000100:00100000:1.0:1763334981.241148:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1907 00002000:00010000:1.0:1763334981.241153:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (28883->18446744073709551615) 00002000:00100000:1.0:1763334981.241156:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fc700 with x1848989694606336 ext(28883->18446744073709551615) 00002000:00010000:1.0:1763334981.241161:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1fc700. 00002000:00010000:0.0:1763334981.241740:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334981.241748:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1ff800 with x1848989694606592 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334981.241756:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1ff800. 00000100:00100000:0.0:1763334981.241786:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1908 00000100:00100000:0.0:1763334981.241798:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694606592:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334981.241957:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334981.241960:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:0.0:1763334981.241963:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334981.241965:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:0.0:1763334981.241968:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334981.242025:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694606592:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 230us (9803us total) trans 17179871233 rc 0/0 00000100:00100000:0.0:1763334981.242033:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1908 00002000:00010000:0.0:1763334981.242036:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334981.242039:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1ff800 with x1848989694606592 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334981.242044:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afb1ff800. 00000100:00100000:2.0:1763334981.253948:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.254102:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694606720 00000100:00100000:1.0:1763334981.254116:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694606720 00000100:00100000:1.0:1763334981.254202:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4972 00000100:00100000:1.0:1763334981.254215:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53644:x1848989694606720:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334981.254258:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334981.254291:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c942 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04a4 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.254416:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c949 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.254434:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c949 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.254448:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c949 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334981.254486:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 28883 00000004:00200000:1.0:1763334981.254491:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334981.254515:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c949 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.254545:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849c942 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04a4 expref: 198 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.254567:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c949 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04a4 expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.254650:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:1.0:1763334981.254654:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334981.254660:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:0.0:1763334981.256531:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53644:x1848989694606720:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 2300us (2582us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334981.256550:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4972 00000100:00100000:2.0:1763334981.263464:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.263841:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694606976 00000100:00100000:0.0:1763334981.263856:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694606976 00000100:00100000:0.0:1763334981.264246:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1808 00000100:00100000:0.0:1763334981.264261:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53644:x1848989694606976:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:0.0:1763334981.268079:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53644:x1848989694606976:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 3798us (4620us total) trans 8589939177 rc 0/0 00000100:00100000:0.0:1763334981.268102:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1808 00000100:00100000:1.0:1763334981.283237:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.283370:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694607232 00000100:00100000:0.0:1763334981.283384:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694607232 00000100:00100000:0.0:1763334981.283464:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4973 00000100:00100000:0.0:1763334981.283476:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53658:x1848989694607232:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334981.283508:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334981.283538:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c950 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04ab expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.283689:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c957 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.283713:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c957 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.283727:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c957 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.283745:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c95e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.283753:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c95e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.283759:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c95e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.283946:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c965 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.283955:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c965 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.283962:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c965 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334981.283988:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:0.0:1763334981.284114:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c957 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284122:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c957 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284130:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c957 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284142:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334981.284146:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c957 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284155:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c957 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284168:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:0.0:1763334981.284171:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334981.284176:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c957 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284182:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849c957 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284197:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c95e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284204:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c95e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284210:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c95e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284215:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334981.284218:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c95e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284224:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c95e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284231:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac7d60900) 00010000:00010000:0.0:1763334981.284234:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334981.284238:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c95e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284244:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849c95e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334981.284293:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849c950 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ab expref: 201 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.284308:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c965 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ab expref: 200 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.284316:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:0.0:1763334981.284318:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334981.284321:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:0.0:1763334981.284421:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53658:x1848989694607232:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 947us (1200us total) trans 8589939178 rc 0/0 00000100:00100000:0.0:1763334981.284432:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4973 00000100:00100000:2.0:1763334981.290009:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.290391:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694607488 00000100:00100000:0.0:1763334981.290408:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694607488 00000100:00100000:0.0:1763334981.290480:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1809 00000100:00100000:0.0:1763334981.290492:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53658:x1848989694607488:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334981.290856:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53658:x1848989694607488:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 365us (863us total) trans 8589939179 rc 0/0 00000100:00100000:0.0:1763334981.290865:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1809 00000100:00100000:3.0:1763334981.293390:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.293523:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694607616 00000100:00100000:0.0:1763334981.293539:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694607616 00000100:00100000:0.0:1763334981.293649:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 409 00000100:00100000:0.0:1763334981.293660:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+201:2360:x1848989694607616:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334981.293683:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334981.293712:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792800/0xcedf0054f849c965 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ab expref: 201 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.293733:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:0.0:1763334981.293737:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334981.293802:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+200:2360:x1848989694607616:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 144us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334981.293807:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 409 00000100:00100000:3.0:1763334981.294456:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.294512:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694607872 00000100:00100000:0.0:1763334981.294519:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694607872 00000100:00100000:0.0:1763334981.294568:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4974 00000100:00100000:0.0:1763334981.294606:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53658:x1848989694607872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334981.294637:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334981.294725:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c973 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04b2 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.294869:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c97a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.294889:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c97a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.294899:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c97a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334981.294911:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:2.0:1763334981.295096:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c973 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04b2 expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.295116:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c97a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04b2 expref: 202 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.295126:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:2.0:1763334981.295129:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763334981.295132:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:2.0:1763334981.295199:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53658:x1848989694607872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 596us (749us total) trans 8589939180 rc 0/0 00000100:00100000:2.0:1763334981.295207:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4974 00000100:00100000:3.0:1763334981.300113:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.301718:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694608128 00000100:00100000:0.0:1763334981.301737:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694608128 00000100:00100000:1.0:1763334981.302384:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4975 00000100:00100000:1.0:1763334981.302399:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53658:x1848989694608128:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334981.302433:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334981.302461:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c988 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04b9 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.302828:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c98f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.302848:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c949 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04a4 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.302859:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c98f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.302909:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c949 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04a4 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.302926:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c949 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04a4 expref: 203 pid: 30972 timeout: 1145 lvb_type: 0 00000100:00100000:1.0:1763334981.302943:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5576a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701881728:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334981.303090:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1763334981.308450:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.308640:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694608256 00000100:00100000:2.0:1763334981.308652:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694608256 00010000:00010000:2.0:1763334981.308703:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c949 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04a4 expref: 204 pid: 30972 timeout: 1145 lvb_type: 0 00000100:00100000:2.0:1763334981.308752:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2647 00000100:00100000:2.0:1763334981.308761:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2360:x1848989694608256:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334981.308780:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334981.308786:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c949 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04a4 expref: 204 pid: 30972 timeout: 1145 lvb_type: 0 00010000:00010000:2.0:1763334981.308813:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c949 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04a4 expref: 204 pid: 30972 timeout: 1145 lvb_type: 0 00010000:00010000:2.0:1763334981.308845:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:2.0:1763334981.308851:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c98f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.308863:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c98f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.308871:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c98f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.308895:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334981.308950:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2360:x1848989694608256:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 190us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334981.308957:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2647 00010000:00010000:1.0:1763334981.309466:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c949 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04a4 expref: 203 pid: 30972 timeout: 1145 lvb_type: 0 00000100:00100000:1.0:1763334981.309486:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5576a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701881728:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334981.309513:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c98f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.309522:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c98f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.309528:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c98f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334981.309551:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:1.0:1763334981.309797:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c988 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04b9 expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.309814:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c98f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04b9 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.309821:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:1.0:1763334981.309825:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334981.309828:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334981.309879:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53658:x1848989694608128:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7484us (9783us total) trans 8589939181 rc 0/0 00000100:00100000:1.0:1763334981.309887:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4975 00000100:00100000:0.0:1763334981.318443:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.318713:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694608384 00000100:00100000:2.0:1763334981.318728:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694608384 00000100:00100000:2.0:1763334981.318800:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1810 00000100:00100000:2.0:1763334981.318814:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53658:x1848989694608384:12345-192.168.201.60@tcp:33:lfs.0 00000100:00100000:2.0:1763334981.319044:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53658:x1848989694608384:12345-192.168.201.60@tcp:33:lfs.0 Request processed in 232us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334981.319053:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1810 00000100:00100000:0.0:1763334981.321934:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.322406:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694608640 00000100:00100000:2.0:1763334981.322421:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694608640 00000100:00100000:2.0:1763334981.322543:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1811 00000100:00100000:2.0:1763334981.322555:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53658:x1848989694608640:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334981.323524:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37a9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53658:x1848989694608640:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 965us (1601us total) trans 8589939182 rc 0/0 00000100:00100000:2.0:1763334981.323535:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1811 00000100:00100000:3.0:1763334981.327447:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.327693:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694608896 00000100:00100000:1.0:1763334981.327709:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694608896 00000100:00100000:1.0:1763334981.327789:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4976 00000100:00100000:1.0:1763334981.327801:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53658:x1848989694608896:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334981.327833:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334981.327837:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1763334981.327874:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c98f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04b9 expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.327901:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849c97a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04b2 expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.327921:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:1.0:1763334981.327927:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334981.327944:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c99d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04c0 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.328082:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c9a4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.328099:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c9a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.328111:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c9a4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334981.328125:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:1.0:1763334981.328284:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c99d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04c0 expref: 205 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.328297:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c9a4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04c0 expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.328305:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:1.0:1763334981.328308:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334981.328310:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334981.328391:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53658:x1848989694608896:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 593us (959us total) trans 8589939183 rc 0/0 00000100:00100000:1.0:1763334981.328399:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4976 00000100:00100000:3.0:1763334981.331391:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.331560:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694609152 00000100:00100000:2.0:1763334981.331604:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694609152 00000100:00100000:2.0:1763334981.331745:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1812 00000100:00100000:2.0:1763334981.331759:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53658:x1848989694609152:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:2.0:1763334981.331862:0:29631:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1ab:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c9a4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04c0 expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.331917:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.331933:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c8fc lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0488 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.331944:0:29631:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.332002:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c8fc lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0488 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.332019:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c8fc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0488 expref: 204 pid: 29628 timeout: 1145 lvb_type: 0 00000100:00100000:2.0:1763334981.332037:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701881856:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334981.332149:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bf9000 going to sleep for 11 seconds 00000100:00100000:0.0:1763334981.337156:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.337260:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694609280 00000100:00100000:1.0:1763334981.337272:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694609280 00010000:00010000:1.0:1763334981.337325:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c8fc lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0488 expref: 205 pid: 29628 timeout: 1145 lvb_type: 0 00000100:00100000:1.0:1763334981.337373:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2648 00000100:00100000:1.0:1763334981.337384:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+205:2360:x1848989694609280:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334981.337402:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334981.337409:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c8fc lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0488 expref: 205 pid: 29628 timeout: 1145 lvb_type: 0 00010000:00010000:1.0:1763334981.337423:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c8fc lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0488 expref: 205 pid: 29628 timeout: 1145 lvb_type: 0 00010000:00010000:1.0:1763334981.337451:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:1.0:1763334981.337457:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334981.337468:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334981.337477:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334981.337501:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334981.337591:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+205:2360:x1848989694609280:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 189us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.337599:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2648 00010000:00010000:2.0:1763334981.337717:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849c8fc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0488 expref: 204 pid: 29628 timeout: 1145 lvb_type: 0 00000100:00100000:2.0:1763334981.337736:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701881856:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334981.337761:0:29631:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.337770:0:29631:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.337776:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.338190:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.338200:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.338208:0:29631:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.338215:0:29631:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334981.338220:0:29631:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.338229:0:29631:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.338240:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:2.0:1763334981.338243:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763334981.338247:0:29631:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.338254:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.338267:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de400) 00010000:00010000:2.0:1763334981.338269:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334981.338274:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849c9a4 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04c0 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334981.338433:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53658:x1848989694609152:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 6677us (7056us total) trans 8589939184 rc -22/-22 00000100:00100000:2.0:1763334981.338443:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1812 00000100:00100000:3.0:1763334981.358439:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.362913:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694609408 00000100:00100000:2.0:1763334981.362938:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694609408 00000100:00100000:2.0:1763334981.363062:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4977 00000100:00100000:2.0:1763334981.363077:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53658:x1848989694609408:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334981.363114:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334981.363150:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04c7 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.363239:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04c7 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.363259:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04c7 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.363286:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334981.363291:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334981.363296:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430e00, rc 0) 00000100:00100000:2.0:1763334981.363387:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53658:x1848989694609408:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 312us (4964us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334981.363399:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4977 00000100:00100000:3.0:1763334981.371651:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.372616:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694609664 00000100:00100000:1.0:1763334981.372632:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694609664 00000100:00100000:1.0:1763334981.372713:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4978 00000100:00100000:1.0:1763334981.372726:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53658:x1848989694609664:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334981.372758:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334981.372789:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c9c0 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04ce expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.373750:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1b2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.373776:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.373797:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334981.373814:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b2:0x0]: returning size 0 00010000:00010000:1.0:1763334981.373897:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849c9c0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ce expref: 207 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.373923:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ce expref: 206 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.373935:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b2:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:1.0:1763334981.373939:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334981.373943:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334981.374053:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+206:53658:x1848989694609664:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1328us (2416us total) trans 8589939185 rc 0/0 00000100:00100000:1.0:1763334981.374065:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4978 00000100:00100000:0.0:1763334981.380550:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.381740:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694609920 00000100:00100000:2.0:1763334981.381762:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694609920 00000100:00100000:2.0:1763334981.381847:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4979 00000100:00100000:2.0:1763334981.381859:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+206:53658:x1848989694609920:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334981.381891:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334981.381920:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9d5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04d5 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.382063:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9dc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.382081:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.382094:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9dc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334981.382109:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:2.0:1763334981.382273:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9d5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04d5 expref: 209 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.382296:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9dc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04d5 expref: 208 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.382307:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334981.382310:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334981.382315:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431a00, rc 0) 00000100:00100000:2.0:1763334981.382405:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+208:53658:x1848989694609920:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 548us (1869us total) trans 8589939186 rc 0/0 00000100:00100000:2.0:1763334981.382415:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4979 00000100:00100000:3.0:1763334981.385385:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.385649:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694610176 00000100:00100000:2.0:1763334981.385663:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694610176 00000100:00100000:2.0:1763334981.385735:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1813 00000100:00100000:2.0:1763334981.385747:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+208:53658:x1848989694610176:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:2.0:1763334981.385852:0:29631:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1ab:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9dc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04d5 expref: 208 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.385902:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.385918:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04c7 expref: 208 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.385927:0:29631:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.385983:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04c7 expref: 208 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.385999:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04c7 expref: 208 pid: 29628 timeout: 1146 lvb_type: 0 00000100:00100000:2.0:1763334981.386078:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701881984:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334981.386192:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334981.389351:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701881984:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334981.389390:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.389480:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694610304 00010000:00010000:2.0:1763334981.389489:0:29631:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:0.0:1763334981.389495:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694610304 00010000:00010000:0.0:1763334981.389543:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04c7 expref: 209 pid: 29628 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334981.389622:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2649 00000100:00100000:0.0:1763334981.389635:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+209:2359:x1848989694610304:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334981.389660:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334981.389669:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04c7 expref: 209 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.389683:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04c7 expref: 209 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.389712:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849c9b9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04c7 expref: 209 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.389734:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:0.0:1763334981.389739:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334981.389750:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334981.389758:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334981.389788:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334981.389823:0:29631:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.389832:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:0.0:1763334981.389853:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+208:2359:x1848989694610304:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 219us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334981.389861:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2649 00010000:00010000:2.0:1763334981.389868:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.389883:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9c7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ce expref: 207 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.389892:0:29631:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.389925:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ce expref: 207 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.389938:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ce expref: 207 pid: 30972 timeout: 1146 lvb_type: 0 00000100:00100000:2.0:1763334981.389953:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701882112:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334981.390015:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530d80 going to sleep for 11 seconds 00000100:00100000:0.0:1763334981.392805:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.392891:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694610432 00000100:00100000:1.0:1763334981.392904:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694610432 00010000:00010000:1.0:1763334981.392956:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9c7 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ce expref: 208 pid: 30972 timeout: 1146 lvb_type: 0 00000100:00100000:2.0:1763334981.393054:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701882112:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334981.393084:0:29631:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:1.0:1763334981.393857:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2650 00000100:00100000:1.0:1763334981.393873:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+208:2360:x1848989694610432:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334981.393893:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334981.393902:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ce expref: 208 pid: 30972 timeout: 1146 lvb_type: 0 00010000:00010000:1.0:1763334981.393917:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ce expref: 208 pid: 30972 timeout: 1146 lvb_type: 0 00010000:00010000:1.0:1763334981.393945:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9c7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1b2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ce expref: 208 pid: 30972 timeout: 1146 lvb_type: 0 00010000:00010000:1.0:1763334981.393963:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b2:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:1.0:1763334981.393982:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334981.393994:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334981.394002:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334981.394023:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334981.394099:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+207:2360:x1848989694610432:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 231us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.394117:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2650 00010000:00010000:2.0:1763334981.394201:0:29631:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.394215:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:2.0:1763334981.394895:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701882240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.394965:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334981.395020:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334981.395047:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701882240 00000100:00100000:2.0:1763334981.395055:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701882240 00000100:00100000:2.0:1763334981.395114:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1763334981.395122:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701882240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.395196:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701882240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334981.395203:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1763334981.395719:0:29631:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871222 gen 2 00000004:00080000:3.0:1763334981.395727:0:29631:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179871217 committed transno 17179871222 00000004:00080000:3.0:1763334981.395757:0:29631:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d6a00, transno 17179871218 00000004:00080000:3.0:1763334981.395780:0:29631:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5577800, transno 17179871219 00000004:00080000:3.0:1763334981.395784:0:29631:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5576d80, transno 17179871220 00000004:00080000:3.0:1763334981.395787:0:29631:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5574e00, transno 17179871221 00000004:00080000:3.0:1763334981.395790:0:29631:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5575f80, transno 17179871222 00000100:00100000:3.0:1763334981.395797:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701882240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763334981.395850:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5500e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701882368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763334981.395889:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334981.395907:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac57b5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1763334981.395923:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701882368 00000100:00100000:3.0:1763334981.395927:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701882368 00000100:00080000:1.0:1763334981.396210:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1763334981.396215:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1763334981.396791:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 5 done 00000100:00100000:1.0:1763334981.399111:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1763334981.399140:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:29631:x1848989701882368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334981.399313:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:29631:x1848989701882368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 187us (3422us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.399322:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1763334981.399431:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5500e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701882368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1763334981.399557:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5500e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701882496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.401753:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334981.401806:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5bf9000 going to sleep for 11 seconds 00000100:00100000:0.0:1763334981.401915:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701882496 00000100:00100000:0.0:1763334981.401928:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701882496 00000100:00100000:0.0:1763334981.403205:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1763334981.403229:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:29631:x1848989701882496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334981.403381:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:29631:x1848989701882496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 163us (1638us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334981.403390:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1763334981.403509:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5500e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701882496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.403648:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701882624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.403701:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334981.403734:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46300 going to sleep for 11 seconds 00000100:00100000:1.0:1763334981.403763:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701882624 00000100:00100000:1.0:1763334981.403771:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701882624 00000100:00100000:1.0:1763334981.403822:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1763334981.403830:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701882624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334981.403898:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701882624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 68us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.403905:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1763334981.404122:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701882624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.404195:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701882752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.404225:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334981.404246:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7600 going to sleep for 11 seconds 00000100:00100000:1.0:1763334981.404564:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701882752 00000100:00100000:1.0:1763334981.404569:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701882752 00000100:00100000:1.0:1763334981.404622:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1763334981.404630:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:29631:x1848989701882752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334981.405337:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:29631:x1848989701882752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 702us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.405348:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1763334981.407790:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701882752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.408182:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701882880:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.408410:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334981.408455:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334981.408533:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701882880 00000100:00100000:1.0:1763334981.408542:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701882880 00000100:00100000:1.0:1763334981.408643:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1763334981.408655:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701882880:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334981.408814:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701882880:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 161us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.408826:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1763334981.408965:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701882880:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.409036:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701883008:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.409056:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334981.409072:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334981.409138:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701883008 00000100:00100000:1.0:1763334981.409141:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701883008 00000100:00100000:1.0:1763334981.409163:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1763334981.409167:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701883008:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334981.409271:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701883008:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 103us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.409276:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1763334981.409312:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701883008:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.409333:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701883136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.409349:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334981.409395:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334981.409425:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701883136 00000100:00100000:1.0:1763334981.409433:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701883136 00000100:00100000:1.0:1763334981.409659:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1763334981.409669:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:29631:x1848989701883136:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334981.409796:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:29631:x1848989701883136:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 128us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334981.409799:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701883136:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334981.409803:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000040:00080000:2.0:1763334981.410252:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].12, 456 off37648 00000001:00080000:2.0:1763334981.410268:0:29631:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939187 00000100:00100000:2.0:1763334981.410349:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701883264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.410384:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334981.410420:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334981.410617:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701883264 00000100:00100000:1.0:1763334981.410622:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701883264 00000100:00100000:1.0:1763334981.410663:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1763334981.410671:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29631:x1848989701883264:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1763334981.410888:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29631:x1848989701883264:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 217us (502us total) trans 17179871234 rc 0/0 00000100:00100000:1.0:1763334981.410895:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1763334981.411172:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afb1fea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701883264:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.411206:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701883392:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1763334981.411239:0:29631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334981.411341:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701883392 00000100:00100000:0.0:1763334981.411346:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701883392 00000100:00100000:2.0:1763334981.411349:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1763334981.411391:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1763334981.411400:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+19:29631:x1848989701883392:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1763334981.411699:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+20:29631:x1848989701883392:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 300us (459us total) trans 21474838484 rc 0/0 00000100:00100000:0.0:1763334981.411707:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1763334981.411784:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:29631:1848989701883392:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1763334981.411901:0:29631:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939188 00010000:00010000:2.0:1763334981.411942:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.411954:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.411964:0:29631:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.411981:0:29631:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334981.411987:0:29631:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.411995:0:29631:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.412112:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b2:0x0].0x0 (ffff9a5ad28fa900) 00010000:00010000:2.0:1763334981.412116:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763334981.412123:0:29631:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.412129:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849c9f1 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1b2:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.412165:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.412171:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.412177:0:29631:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.412182:0:29631:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334981.412185:0:29631:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.412191:0:29631:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.412207:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334981.412210:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763334981.412213:0:29631:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.412219:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849c9ea lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.412232:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334981.412235:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334981.412243:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9dc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04d5 expref: 209 pid: 29628 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334981.412368:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+208:53658:x1848989694610176:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 26623us (26999us total) trans 8589939189 rc 0/0 00000100:00100000:2.0:1763334981.412377:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1813 00000020:00080000:2.0:1763334981.412382:0:29631:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1763334981.416738:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.417143:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694610560 00000100:00100000:1.0:1763334981.417156:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694610560 00000100:00100000:1.0:1763334981.417231:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4980 00000100:00100000:1.0:1763334981.417244:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+208:53658:x1848989694610560:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334981.417277:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334981.417308:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04dc expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.417385:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04dc expref: 209 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.417400:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04dc expref: 209 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.417419:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334981.417423:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334981.417427:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334981.417510:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa747800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+209:53658:x1848989694610560:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 269us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.417518:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4980 00000100:00100000:2.0:1763334981.427995:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.428087:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694610688 00000100:00100000:3.0:1763334981.428101:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694610688 00002000:00100000:3.0:1763334981.428188:0:21629:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x24a:0x0] (172032->200813) req@ffff9a59c58c5c00 x1848989694610688/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:27/0 lens 488/0 e 0 to 0 dl 1763334992 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334981.428200:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c5c00 with x1848989694610688 ext(172032->200813) 00002000:00010000:3.0:1763334981.428207:0:21629:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c58c5c00 00000100:00100000:3.0:1763334981.428249:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1909 00000100:00100000:3.0:1763334981.428260:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694610688:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:2.0:1763334981.436631:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2359:x1848989694610688:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 8309us (8598us total) trans 17179871235 rc 0/0 00000100:00100000:2.0:1763334981.436649:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1909 00002000:00100000:2.0:1763334981.436666:0:21629:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x280000400:0x24a:0x0] (172032->200813) req@ffff9a59c58c5c00 x1848989694610688/t17179871235(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:27/0 lens 488/448 e 0 to 0 dl 1763334992 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334981.436677:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c58c5c00 with x1848989694610688 ext(172032->200813) 00002000:00010000:2.0:1763334981.436686:0:21629:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c58c5c00 00000100:00100000:0.0:1763334981.440415:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.440732:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694610944 00000100:00100000:2.0:1763334981.440749:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694610944 00000100:00100000:2.0:1763334981.440831:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1814 00000100:00100000:2.0:1763334981.440845:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+209:53658:x1848989694610944:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:2.0:1763334981.441540:0:29631:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x1b2:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1763334981.441718:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1169, 64 off100040 00000004:00080000:2.0:1763334981.441733:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1046075161019ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334981.441795:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1159, 64 off98984 00000004:00080000:2.0:1763334981.441803:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1046075231139ns, next at 1047075229764ns, rc = 0 00000001:00080000:2.0:1763334981.441811:0:29631:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939190 00010000:00010000:2.0:1763334981.441880:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9ff lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.441903:0:29631:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9ff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.441919:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9ff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.441929:0:29631:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9ff lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1b2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.441935:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9ff lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1b2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.441942:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9ff lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334981.441978:0:29631:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334981.442168:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+211:53658:x1848989694610944:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1323us (1766us total) trans 8589939191 rc 0/0 00000100:00100000:2.0:1763334981.442181:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1814 00000020:00080000:2.0:1763334981.442188:0:29631:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763334981.443163:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334981.443177:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9ff lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334981.443188:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334981.443194:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9ff lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334981.443204:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9ff lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334981.443221:0:8206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b2:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:3.0:1763334981.443224:0:8206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763334981.443229:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9ff lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1b2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334981.443234:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849c9ff lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334981.443257:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334981.443259:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334981.443260:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1763334981.446487:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.446650:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694611200 00000100:00100000:2.0:1763334981.446664:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694611200 00000100:00100000:2.0:1763334981.446734:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1815 00000100:00100000:2.0:1763334981.446745:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+211:53658:x1848989694611200:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334981.449994:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+212:53658:x1848989694611200:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 3210us (3484us total) trans 8589939192 rc 0/0 00000100:00100000:2.0:1763334981.450013:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1815 00010000:00010000:0.0:1763334981.477885:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334981.483687:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.484067:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694611328 00000100:00100000:1.0:1763334981.484081:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694611328 00000100:00100000:1.0:1763334981.484155:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4981 00000100:00100000:1.0:1763334981.484167:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+212:53659:x1848989694611328:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334981.484198:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334981.484226:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ca06 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04e3 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.484314:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ca0d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484332:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ca0d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484347:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ca0d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484364:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca14 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484372:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca14 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484378:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca14 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484523:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ca1b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484532:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ca1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484540:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ca1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334981.484623:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00000004:00200000:1.0:1763334981.484628:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334981.484650:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ca1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484664:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ca1b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484673:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ca0d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484680:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ca0d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484692:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ca0d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484698:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334981.484703:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ca0d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484711:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ca0d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484724:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:1.0:1763334981.484728:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334981.484732:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ca0d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.484738:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ca0d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.488107:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca14 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.488132:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca14 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.488141:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca14 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.488148:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334981.488153:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca14 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.488161:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca14 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.488186:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ad28fa000) 00010000:00010000:1.0:1763334981.488190:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334981.488196:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca14 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.488203:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca14 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334981.488280:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849ca06 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04e3 expref: 214 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.488298:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ca1b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04e3 expref: 213 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.488307:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334981.488309:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334981.488312:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478000, rc 0) 00000100:00100000:1.0:1763334981.488412:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+213:53659:x1848989694611328:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4246us (4740us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.488423:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4981 00000100:00100000:1.0:1763334981.495500:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.495638:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694611584 00000100:00100000:3.0:1763334981.495652:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694611584 00000100:00100000:3.0:1763334981.495730:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4982 00000100:00100000:3.0:1763334981.495742:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+213:53659:x1848989694611584:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334981.495768:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334981.495793:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ca22 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04ea expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.495915:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ca29 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334981.495931:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ca29 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334981.495943:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ca29 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334981.495956:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:3.0:1763334981.496137:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ca22 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ea expref: 216 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.496158:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ca29 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ea expref: 215 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.496168:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:3.0:1763334981.496171:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1763334981.496175:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:3.0:1763334981.499721:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+215:53659:x1848989694611584:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 513us (770us total) trans 8589939193 rc 0/0 00000100:00100000:3.0:1763334981.499737:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4982 00000100:00100000:0.0:1763334981.503200:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.503430:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694611840 00000100:00100000:3.0:1763334981.503444:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694611840 00000100:00100000:3.0:1763334981.503524:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4983 00000100:00100000:3.0:1763334981.503537:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+215:53659:x1848989694611840:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334981.503568:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334981.503664:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ca37 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04f1 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.503803:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ca3e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334981.503821:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ca3e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334981.503833:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ca3e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334981.503850:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:3.0:1763334981.504033:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066a00/0xcedf0054f849ca37 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04f1 expref: 218 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.504055:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ca3e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04f1 expref: 217 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.504065:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:3.0:1763334981.504068:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763334981.504073:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:3.0:1763334981.504161:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+217:53659:x1848989694611840:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 626us (975us total) trans 8589939194 rc 0/0 00000100:00100000:3.0:1763334981.504171:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4983 00000100:00100000:2.0:1763334981.525173:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.525251:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694611968 00000100:00100000:0.0:1763334981.525267:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694611968 00000100:00100000:0.0:1763334981.525382:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1910 00000100:00100000:0.0:1763334981.525397:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694611968:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334981.525447:0:21629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ca4c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.525468:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.525471:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.525478:0:21629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ca4c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.525494:0:21629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ca4c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.531839:0:21629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ca4c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.531865:0:21629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ca4c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.531876:0:21629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ca4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.531885:0:21629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334981.531890:0:21629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ca4c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.531900:0:21629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ca4c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.531924:0:21629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ca4c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.531934:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ca4c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334981.532068:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694611968:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 6669us (6905us total) trans 0 rc 200814/200814 00000100:00100000:2.0:1763334981.532080:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1910 00000100:00100000:2.0:1763334981.543790:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.543919:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694612096 00000100:00100000:0.0:1763334981.543932:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694612096 00000100:00100000:0.0:1763334981.544047:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1911 00000100:00100000:0.0:1763334981.544060:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2359:x1848989694612096:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334981.544111:0:21629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca53 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.544131:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.544134:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.544141:0:21629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca53 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.544158:0:21629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca53 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.548386:0:21629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca53 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.548409:0:21629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca53 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.548420:0:21629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.548428:0:21629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334981.548433:0:21629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca53 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.548450:0:21629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca53 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.548475:0:21629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca53 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.548484:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca53 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334981.548679:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2359:x1848989694612096:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 4614us (4898us total) trans 0 rc 159744/159744 00000100:00100000:0.0:1763334981.548693:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1911 00000100:00100000:2.0:1763334981.554495:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.554615:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694612224 00000100:00100000:1.0:1763334981.554631:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694612224 00000100:00100000:1.0:1763334981.554721:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 410 00000100:00100000:1.0:1763334981.554734:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+217:53659:x1848989694612224:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:1.0:1763334981.554755:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334981.554789:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ca3e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04f1 expref: 217 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.554819:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334981.554825:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334981.554900:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+216:53659:x1848989694612224:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 169us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.554908:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 410 00000100:00100000:1.0:1763334981.556877:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.557066:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694612480 00000100:00100000:2.0:1763334981.557079:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694612480 00000100:00100000:2.0:1763334981.557148:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1816 00000100:00100000:2.0:1763334981.557160:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37a9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+216:53659:x1848989694612480:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334981.557490:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37a9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+217:53659:x1848989694612480:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 332us (626us total) trans 8589939195 rc 0/0 00000100:00100000:2.0:1763334981.557499:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1816 00000100:00100000:2.0:1763334981.580499:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.581346:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694612736 00000100:00100000:0.0:1763334981.581361:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694612736 00000100:00100000:1.0:1763334981.581520:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4984 00000100:00100000:1.0:1763334981.581533:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+217:53660:x1848989694612736:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334981.581565:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334981.581616:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ca5a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04f8 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.581748:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849ca61 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334981.581773:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849ca61 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334981.581785:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849ca61 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:1.0:1763334981.581801:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:1.0:1763334981.581953:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849ca5a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04f8 expref: 220 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.581985:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849ca61 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04f8 expref: 219 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.582000:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334981.582007:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334981.582011:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334981.582087:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+219:53660:x1848989694612736:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 557us (1611us total) trans 8589939196 rc 0/0 00000100:00100000:1.0:1763334981.582095:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4984 00000100:00100000:3.0:1763334981.589654:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.589765:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694612864 00000100:00100000:0.0:1763334981.589780:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694612864 00000100:00100000:0.0:1763334981.589868:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1912 00000100:00100000:0.0:1763334981.589878:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694612864:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334981.590127:0:21629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ca6f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.590145:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.590147:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.590154:0:21629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ca6f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.590169:0:21629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ca6f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.595196:0:21629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ca6f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.595221:0:21629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ca6f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.595233:0:21629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ca6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.595241:0:21629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334981.595246:0:21629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ca6f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.595269:0:21629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ca6f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.595293:0:21629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ca6f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.595302:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ca6f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334981.595412:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694612864:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 5527us (5763us total) trans 0 rc 200814/200814 00000100:00100000:0.0:1763334981.595424:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1912 00000100:00100000:2.0:1763334981.602135:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.603738:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694612992 00000100:00100000:0.0:1763334981.603761:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694612992 00000100:00100000:0.0:1763334981.604467:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1913 00000100:00100000:0.0:1763334981.604484:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2362:x1848989694612992:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334981.604539:0:21629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca76 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.604560:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.604562:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.604603:0:21629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.604622:0:21629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.609634:0:21629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca76 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.609658:0:21629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca76 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.609668:0:21629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.609675:0:21629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334981.609680:0:21629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca76 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.609689:0:21629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca76 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.609712:0:21629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca76 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.609720:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849ca76 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334981.609834:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2362:x1848989694612992:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 5347us (7705us total) trans 0 rc 159744/159744 00000100:00100000:0.0:1763334981.609845:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1913 00000100:00100000:2.0:1763334981.614319:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.615124:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694613120 00000100:00100000:0.0:1763334981.615140:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694613120 00000100:00100000:1.0:1763334981.615453:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 411 00000100:00100000:1.0:1763334981.615465:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+219:53660:x1848989694613120:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:1.0:1763334981.615485:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334981.615518:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849ca61 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04f8 expref: 219 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.615542:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334981.615549:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334981.615761:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+218:53660:x1848989694613120:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 297us (1456us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.615770:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 411 00000100:00100000:2.0:1763334981.619882:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.620068:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694613376 00000100:00100000:0.0:1763334981.620084:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694613376 00000100:00100000:0.0:1763334981.620184:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1817 00000100:00100000:0.0:1763334981.620197:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+218:53660:x1848989694613376:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334981.620560:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+219:53660:x1848989694613376:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 363us (691us total) trans 8589939197 rc 0/0 00000100:00100000:0.0:1763334981.620569:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1817 00000100:00100000:3.0:1763334981.625497:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.627041:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694613632 00000100:00100000:1.0:1763334981.627070:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694613632 00000100:00100000:1.0:1763334981.627206:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4985 00000100:00100000:1.0:1763334981.627221:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+219:53644:x1848989694613632:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334981.627267:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334981.627297:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849ca7d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b04ff expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.627435:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334981.627453:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ca1b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04e3 expref: 220 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.627463:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334981.627506:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ca1b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04e3 expref: 220 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.627521:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ca1b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04e3 expref: 220 pid: 30972 timeout: 1146 lvb_type: 0 00000100:00100000:1.0:1763334981.627537:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701883520:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334981.627695:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b000 going to sleep for 11 seconds 00000100:00100000:1.0:1763334981.635566:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.635710:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694613760 00000100:00100000:3.0:1763334981.635724:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694613760 00010000:00010000:3.0:1763334981.635781:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ca1b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04e3 expref: 221 pid: 30972 timeout: 1146 lvb_type: 0 00000100:00100000:3.0:1763334981.635836:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2651 00000100:00100000:3.0:1763334981.635849:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+221:2359:x1848989694613760:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334981.635870:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334981.635878:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ca1b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04e3 expref: 221 pid: 30972 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334981.635892:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ca1b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04e3 expref: 221 pid: 30972 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334981.635923:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:3.0:1763334981.635928:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.635940:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.635948:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.635986:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334981.636064:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+221:2359:x1848989694613760:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 218us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334981.636072:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2651 00010000:00010000:2.0:1763334981.636190:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ca1b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04e3 expref: 220 pid: 30972 timeout: 1146 lvb_type: 0 00000100:00100000:2.0:1763334981.636208:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701883520:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334981.636237:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.636247:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.636270:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334981.636292:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:2.0:1763334981.636482:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849ca7d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ff expref: 221 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.636498:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ff expref: 220 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.636506:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:2.0:1763334981.636508:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334981.636511:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:2.0:1763334981.636556:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+220:53644:x1848989694613632:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 9340us (11073us total) trans 8589939198 rc 0/0 00000100:00100000:2.0:1763334981.636564:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4985 00000100:00100000:1.0:1763334981.640998:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.641330:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694613888 00000100:00100000:2.0:1763334981.641345:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694613888 00000100:00100000:2.0:1763334981.641430:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4986 00000100:00100000:2.0:1763334981.641444:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+220:53644:x1848989694613888:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334981.641477:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334981.641508:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ca92 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0506 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.641660:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.641679:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ff expref: 221 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.641690:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.641732:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ff expref: 221 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.641748:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ff expref: 221 pid: 29628 timeout: 1146 lvb_type: 0 00000100:00100000:2.0:1763334981.641763:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701883648:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334981.641870:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7780 going to sleep for 11 seconds 00000100:00100000:2.0:1763334981.645231:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701883648:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334981.645278:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334981.646013:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.646603:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694614016 00000100:00100000:0.0:1763334981.646615:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694614016 00010000:00010000:0.0:1763334981.646665:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ff expref: 222 pid: 29628 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334981.646714:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2652 00000100:00100000:0.0:1763334981.646725:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+222:2359:x1848989694614016:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334981.646744:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334981.646752:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ff expref: 222 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.646772:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ff expref: 222 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.646800:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849ca84 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ff expref: 222 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.646818:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:0.0:1763334981.646824:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334981.646835:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334981.646844:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334981.646878:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334981.646942:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+221:2359:x1848989694614016:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 218us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334981.646951:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2652 00010000:00010000:2.0:1763334981.647218:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.647227:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334981.647293:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00000004:00200000:2.0:1763334981.647299:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334981.647324:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.647361:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ca92 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0506 expref: 221 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.647383:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0506 expref: 220 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.647391:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:2.0:1763334981.647394:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334981.647397:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430800, rc 0) 00000100:00100000:2.0:1763334981.647943:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+220:53644:x1848989694613888:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 6499us (7384us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334981.647952:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4986 00000100:00100000:1.0:1763334981.652382:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.652852:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694614272 00000100:00100000:2.0:1763334981.652867:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694614272 00000100:00100000:2.0:1763334981.652937:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1818 00000100:00100000:2.0:1763334981.652947:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+220:53644:x1848989694614272:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:2.0:1763334981.653236:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+221:53644:x1848989694614272:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 289us (867us total) trans 8589939199 rc 0/0 00000100:00100000:2.0:1763334981.653245:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1818 00000100:00100000:3.0:1763334981.671246:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.671533:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694614400 00000100:00100000:2.0:1763334981.671549:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694614400 00000100:00100000:2.0:1763334981.671677:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4987 00000100:00100000:2.0:1763334981.671689:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+221:53661:x1848989694614400:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334981.671720:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334981.671748:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849caa0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b050d expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.671846:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849caa7 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.671866:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849caa7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.671879:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849caa7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.671896:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849caae lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.671903:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849caae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.671910:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849caae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672070:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cab5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672080:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cab5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672087:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cab5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334981.672134:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00000004:00200000:2.0:1763334981.672140:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334981.672167:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cab5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672179:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cab5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672188:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849caa7 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672198:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849caa7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672205:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849caa7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672213:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334981.672217:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849caa7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672226:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849caa7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672240:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334981.672244:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334981.672248:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849caa7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672264:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849caa7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672279:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849caae lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672285:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849caae lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672291:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849caae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672295:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334981.672297:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849caae lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672307:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849caae lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672313:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334981.672315:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334981.672317:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849caae lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672322:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849caae lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.672354:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849caa0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b050d expref: 223 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.672366:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cab5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b050d expref: 222 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.672373:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:2.0:1763334981.672375:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334981.672378:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431c00, rc 0) 00000100:00100000:2.0:1763334981.677889:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+222:53661:x1848989694614400:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6178us (6635us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334981.677910:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4987 00000100:00100000:1.0:1763334981.680176:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.680563:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694614528 00000100:00100000:3.0:1763334981.681059:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694614528 00000100:00100000:3.0:1763334981.681450:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 412 00000100:00100000:3.0:1763334981.681462:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+222:2359:x1848989694614528:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334981.681482:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334981.681516:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cab5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b050d expref: 222 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.681538:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:3.0:1763334981.681544:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334981.681643:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+221:2359:x1848989694614528:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 183us (1480us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334981.681651:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 412 00000100:00100000:1.0:1763334981.684168:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.684413:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694614784 00000100:00100000:2.0:1763334981.684426:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694614784 00000100:00100000:2.0:1763334981.684495:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4988 00000100:00100000:2.0:1763334981.684505:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+221:53661:x1848989694614784:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334981.684530:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334981.684557:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cabc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0514 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.684763:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.684781:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0506 expref: 222 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.684792:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.684835:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0506 expref: 222 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.684851:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0506 expref: 222 pid: 29628 timeout: 1146 lvb_type: 0 00000100:00100000:2.0:1763334981.684868:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701883776:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334981.684990:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c26a7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334981.688274:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.688792:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701883776:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334981.688831:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:0.0:1763334981.689000:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694614912 00000100:00100000:0.0:1763334981.689010:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694614912 00010000:00010000:0.0:1763334981.689054:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0506 expref: 223 pid: 29628 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334981.689094:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2653 00000100:00100000:0.0:1763334981.689103:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+223:2360:x1848989694614912:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334981.689121:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334981.689129:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0506 expref: 223 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.689142:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0506 expref: 223 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.689168:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ca99 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0506 expref: 223 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.689186:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:0.0:1763334981.689191:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334981.689202:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334981.689210:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334981.689232:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334981.689309:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+222:2360:x1848989694614912:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 206us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334981.689316:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2653 00010000:00010000:1.0:1763334981.689650:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334981.689658:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:1.0:1763334981.689681:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:1.0:1763334981.689881:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cabc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0514 expref: 223 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.689897:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0514 expref: 222 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.689905:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334981.689908:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334981.689910:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c314b400, rc 0) 00000100:00100000:1.0:1763334981.689950:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+222:53661:x1848989694614784:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5446us (5800us total) trans 8589939200 rc 0/0 00000100:00100000:1.0:1763334981.689958:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4988 00000100:00100000:2.0:1763334981.693560:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.693945:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694615040 00000100:00100000:1.0:1763334981.693971:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694615040 00000100:00100000:1.0:1763334981.694057:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4989 00000100:00100000:1.0:1763334981.694071:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+222:53661:x1848989694615040:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334981.694105:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334981.694138:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849cad1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b051b expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.694289:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cad8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334981.694309:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0514 expref: 223 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.694319:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cad8 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334981.694370:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0514 expref: 223 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.694386:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0514 expref: 223 pid: 29628 timeout: 1146 lvb_type: 0 00000100:00100000:1.0:1763334981.694404:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5574e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701883904:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334981.694512:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334981.699748:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.699878:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5574e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701883904:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334981.699917:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cad8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:3.0:1763334981.700178:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694615168 00000100:00100000:3.0:1763334981.700192:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694615168 00010000:00010000:3.0:1763334981.700245:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0514 expref: 224 pid: 29628 timeout: 1146 lvb_type: 0 00000100:00100000:3.0:1763334981.700295:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2654 00000100:00100000:3.0:1763334981.700306:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+224:2360:x1848989694615168:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334981.700326:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334981.700334:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0514 expref: 224 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334981.700347:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0514 expref: 224 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334981.700376:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cac3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0514 expref: 224 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334981.700395:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:3.0:1763334981.700401:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cad8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.700412:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cad8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.700420:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cad8 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.700455:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334981.700540:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+223:2360:x1848989694615168:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 234us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334981.700552:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2654 00010000:00010000:1.0:1763334981.700673:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cad8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334981.700680:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cad8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:1.0:1763334981.700746:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00000004:00200000:1.0:1763334981.700753:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334981.700779:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cad8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334981.700825:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849cad1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b051b expref: 223 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.700847:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cad8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b051b expref: 222 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.700855:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334981.700859:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334981.700862:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334981.700908:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+222:53661:x1848989694615040:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 6839us (7362us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.700916:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4989 00000100:00100000:0.0:1763334981.705123:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.705438:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694615424 00000100:00100000:2.0:1763334981.705454:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694615424 00000100:00100000:2.0:1763334981.705527:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1819 00000100:00100000:2.0:1763334981.705540:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+222:53661:x1848989694615424:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334981.705873:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+223:53661:x1848989694615424:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 334us (763us total) trans 8589939201 rc 0/0 00000100:00100000:2.0:1763334981.705882:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1819 00000100:00100000:3.0:1763334981.709131:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.709199:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694615680 00000100:00100000:1.0:1763334981.709215:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694615680 00000100:00100000:1.0:1763334981.709445:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4990 00000100:00100000:1.0:1763334981.709458:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+223:53661:x1848989694615680:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334981.709488:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334981.709493:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1763334981.709532:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849ca29 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04ea expref: 223 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.709558:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334981.709564:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334981.710007:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cadf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0522 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.710148:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cae6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334981.710166:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cae6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334981.710180:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cae6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:1.0:1763334981.710195:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:1.0:1763334981.710378:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cadf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0522 expref: 225 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.710396:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cae6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0522 expref: 224 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.710404:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334981.710407:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334981.710410:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:1.0:1763334981.710493:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+224:53661:x1848989694615680:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1037us (1377us total) trans 8589939202 rc 0/0 00000100:00100000:1.0:1763334981.710502:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4990 00000100:00100000:1.0:1763334981.719597:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.719649:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.719680:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.719745:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694615808 00000100:00100000:0.0:1763334981.719751:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694616064 00000100:00100000:2.0:1763334981.719759:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694615808 00000100:00100000:0.0:1763334981.719759:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694616064 00000100:00100000:3.0:1763334981.719846:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694615936 00000100:00100000:3.0:1763334981.719850:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694615936 00000100:00100000:1.0:1763334981.720659:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5067 00000100:00100000:0.0:1763334981.720670:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5068 00000100:00100000:1.0:1763334981.720678:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2360:x1848989694615808:12345-192.168.201.60@tcp:1:lfs.0 00000100:00100000:0.0:1763334981.720678:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2360:x1848989694616064:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334981.720738:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.720738:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.720760:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c8e0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b047a expref: 33 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.720761:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849c7cf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b040a expref: 33 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.720770:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334981.720772:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334981.720774:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334981.720776:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334981.720777:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.720778:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.720818:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c8e0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b047a expref: 33 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.720818:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849c7cf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b040a expref: 33 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.720834:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849c7cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b040a expref: 33 pid: 6517 timeout: 1146 lvb_type: 0 00010000:00010000:1.0:1763334981.720839:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c8e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b047a expref: 33 pid: 7819 timeout: 1146 lvb_type: 0 00000100:00100000:1.0:1763334981.720855:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701884160:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334981.720955:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701884032:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334981.720960:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1763334981.720992:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98000 going to sleep for 11 seconds 00000100:00100000:0.0:1763334981.721014:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5069 00000100:00100000:0.0:1763334981.721021:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694615936:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:0.0:1763334981.721048:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.721060:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0403 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.721066:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334981.721069:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334981.721071:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.721091:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0403 expref: 27 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.721100:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0403 expref: 27 pid: 6517 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334981.721112:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701884288:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334981.721136:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b989c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334981.729147:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.729193:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.729280:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701884288:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334981.729316:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334981.729365:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.729395:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694616320 00000100:00100000:0.0:1763334981.729404:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694616320 00010000:00010000:0.0:1763334981.729451:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849c7cf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b040a expref: 34 pid: 6517 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334981.729483:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694616192 00000100:00100000:0.0:1763334981.729486:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694616192 00010000:00010000:0.0:1763334981.729499:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c8e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b047a expref: 35 pid: 7819 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334981.729519:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694616448 00000100:00100000:0.0:1763334981.729521:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694616448 00010000:00010000:0.0:1763334981.729537:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0403 expref: 28 pid: 6517 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334981.729554:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2655 00000100:00100000:0.0:1763334981.729564:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+35:2360:x1848989694616320:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334981.729614:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334981.729643:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849c7cf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b040a expref: 35 pid: 6517 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.729658:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849c7cf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b040a expref: 35 pid: 6517 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.729691:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.729693:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.729699:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.729712:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.729733:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334981.729792:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+35:2360:x1848989694616320:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 228us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334981.729800:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2655 00000100:00100000:0.0:1763334981.729821:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2656 00000100:00100000:0.0:1763334981.729826:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+34:2359:x1848989694616192:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334981.729833:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1763334981.729841:0:11727:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 28883 -> 200814 00010000:00010000:0.0:1763334981.729846:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c8e0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b047a expref: 34 pid: 7819 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.729856:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c8e0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b047a expref: 34 pid: 7819 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.729868:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.729870:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.729873:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.729881:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.729892:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334981.729912:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+34:2359:x1848989694616192:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 85us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334981.729918:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2656 00000100:00100000:0.0:1763334981.729975:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2657 00000100:00100000:0.0:1763334981.729983:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694616448:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334981.729991:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334981.730005:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0403 expref: 28 pid: 6517 timeout: 1146 lvb_type: 0 00010000:00010000:1.0:1763334981.730249:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067200/0xcedf0054f849c8e0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b047a expref: 33 pid: 7819 timeout: 1146 lvb_type: 0 00000100:00100000:1.0:1763334981.730265:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a23100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701884160:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334981.730281:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.730289:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.730297:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.730334:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.730342:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.730350:0:26216:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.730356:0:26216:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334981.730361:0:26216:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.730370:0:26216:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.730382:0:26216:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.730390:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cafb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334981.730442:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2360:x1848989694615808:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 9770us (10877us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.730450:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5067 00010000:00010000:2.0:1763334981.730747:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478800/0xcedf0054f849c7cf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b040a expref: 31 pid: 6517 timeout: 1146 lvb_type: 0 00000100:00100000:2.0:1763334981.730758:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a83b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701884032:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334981.730771:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.730778:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.730784:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.730802:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.730808:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.730814:0:21625:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.730821:0:21625:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334981.730823:0:21625:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.730837:0:21625:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.730849:0:21625:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.730856:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849caf4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334981.730901:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694616064:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 10224us (11251us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334981.730909:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5068 00010000:00010000:0.0:1763334981.734188:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0403 expref: 28 pid: 6517 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.734225:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849c7c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0403 expref: 28 pid: 6517 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334981.734242:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.734244:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.734251:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.734262:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.734318:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334981.734406:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694616448:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4421us (5037us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334981.734417:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2657 00010000:00010000:2.0:1763334981.734526:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.734537:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.734608:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.734617:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.734625:0:26564:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.734637:0:26564:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334981.734641:0:26564:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.734650:0:26564:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.734663:0:26564:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.734671:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334981.734730:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694615936:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 13709us (15049us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334981.734740:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5069 00000100:00100000:1.0:1763334981.740835:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.740942:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694616704 00000100:00100000:2.0:1763334981.740956:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694616704 00000100:00100000:2.0:1763334981.741176:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4991 00000100:00100000:2.0:1763334981.741190:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+224:53661:x1848989694616704:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334981.741258:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1763334981.741292:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cad8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b051b expref: 224 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.741315:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849c9f8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b04dc expref: 223 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.741326:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:2.0:1763334981.741331:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334981.741369:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cb09 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.741384:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cb09 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334981.741394:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cb09 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000040:00080000:2.0:1763334981.741952:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1170, 88 off100128 00000004:00080000:2.0:1763334981.741973:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1046375400429ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334981.742010:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1160, 88 off99072 00000004:00080000:2.0:1763334981.742014:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1046375442430ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334981.742038:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1161, 88 off99160 00000004:00080000:2.0:1763334981.742041:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1046375468930ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334981.742052:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1171, 88 off100216 00000004:00080000:2.0:1763334981.742055:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1046375483700ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334981.742066:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1162, 88 off99248 00000004:00080000:2.0:1763334981.742069:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1046375497678ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334981.742080:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1172, 88 off100304 00000004:00080000:2.0:1763334981.742083:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1046375511476ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334981.742094:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1173, 88 off100392 00000004:00080000:2.0:1763334981.742096:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1046375524673ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334981.742107:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1163, 88 off99336 00000004:00080000:2.0:1763334981.742109:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1046375537551ns, next at 1047075229764ns, rc = 0 00000001:00080000:3.0:1763334981.781662:0:32484:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939197 is committed 00000020:00080000:3.0:1763334981.781704:0:32484:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969317 batchid updated 00000001:00080000:3.0:1763334981.781719:0:32484:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939202 is committed 00000001:00080000:3.0:1763334981.781746:0:32484:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939203 is committed 00000004:00080000:3.0:1763334981.781752:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 773 committed 00000004:00080000:3.0:1763334981.781765:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 785 committed 00000004:00080000:3.0:1763334981.781774:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 784 committed 00000004:00080000:3.0:1763334981.781777:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 772 committed 00000004:00080000:3.0:1763334981.781779:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 783 committed 00000004:00080000:3.0:1763334981.781781:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 771 committed 00000004:00080000:3.0:1763334981.781783:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 770 committed 00000004:00080000:3.0:1763334981.781784:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 782 committed 00000004:00080000:3.0:1763334981.781801:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 769 committed 00000004:00080000:3.0:1763334981.781803:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 781 committed 00000020:00080000:3.0:1763334981.781816:0:32484:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a5ac57b5c00 refcount 2 committed 0 result 0 batchid 4294969318 00000020:00080000:3.0:1763334981.781821:0:32484:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5ac4808c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a5ac57b5780 00000020:00080000:3.0:1763334981.781825:0:32484:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5ac8d70600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a5ac57b50c0 00000020:00080000:3.0:1763334981.781828:0:32484:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5ac8d70400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a5afb24c000 00000020:00080000:3.0:1763334981.781831:0:32484:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].12 00000100:00100000:3.0:1763334981.781992:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701884416:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1763334981.782072:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334981.782105:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5501880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701884928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334981.782124:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334981.782148:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334981.782153:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701884800:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334981.782169:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334981.782193:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701884544:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334981.782212:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334981.782227:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763334981.782232:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701884672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334981.782249:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334981.782280:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701884416 00000100:00100000:3.0:1763334981.782287:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701884416 00000100:00100000:3.0:1763334981.782335:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701884928 00000100:00100000:3.0:1763334981.782337:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701884928 00000100:00100000:3.0:1763334981.782350:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701884800 00000100:00100000:3.0:1763334981.782352:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701884800 00000100:00100000:3.0:1763334981.782366:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701884544 00000100:00100000:3.0:1763334981.782368:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701884544 00000100:00100000:3.0:1763334981.782381:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701884672 00000100:00100000:3.0:1763334981.782383:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701884672 00000100:00100000:3.0:1763334981.782401:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5070 00000100:00100000:3.0:1763334981.782410:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701884416:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1763334981.782439:0:21625:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:589 count 1 00010000:00010000:3.0:1763334981.782486:0:21625:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.782512:0:21625:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c838 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b042d expref: 29 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334981.782522:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334981.782525:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334981.782530:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.782561:0:21625:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c838 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b042d expref: 29 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334981.782601:0:21625:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c838 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b042d expref: 29 pid: 32239 timeout: 1146 lvb_type: 1 00000100:00100000:3.0:1763334981.782614:0:21625:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701885056:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334981.782681:0:21625:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad830c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334981.782697:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5071 00000100:00100000:3.0:1763334981.782705:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701884928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334981.782953:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 158406 -> 158406 00002000:00010000:3.0:1763334981.782958:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334981.782972:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334981.782975:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:3.0:1763334981.782977:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334981.783025:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701884928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 321us (899us total) trans 17179871236 rc 0/0 00000100:00100000:3.0:1763334981.783033:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5071 00000100:00100000:3.0:1763334981.783055:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5072 00000100:00100000:3.0:1763334981.783061:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701884800:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334981.783132:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334981.783136:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334981.783139:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334981.783141:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334981.783144:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334981.783165:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701884800:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (994us total) trans 17179871237 rc 0/0 00000100:00100000:3.0:1763334981.783170:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5072 00000100:00100000:3.0:1763334981.783182:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5073 00000100:00100000:3.0:1763334981.783187:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701884544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334981.783275:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701884544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 88us (1062us total) trans 17179871238 rc 0/0 00000100:00100000:3.0:1763334981.783281:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5073 00000100:00100000:3.0:1763334981.783292:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5074 00000100:00100000:3.0:1763334981.783298:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701884672:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334981.783379:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701884672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (1128us total) trans 17179871239 rc 0/0 00000100:00100000:3.0:1763334981.783385:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5074 00000004:00080000:3.0:1763334981.783613:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5501180/2, rc 0, transno 17179871239 00000100:00100000:3.0:1763334981.783621:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701884672:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334981.783630:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5500380/2, rc 0, transno 17179871238 00000100:00100000:3.0:1763334981.783634:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701884544:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334981.783651:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5503b80/2, rc 0, transno 17179871237 00000100:00100000:3.0:1763334981.783655:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701884800:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334981.783662:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5501880/2, rc 0, transno 17179871236 00000100:00100000:3.0:1763334981.783665:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5501880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701884928:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1763334981.783700:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000867616e2 reply state 0000000092e6b358 transno 8589939203 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cb09 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:3.0:1763334981.783713:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1763334981.783791:0:29628:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763334981.783803:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53661:x1848989694616704:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 42616us (42982us total) trans 8589939203 rc 0/0 00000100:00100000:3.0:1763334981.783812:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4991 00010000:00010000:3.0:1763334981.783835:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cb09 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.783843:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cb09 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.783852:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cb09 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.783858:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c314b400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334981.783863:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cb09 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.783872:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cb09 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.783890:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:3.0:1763334981.783893:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334981.783899:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cb09 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334981.783905:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cb09 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334981.784291:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701885312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334981.784341:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334981.784376:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1763334981.784381:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701885184:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334981.784402:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334981.784415:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701885696:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334981.784432:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334981.784493:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701885312 00000100:00100000:2.0:1763334981.784502:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701885312 00000100:00100000:2.0:1763334981.784548:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701885184 00000100:00100000:2.0:1763334981.784551:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701885184 00000100:00100000:2.0:1763334981.784564:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701885696 00000100:00100000:2.0:1763334981.784566:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701885696 00000100:00100000:2.0:1763334981.784605:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5075 00000100:00100000:2.0:1763334981.784614:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3290:x1848989701885312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334981.784802:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334981.784806:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334981.784808:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1763334981.784810:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334981.784812:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334981.784855:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3290:x1848989701885312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 241us (514us total) trans 21474838485 rc 0/0 00000100:00100000:2.0:1763334981.784862:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5075 00000100:00100000:2.0:1763334981.784879:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5076 00000100:00100000:2.0:1763334981.784884:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+22:3290:x1848989701885184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1763334981.784900:0:26564:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:585 count 1 00010000:00010000:2.0:1763334981.784920:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.784939:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c4e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f2 expref: 25 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.784948:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334981.784950:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334981.784954:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.785005:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c4e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f2 expref: 25 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.785018:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c4e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f2 expref: 25 pid: 26564 timeout: 1146 lvb_type: 0 00000100:00100000:2.0:1763334981.785031:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701885824:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334981.785095:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af69b2540 going to sleep for 11 seconds 00000004:00080000:2.0:1763334981.785134:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c4700/2, rc 0, transno 21474838485 00000100:00100000:2.0:1763334981.785141:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701885312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334981.785632:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5077 00000100:00100000:1.0:1763334981.785645:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3290:x1848989701885696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334981.785808:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334981.785812:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334981.785814:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334981.785817:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334981 -> 1763334981 00002000:00010000:1.0:1763334981.785819:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334981.785867:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3290:x1848989701885696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 226us (1433us total) trans 21474838486 rc 0/0 00000100:00100000:1.0:1763334981.785875:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5077 00000004:00080000:2.0:1763334981.786177:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c5f80/2, rc 0, transno 21474838486 00000100:00100000:2.0:1763334981.786185:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701885696:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1763334981.787502:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969318 committed batchid 4294969317 00000020:00080000:0.0:1763334981.787940:0:29663:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969317 cancel update log [0x200000bd0:0x1:0x0].11: rc = 0 00000020:00080000:0.0:1763334981.787954:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969317 00000100:00100000:3.0:1763334981.791371:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701885440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334981.791488:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334981.796019:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763334981.796049:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701885568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334981.796129:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334981.796268:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334981.796814:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701885440 00000100:00100000:1.0:1763334981.796828:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701885440 00000100:00100000:1.0:1763334981.796905:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5078 00000100:00100000:1.0:1763334981.796917:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+23:3291:x1848989701885440:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334981.797279:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+24:3291:x1848989701885440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 364us (5790us total) trans 21474838487 rc 0/0 00000100:00100000:1.0:1763334981.797288:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5078 00000100:00100000:0.0:1763334981.798151:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.798225:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694616832 00000100:00100000:0.0:1763334981.798235:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694616832 00010000:00010000:0.0:1763334981.798277:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c838 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b042d expref: 30 pid: 32239 timeout: 1146 lvb_type: 1 00000100:00100000:0.0:1763334981.798321:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2658 00000100:00100000:0.0:1763334981.798331:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694616832:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334981.798347:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334981.798353:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c838 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b042d expref: 30 pid: 32239 timeout: 1146 lvb_type: 1 00010000:00010000:0.0:1763334981.798367:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c838 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b042d expref: 30 pid: 32239 timeout: 1146 lvb_type: 1 00010000:00010000:0.0:1763334981.798399:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.798401:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.798407:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.798417:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.798443:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334981.798500:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694616832:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 170us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334981.798507:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2658 00010000:00010000:0.0:1763334981.798688:0:21625:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849c838 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b042d expref: 29 pid: 32239 timeout: 1146 lvb_type: 1 00000100:00100000:0.0:1763334981.798704:0:21625:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:21625:1848989701885056:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334981.798728:0:21625:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.798739:0:21625:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.798746:0:21625:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.798757:0:21625:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.798765:0:21625:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.798787:0:21625:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1763334981.799354:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701884416:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16943us (17280us total) trans 17179871240 rc 0/0 00000100:00100000:0.0:1763334981.799363:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5070 00000004:00080000:2.0:1763334981.800171:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5502300/2, rc 0, transno 17179871240 00000100:00100000:2.0:1763334981.800185:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5502300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701884416:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1763334981.800206:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334981.800215:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.800226:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334981.800232:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.800243:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.800280:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.800286:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849cb10 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.800309:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334981.800311:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334981.800313:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334981.800462:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c6a00/2, rc 0, transno 21474838487 00000100:00100000:3.0:1763334981.800469:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701885440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334981.800599:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701885824:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334981.800622:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334981.800760:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.800783:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694617088 00000100:00100000:3.0:1763334981.800791:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694617088 00010000:00010000:3.0:1763334981.800824:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c4e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f2 expref: 26 pid: 26564 timeout: 1146 lvb_type: 0 00000100:00100000:3.0:1763334981.800852:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2659 00000100:00100000:3.0:1763334981.800861:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694617088:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334981.800874:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334981.800880:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c4e9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f2 expref: 26 pid: 26564 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334981.800892:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c4e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f2 expref: 26 pid: 26564 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334981.800912:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849c4e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x249:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400030020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b02f2 expref: 26 pid: 26564 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334981.800926:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334981.800928:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334981.800933:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.800944:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.800978:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334981.801023:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694617088:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 163us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334981.801030:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2659 00010000:00010000:3.0:1763334981.801075:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.801082:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.801092:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.801100:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.801117:0:26564:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1763334981.801647:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3290:x1848989701885184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16761us (17242us total) trans 21474838488 rc 0/0 00000100:00100000:3.0:1763334981.801656:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5076 00000100:00100000:3.0:1763334981.801671:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701885568 00000100:00100000:3.0:1763334981.801675:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701885568 00000100:00100000:3.0:1763334981.801696:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5079 00000100:00100000:3.0:1763334981.801701:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+24:3291:x1848989701885568:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334981.801829:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 217778 -> 217778 00002000:00010000:3.0:1763334981.801833:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334981.801835:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334981.801838:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334979 -> 1763334979 00002000:00010000:3.0:1763334981.801840:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334981.801870:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+25:3291:x1848989701885568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (5740us total) trans 21474838489 rc 0/0 00000100:00100000:3.0:1763334981.801877:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5079 00010000:00010000:3.0:1763334981.801896:0:8205:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334981.801903:0:8205:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.801912:0:8205:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c314b600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334981.801915:0:8205:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.801924:0:8205:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.801938:0:8205:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.801951:0:8205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59c314b600/0xcedf0054f849cb17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x249:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.801976:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334981.801978:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334981.801979:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1763334981.802006:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c7800/2, rc 0, transno 21474838489 00000100:00100000:3.0:1763334981.802012:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701885568:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334981.802033:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c4000/2, rc 0, transno 21474838488 00000100:00100000:3.0:1763334981.802037:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701885184:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1763334981.802859:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694616960 00000100:00100000:1.0:1763334981.802871:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694616960 00000100:00100000:1.0:1763334981.802932:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4992 00000100:00100000:1.0:1763334981.802941:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53661:x1848989694616960:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334981.802972:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334981.802998:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849cb1e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0529 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.803069:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849cb1e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0529 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.803086:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849cb1e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0529 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.803105:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334981.803108:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334981.803112:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334981.803179:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53661:x1848989694616960:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 239us (5034us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334981.803185:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4992 00000100:00100000:0.0:1763334981.808803:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.810772:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694617216 00000100:00100000:2.0:1763334981.810791:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694617216 00000100:00100000:2.0:1763334981.810874:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4993 00000100:00100000:2.0:1763334981.810885:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53661:x1848989694617216:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334981.810911:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334981.810939:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cb25 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0530 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.811055:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849cb2c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.811072:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849cb2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.811085:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849cb2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334981.811118:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00000004:00200000:2.0:1763334981.811123:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334981.811142:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849cb2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334981.811169:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b400/0xcedf0054f849cb25 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0530 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.811188:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849cb2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0530 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.811197:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:2.0:1763334981.811201:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334981.811206:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c314b800, rc 0) 00000100:00100000:2.0:1763334981.811286:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53661:x1848989694617216:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 402us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334981.811293:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4993 00000100:00100000:2.0:1763334981.820604:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.820648:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.820678:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.822594:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694617344 00000100:00100000:0.0:1763334981.822616:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694617344 00000100:00100000:0.0:1763334981.822686:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694617472 00000100:00100000:0.0:1763334981.822690:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694617472 00000100:00100000:0.0:1763334981.822717:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694617600 00000100:00100000:0.0:1763334981.822721:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694617600 00000100:00100000:1.0:1763334981.822750:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5080 00000100:00100000:1.0:1763334981.822767:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2362:x1848989694617344:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334981.822791:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334981.822821:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cb33 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0537 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334981.822998:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 200814, mtime: 0x691a5b45, atime: 0x691a5b44, ctime: 0x691a5b45, blocks: 0xd3 00010000:00010000:1.0:1763334981.823028:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334981.823031:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334981.823046:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cb33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0537 expref: 31 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334981.823069:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cb33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0537 expref: 31 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334981.823086:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:1.0:1763334981.823165:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2362:x1848989694617344:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 403us (2607us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334981.823356:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5081 00000100:00100000:2.0:1763334981.823362:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5082 00000100:00100000:0.0:1763334981.823366:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2362:x1848989694617472:12345-192.168.201.60@tcp:101:lfs.0 00000100:00100000:2.0:1763334981.823372:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2362:x1848989694617600:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334981.823379:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334981.823379:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334981.823392:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b400/0xcedf0054f849cb3a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0545 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.823392:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cb41 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b053e expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334981.823408:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x691a5b45, atime: 0x691a5b44, ctime: 0x691a5b45, blocks: 0x3 00002000:00010000:0.0:1763334981.823410:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x248:0x0] initial LVB size: 0, mtime: 0x691a5b45, atime: 0x691a5b44, ctime: 0x691a5b45, blocks: 0x3 00010000:00010000:2.0:1763334981.823417:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.823418:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334981.823419:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.823420:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334981.823425:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b400/0xcedf0054f849cb3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0545 expref: 32 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334981.823425:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cb41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b053e expref: 26 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334981.823438:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cb41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b053e expref: 26 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334981.823441:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b400/0xcedf0054f849cb3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0545 expref: 32 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334981.823447:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00010000:00010000:2.0:1763334981.823449:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59c314b400, rc 0) 00000100:00100000:2.0:1763334981.823469:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2362:x1848989694617600:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 99us (2790us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334981.823474:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694617472:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 112us (2827us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334981.823476:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5082 00000100:00100000:0.0:1763334981.823480:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5081 00000100:00100000:1.0:1763334981.823534:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5080 00000100:00100000:0.0:1763334981.860879:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334981.861031:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694617728 00000100:00100000:2.0:1763334981.861048:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694617728 00000100:00100000:2.0:1763334981.861153:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1914 00000100:00100000:2.0:1763334981.861168:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694617728:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334981.861223:0:21629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b600/0xcedf0054f849cb48 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.861243:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334981.861246:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334981.861253:0:21629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b600/0xcedf0054f849cb48 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.861271:0:21629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b600/0xcedf0054f849cb48 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.870872:0:21629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b600/0xcedf0054f849cb48 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.870898:0:21629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b600/0xcedf0054f849cb48 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.870909:0:21629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b600/0xcedf0054f849cb48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.870916:0:21629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59c314b600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334981.870921:0:21629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b600/0xcedf0054f849cb48 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.870931:0:21629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b600/0xcedf0054f849cb48 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.870953:0:21629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b600/0xcedf0054f849cb48 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.870968:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b600/0xcedf0054f849cb48 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334981.872094:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694617728:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 10916us (11216us total) trans 0 rc 200814/200814 00000100:00100000:2.0:1763334981.872110:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1914 00000100:00100000:2.0:1763334981.876174:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334981.876289:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694617856 00000100:00100000:0.0:1763334981.876304:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694617856 00000100:00100000:0.0:1763334981.876875:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1915 00000100:00100000:0.0:1763334981.876890:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694617856:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:0.0:1763334981.876940:0:21629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.876977:0:21629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c83f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0434 expref: 26 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334981.876995:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.876997:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334981.877002:0:21629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334981.877054:0:21629:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c83f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0434 expref: 26 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334981.877072:0:21629:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c83f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0434 expref: 26 pid: 21625 timeout: 1146 lvb_type: 1 00000100:00100000:0.0:1763334981.877091:0:21629:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:21629:1848989701885952:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334981.877221:0:21629:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98c00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334981.881562:0:21629:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0000_UUID:21629:1848989701885952:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334981.881630:0:21629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334981.882278:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.882567:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694617984 00000100:00100000:3.0:1763334981.882618:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694617984 00010000:00010000:3.0:1763334981.882670:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c83f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0434 expref: 27 pid: 21625 timeout: 1146 lvb_type: 1 00000100:00100000:3.0:1763334981.882712:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2660 00000100:00100000:3.0:1763334981.882723:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2362:x1848989694617984:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334981.882744:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334981.882773:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c83f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0434 expref: 27 pid: 21625 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334981.882788:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c83f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0434 expref: 27 pid: 21625 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334981.882821:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849c83f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0434 expref: 27 pid: 21625 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334981.882845:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334981.882847:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334981.882853:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.882864:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.883941:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334981.884049:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694617984:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1322us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334981.884062:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2660 00010000:00010000:2.0:1763334981.884862:0:21629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.884878:0:21629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00000001:00080000:2.0:1763334981.935823:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838484 is committed 00000001:00080000:2.0:1763334981.935844:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838482 is committed 00000001:00080000:2.0:1763334981.935908:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838487 is committed 00000001:00080000:2.0:1763334981.935938:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838490 is committed 00000001:00080000:2.0:1763334981.935982:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838489 is committed 00002000:00010000:2.0:1763334981.936211:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334979 -> 1763334982 00002000:00010000:2.0:1763334981.936217:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334979 -> 1763334982 00010000:00010000:2.0:1763334981.936238:0:21629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.936253:0:21629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.936263:0:21629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.936272:0:21629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334981.936277:0:21629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.936288:0:21629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.936314:0:21629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.936322:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cb4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334981.936461:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2362:x1848989694617856:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 59568us (60294us total) trans 21474838490 rc 0/0 00000100:00100000:2.0:1763334981.936473:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1915 00000100:00100000:2.0:1763334981.940850:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.941037:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694618112 00000100:00100000:3.0:1763334981.941052:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694618112 00000100:00100000:3.0:1763334981.941152:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1916 00000100:00100000:3.0:1763334981.941164:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2361:x1848989694618112:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:3.0:1763334981.941221:0:21629:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.941245:0:21629:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c8bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0465 expref: 31 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334981.941254:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334981.941257:0:21629:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334981.941261:0:21629:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.941315:0:21629:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c8bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0465 expref: 31 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334981.941332:0:21629:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c8bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0465 expref: 31 pid: 32239 timeout: 1146 lvb_type: 1 00000100:00100000:3.0:1763334981.941352:0:21629:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab37100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:21629:1848989701886080:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334981.941475:0:21629:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530d80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334981.944538:0:21629:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab37100 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_006:lustre-OST0001_UUID:21629:1848989701886080:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334981.944623:0:21629:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334981.945978:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334981.946216:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694618240 00000100:00100000:3.0:1763334981.946229:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694618240 00010000:00010000:3.0:1763334981.946287:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c8bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0465 expref: 32 pid: 32239 timeout: 1146 lvb_type: 1 00000100:00100000:3.0:1763334981.946778:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2661 00000100:00100000:3.0:1763334981.946792:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2359:x1848989694618240:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334981.946814:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334981.946843:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c8bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0465 expref: 32 pid: 32239 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334981.946859:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c8bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0465 expref: 32 pid: 32239 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334981.946890:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849c8bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0465 expref: 32 pid: 32239 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334981.946911:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334981.946914:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334981.946920:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.946931:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334981.946979:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334981.947133:0:21629:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334981.947143:0:21629:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334981.950340:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2359:x1848989694618240:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 3533us (4362us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334981.950359:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2661 00000001:00080000:2.0:1763334981.995996:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871240 is committed 00000001:00080000:2.0:1763334981.996020:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871233 is committed 00000001:00080000:2.0:1763334981.996069:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871241 is committed 00002000:00010000:1.0:1763334981.996413:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 158406 -> 204800 00002000:00010000:1.0:1763334981.996420:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334980 -> 1763334982 00002000:00010000:1.0:1763334981.996423:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334981 -> 1763334982 00010000:00010000:1.0:1763334981.996442:0:21629:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.996457:0:21629:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.996467:0:21629:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.996476:0:21629:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334981.996481:0:21629:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.996492:0:21629:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.996523:0:21629:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334981.996531:0:21629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cb56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 21629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334981.997371:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2361:x1848989694618112:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 56196us (56525us total) trans 17179871241 rc 0/0 00000100:00100000:1.0:1763334981.997387:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1916 00000100:00100000:2.0:1763334982.012128:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.013714:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694618496 00000100:00100000:1.0:1763334982.013733:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694618496 00000100:00100000:1.0:1763334982.013829:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4994 00000100:00100000:1.0:1763334982.013841:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53661:x1848989694618496:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334982.013918:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334982.013966:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59c314b800/0xcedf0054f849cb2c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0530 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.013992:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334982.013998:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334982.014349:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849cb5d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334982.014366:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849cb5d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334982.014376:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849cb5d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000001:00080000:1.0:1763334982.015072:0:29628:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939204 00000004:00010000:1.0:1763334982.015120:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000001d1a5c11 reply state 000000007d0d33c9 transno 8589939205 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849cb5d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334982.015134:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334982.015796:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53661:x1848989694618496:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 1949us (3677us total) trans 8589939205 rc 0/0 00000100:00100000:1.0:1763334982.015807:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4994 00000020:00080000:1.0:1763334982.015816:0:29628:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1763334982.019374:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849cb5d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.019398:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849cb5d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.019407:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849cb5d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.019414:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334982.019420:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849cb5d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.019430:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849cb5d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.019459:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:0.0:1763334982.019463:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334982.019469:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849cb5d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.019476:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849cb5d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334982.019768:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.020108:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694618624 00000100:00100000:3.0:1763334982.020122:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694618624 00000100:00100000:3.0:1763334982.020510:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5083 00000100:00100000:3.0:1763334982.020525:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+13:53661:x1848989694618624:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334982.020551:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334982.020608:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cb64 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b054c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334982.020639:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 217778, mtime: 0x691a5b46, atime: 0x691a5b40, ctime: 0x691a5b46, blocks: 0x203 00010000:00010000:3.0:1763334982.020667:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.020670:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.020679:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cb64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b054c expref: 14 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.020698:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cb64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b054c expref: 14 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.020712:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:3.0:1763334982.020777:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+14:53661:x1848989694618624:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 256us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334982.020785:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5083 00000100:00100000:2.0:1763334982.023836:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.024343:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.024820:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694618752 00000100:00100000:1.0:1763334982.024834:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694618752 00002000:00010000:1.0:1763334982.024898:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/586 (200814->18446744073709551615) 00002000:00100000:1.0:1763334982.024904:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e86300 with x1848989694618752 ext(200814->18446744073709551615) 00002000:00010000:1.0:1763334982.024919:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9e86300. 00000100:00100000:3.0:1763334982.025134:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694618880 00000100:00100000:3.0:1763334982.025139:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694618880 00002000:00010000:3.0:1763334982.025158:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/590 (0->18446744073709551615) 00002000:00100000:3.0:1763334982.025162:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e87480 with x1848989694618880 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334982.025169:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9e87480. 00000100:00100000:1.0:1763334982.025387:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1917 00000100:00100000:1.0:1763334982.025399:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2361:x1848989694618752:12345-192.168.201.60@tcp:10:lfs.0 00000100:00100000:0.0:1763334982.025862:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1918 00000100:00100000:0.0:1763334982.025876:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2361:x1848989694618880:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:0.0:1763334982.026198:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334982.026203:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334979 -> 1763334982 00002000:00010000:0.0:1763334982.026206:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334982.026208:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334979 -> 1763334982 00002000:00010000:0.0:1763334982.026211:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1763334982.026525:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 217778 -> 200814 00002000:00010000:1.0:1763334982.026528:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334982 -> 1763334982 00002000:00010000:1.0:1763334982.026531:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334982.026533:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:1.0:1763334982.026535:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1763334982.026985:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694618880:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 1109us (2638us total) trans 17179871242 rc 0/0 00000100:00100000:0.0:1763334982.026997:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1918 00002000:00010000:0.0:1763334982.027003:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/590 (0->18446744073709551615) 00002000:00100000:0.0:1763334982.027007:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e87480 with x1848989694618880 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334982.027015:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9e87480. 00000100:00100000:1.0:1763334982.027062:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2361:x1848989694618752:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 1664us (3494us total) trans 21474838491 rc 0/0 00000100:00100000:1.0:1763334982.027068:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1917 00002000:00010000:1.0:1763334982.027070:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/586 (200814->18446744073709551615) 00002000:00100000:1.0:1763334982.027073:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e86300 with x1848989694618752 ext(200814->18446744073709551615) 00002000:00010000:1.0:1763334982.027079:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9e86300. 00000100:00100000:2.0:1763334982.030227:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.030340:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694619008 00000100:00100000:1.0:1763334982.030355:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694619008 00000100:00100000:1.0:1763334982.030434:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4995 00000100:00100000:1.0:1763334982.030446:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53661:x1848989694619008:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334982.030479:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334982.030508:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849cb6b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0553 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.030700:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb72 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334982.030719:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334982.030733:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:1.0:1763334982.030773:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00000004:00200000:1.0:1763334982.030778:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334982.030798:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334982.030826:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849cb6b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0553 expref: 193 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.030849:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb72 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0553 expref: 192 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.030858:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334982.030862:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334982.030866:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334982.030938:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53661:x1848989694619008:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 494us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334982.030946:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4995 00000100:00100000:0.0:1763334982.034485:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.034789:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694619264 00000100:00100000:3.0:1763334982.034804:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694619264 00000100:00100000:3.0:1763334982.034884:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4996 00000100:00100000:3.0:1763334982.034897:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53661:x1848989694619264:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:3.0:1763334982.034987:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334982.035024:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb72 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0553 expref: 192 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.035050:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:3.0:1763334982.035057:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334982.035389:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cb79 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.035405:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cb79 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.035416:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cb79 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:3.0:1763334982.035472:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939206 00000004:00010000:3.0:1763334982.035499:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000c59edbfc reply state 00000000a6b73c11 transno 8589939207 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cb79 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334982.035509:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334982.035704:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53661:x1848989694619264:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 809us (1233us total) trans 8589939207 rc 0/0 00000100:00100000:3.0:1763334982.035714:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4996 00000020:00080000:3.0:1763334982.035722:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1763334982.040278:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cb79 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.040303:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cb79 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.040312:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cb79 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.040320:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334982.040325:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cb79 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.040334:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cb79 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.040357:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334982.040361:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334982.040366:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cb79 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.040373:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cb79 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334982.040760:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.040855:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694619392 00000100:00100000:3.0:1763334982.040872:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694619392 00000100:00100000:3.0:1763334982.040935:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5084 00000100:00100000:3.0:1763334982.040946:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:53661:x1848989694619392:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334982.040976:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334982.041003:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cb80 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b055a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334982.041031:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 204800, mtime: 0x691a5b46, atime: 0x691a5b44, ctime: 0x691a5b46, blocks: 0x203 00010000:00010000:3.0:1763334982.041057:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.041060:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.041069:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cb80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b055a expref: 22 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.041086:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cb80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b055a expref: 22 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.041106:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:3.0:1763334982.041812:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:53661:x1848989694619392:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 862us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334982.041823:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5084 00000100:00100000:2.0:1763334982.044696:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.044820:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694619520 00000100:00100000:0.0:1763334982.044834:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694619520 00000100:00100000:0.0:1763334982.044910:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5085 00000100:00100000:0.0:1763334982.044922:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+15:53661:x1848989694619520:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334982.044949:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334982.044986:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb87 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0561 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.045025:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c7ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03f5 expref: 16 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.045033:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334982.045036:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334982.045041:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb87 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0561 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.045084:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c7ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03f5 expref: 16 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.045098:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c7ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03f5 expref: 16 pid: 32239 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334982.045114:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701886208:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334982.045216:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98300 going to sleep for 11 seconds 00000100:00100000:2.0:1763334982.047803:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a82d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701886208:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334982.047854:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb87 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0561 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.047881:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792800, rc 0) 00000100:00100000:2.0:1763334982.047972:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+16:53661:x1848989694619520:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3050us (3289us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.047982:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5085 00000100:00100000:2.0:1763334982.050134:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.050280:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694619648 00000100:00100000:3.0:1763334982.050293:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694619648 00010000:00010000:3.0:1763334982.050347:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c7ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03f5 expref: 16 pid: 32239 timeout: 1146 lvb_type: 0 00000100:00100000:3.0:1763334982.050397:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2662 00000100:00100000:3.0:1763334982.050408:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694619648:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334982.050428:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334982.050456:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c7ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03f5 expref: 16 pid: 32239 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334982.050472:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c7ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03f5 expref: 16 pid: 32239 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334982.050501:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849c7ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b03f5 expref: 16 pid: 32239 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334982.050520:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.050522:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.050529:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb87 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0561 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.050546:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0561 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.050632:0:11727:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792800/0xcedf0054f849cb87 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0561 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334982.050650:0:11727:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab37100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11727:1848989701886336:192.168.201.60@tcp:105: 00000100:00100000:3.0:1763334982.050749:0:11727:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530d80 going to sleep for 11 seconds 00000100:00100000:0.0:1763334982.054999:0:11727:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab37100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11727:1848989701886336:192.168.201.60@tcp:105: 00010000:00010000:0.0:1763334982.055045:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334982.055851:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694619648:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5436us (5724us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334982.055870:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2662 00000100:00100000:2.0:1763334982.056253:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.056436:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.056546:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694619776 00000100:00100000:1.0:1763334982.056558:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694619776 00002000:00010000:1.0:1763334982.056630:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/591 (200814->18446744073709551615) 00002000:00100000:1.0:1763334982.056636:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e84000 with x1848989694619776 ext(200814->18446744073709551615) 00002000:00010000:1.0:1763334982.056653:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9e84000. 00000100:00100000:1.0:1763334982.056682:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694619904 00000100:00100000:1.0:1763334982.056685:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694619904 00002000:00010000:1.0:1763334982.056695:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/587 (0->18446744073709551615) 00002000:00100000:1.0:1763334982.056698:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e87b80 with x1848989694619904 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334982.056705:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9e87b80. 00000100:00100000:1.0:1763334982.056728:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1919 00000100:00100000:1.0:1763334982.056737:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694619776:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:1.0:1763334982.057105:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 204800 -> 200814 00002000:00010000:1.0:1763334982.057109:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334982 -> 1763334982 00002000:00010000:1.0:1763334982.057112:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334982.057114:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:1.0:1763334982.057117:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1763334982.057172:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694619776:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 436us (921us total) trans 17179871243 rc 0/0 00000100:00100000:1.0:1763334982.057179:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1919 00002000:00010000:1.0:1763334982.057182:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/591 (200814->18446744073709551615) 00002000:00100000:1.0:1763334982.057185:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e84000 with x1848989694619776 ext(200814->18446744073709551615) 00002000:00010000:1.0:1763334982.057189:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9e84000. 00000100:00100000:1.0:1763334982.057206:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1920 00000100:00100000:1.0:1763334982.057212:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694619904:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:1.0:1763334982.057377:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334982.057380:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334980 -> 1763334982 00002000:00010000:1.0:1763334982.057383:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334982.057385:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334981 -> 1763334982 00002000:00010000:1.0:1763334982.057388:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334982.057408:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694619904:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 196us (972us total) trans 21474838492 rc 0/0 00000100:00100000:1.0:1763334982.057415:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1920 00002000:00010000:1.0:1763334982.057418:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/587 (0->18446744073709551615) 00002000:00100000:1.0:1763334982.057421:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e87b80 with x1848989694619904 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334982.057425:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9e87b80. 00000100:00100000:2.0:1763334982.061723:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.061831:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694620160 00000100:00100000:1.0:1763334982.061846:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694620160 00000100:00100000:1.0:1763334982.061986:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4997 00000100:00100000:1.0:1763334982.061999:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53661:x1848989694620160:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:1.0:1763334982.062145:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cb8e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334982.062168:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cb8e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334982.062181:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cb8e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00010000:1.0:1763334982.062388:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000008b271fc8 reply state 00000000cdc7be77 transno 8589939208 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cb8e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334982.062399:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334982.063250:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53661:x1848989694620160:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 1245us (1533us total) trans 8589939208 rc 0/0 00000100:00100000:1.0:1763334982.063264:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4997 00010000:00010000:0.0:1763334982.065851:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cb8e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.065875:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cb8e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.065884:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cb8e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.065891:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334982.065897:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cb8e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.065905:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cb8e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.065924:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:0.0:1763334982.065927:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334982.065932:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cb8e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.065939:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cb8e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334982.066451:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.066657:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694620288 00000100:00100000:0.0:1763334982.066670:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694620288 00000100:00100000:0.0:1763334982.066723:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5086 00000100:00100000:0.0:1763334982.066731:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:53661:x1848989694620288:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334982.066752:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334982.066773:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cb95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0568 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.066808:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cb33 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0537 expref: 24 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334982.066823:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.066826:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.066831:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cb95 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0568 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.066874:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cb33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0537 expref: 24 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334982.066889:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cb33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0537 expref: 24 pid: 26564 timeout: 1146 lvb_type: 1 00000100:00100000:0.0:1763334982.066904:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701886464:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334982.067018:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98f00 going to sleep for 11 seconds 00000100:00100000:0.0:1763334982.070665:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701886464:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334982.070715:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cb95 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0568 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.070740:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:1.0:1763334982.071181:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.071396:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694620416 00000100:00100000:3.0:1763334982.071406:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694620416 00010000:00010000:3.0:1763334982.071464:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cb33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0537 expref: 25 pid: 26564 timeout: 1146 lvb_type: 1 00000100:00100000:3.0:1763334982.071511:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2663 00000100:00100000:3.0:1763334982.071522:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694620416:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334982.071540:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334982.071566:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cb33 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0537 expref: 25 pid: 26564 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334982.071600:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cb33 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0537 expref: 25 pid: 26564 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334982.071631:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cb33 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0537 expref: 25 pid: 26564 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334982.071652:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.071654:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.071663:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cb95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0568 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.071675:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cb95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0568 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.071721:0:11727:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cb95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0568 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334982.071739:0:11727:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab36d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11727:1848989701886592:192.168.201.60@tcp:105: 00000100:00100000:0.0:1763334982.071853:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:53661:x1848989694620288:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5120us (5407us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334982.071863:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5086 00000100:00100000:3.0:1763334982.072472:0:11727:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530f00 going to sleep for 11 seconds 00000100:00100000:3.0:1763334982.076426:0:11727:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab36d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11727:1848989701886592:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334982.076466:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334982.076552:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694620416:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5028us (5371us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334982.076567:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2663 00000100:00100000:2.0:1763334982.077095:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.077178:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694620544 00000100:00100000:1.0:1763334982.077189:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694620544 00000100:00100000:1.0:1763334982.077245:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5087 00000100:00100000:1.0:1763334982.077256:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+16:53661:x1848989694620544:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334982.077276:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334982.077300:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb9c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b056f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.077335:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cb41 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b053e expref: 17 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334982.077345:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334982.077347:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334982.077352:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb9c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b056f expref: 17 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.077392:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cb41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b053e expref: 17 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334982.077408:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cb41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b053e expref: 17 pid: 25383 timeout: 1146 lvb_type: 1 00000100:00100000:1.0:1763334982.077425:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701886720:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334982.077491:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b000 going to sleep for 11 seconds 00000100:00100000:1.0:1763334982.080456:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.080698:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701886720:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334982.080726:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694620672 00000100:00100000:3.0:1763334982.080740:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694620672 00010000:00010000:0.0:1763334982.080743:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb9c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b056f expref: 17 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.080771:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00010000:00010000:3.0:1763334982.080785:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cb41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b053e expref: 18 pid: 25383 timeout: 1146 lvb_type: 1 00000100:00100000:0.0:1763334982.080832:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb347c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+18:53661:x1848989694620544:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3575us (3737us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334982.080842:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5087 00000100:00100000:3.0:1763334982.080974:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2664 00000100:00100000:3.0:1763334982.080990:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694620672:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334982.081011:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334982.081041:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cb41 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b053e expref: 17 pid: 25383 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334982.081060:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cb41 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b053e expref: 17 pid: 25383 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334982.081092:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cb41 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b053e expref: 17 pid: 25383 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334982.081174:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.081176:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.081186:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b056f expref: 16 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.081197:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b056f expref: 16 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.081244:0:11727:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b056f expref: 16 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334982.081260:0:11727:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11727:1848989701886848:192.168.201.60@tcp:105: 00000100:00100000:3.0:1763334982.081351:0:11727:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530d80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334982.086535:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.086702:0:11727:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11727:1848989701886848:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334982.086738:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334982.086813:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694620672:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5824us (6364us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334982.086831:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2664 00000100:00100000:0.0:1763334982.087781:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694620800 00000100:00100000:0.0:1763334982.087798:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694620800 00000100:00100000:0.0:1763334982.087868:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5088 00000100:00100000:0.0:1763334982.087879:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:53661:x1848989694620800:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334982.087898:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334982.087919:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849cba3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0576 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.087949:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b400/0xcedf0054f849cb3a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0545 expref: 24 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334982.087970:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.087973:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.087977:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849cba3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0576 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.088015:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b400/0xcedf0054f849cb3a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0545 expref: 24 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334982.088028:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b400/0xcedf0054f849cb3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0545 expref: 24 pid: 6517 timeout: 1146 lvb_type: 1 00000100:00100000:0.0:1763334982.088048:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701886976:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334982.088145:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334982.094367:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.094523:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694620928 00000100:00100000:3.0:1763334982.094537:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694620928 00010000:00010000:3.0:1763334982.094604:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b400/0xcedf0054f849cb3a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0545 expref: 25 pid: 6517 timeout: 1146 lvb_type: 1 00000100:00100000:3.0:1763334982.094640:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2665 00000100:00100000:3.0:1763334982.094650:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694620928:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334982.094669:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334982.094694:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b400/0xcedf0054f849cb3a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0545 expref: 25 pid: 6517 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334982.094707:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b400/0xcedf0054f849cb3a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0545 expref: 25 pid: 6517 timeout: 1146 lvb_type: 1 00010000:00010000:3.0:1763334982.094740:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.094742:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.094750:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849cba3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0576 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.094761:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849cba3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0576 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.094807:0:11727:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849cba3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0576 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334982.094830:0:11727:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11727:1848989701887104:192.168.201.60@tcp:105: 00000100:00100000:3.0:1763334982.094927:0:11727:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3530d80 going to sleep for 11 seconds 00010000:00010000:0.0:1763334982.095298:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59c314b400/0xcedf0054f849cb3a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0545 expref: 25 pid: 6517 timeout: 1146 lvb_type: 1 00000100:00100000:0.0:1763334982.095315:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a80000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701886976:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334982.095344:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849cba3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0576 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.095355:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334982.095404:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:53661:x1848989694620800:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7526us (8883us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334982.095413:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5088 00000100:00100000:3.0:1763334982.098723:0:11727:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11727:1848989701887104:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334982.098764:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334982.098968:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694620928:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4307us (4605us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.098982:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2665 00000100:00100000:2.0:1763334982.099116:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.099338:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.099966:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.100026:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694621056 00000100:00100000:0.0:1763334982.100037:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694621056 00000100:00100000:3.0:1763334982.100543:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694621312 00000100:00100000:3.0:1763334982.100549:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694621312 00000100:00100000:0.0:1763334982.100630:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694621184 00000100:00100000:0.0:1763334982.100634:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694621184 00000100:00100000:0.0:1763334982.100653:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5089 00000100:00100000:0.0:1763334982.100666:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694621056:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334982.100952:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 200814 -> 200814 00002000:00010000:0.0:1763334982.100965:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:0.0:1763334982.100967:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334982.100970:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334981 -> 1763334982 00002000:00010000:0.0:1763334982.100972:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 211 -> 71 00000100:00100000:0.0:1763334982.101030:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694621056:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 368us (1914us total) trans 17179871244 rc 0/0 00000100:00100000:0.0:1763334982.101038:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5089 00000100:00100000:0.0:1763334982.101082:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5090 00000100:00100000:0.0:1763334982.101087:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694621184:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334982.101189:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334982.101192:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:0.0:1763334982.101194:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334982.101196:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334981 -> 1763334982 00002000:00010000:0.0:1763334982.101198:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334982.101217:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694621184:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 129us (1262us total) trans 21474838493 rc 0/0 00000100:00100000:0.0:1763334982.103398:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5090 00000100:00100000:2.0:1763334982.106989:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5091 00000100:00100000:2.0:1763334982.107135:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694621312:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334982.107648:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334982.107652:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:2.0:1763334982.107655:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334982.107657:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334981 -> 1763334982 00002000:00010000:2.0:1763334982.107659:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334982.107758:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694621312:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 752us (8418us total) trans 17179871245 rc 0/0 00000100:00100000:2.0:1763334982.107770:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5091 00000100:00100000:2.0:1763334982.114949:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.115108:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694621568 00000100:00100000:0.0:1763334982.115124:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694621568 00000100:00100000:0.0:1763334982.115714:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1820 00000100:00100000:0.0:1763334982.115730:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53661:x1848989694621568:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:0.0:1763334982.115826:0:29630:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x1ab:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cae6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0522 expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.115901:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334982.115918:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849cb1e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0529 expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.115928:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334982.115990:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849cb1e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0529 expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.116006:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849cb1e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0529 expref: 194 pid: 29628 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334982.116025:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701887232:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334982.118078:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98f00 going to sleep for 11 seconds 00000100:00100000:0.0:1763334982.125343:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a80000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701887232:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334982.125384:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:1.0:1763334982.125643:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.126069:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694621696 00000100:00100000:2.0:1763334982.126080:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694621696 00010000:00010000:2.0:1763334982.126132:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849cb1e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0529 expref: 195 pid: 29628 timeout: 1146 lvb_type: 0 00000100:00100000:2.0:1763334982.126181:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2666 00000100:00100000:2.0:1763334982.126194:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2359:x1848989694621696:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334982.126216:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334982.126224:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849cb1e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0529 expref: 195 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:2.0:1763334982.126237:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849cb1e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0529 expref: 195 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:2.0:1763334982.126266:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849cb1e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0529 expref: 195 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:2.0:1763334982.126287:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:2.0:1763334982.126294:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334982.126305:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334982.126313:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334982.126351:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334982.126433:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2359:x1848989694621696:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 241us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.126441:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2666 00010000:00010000:0.0:1763334982.127015:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334982.127027:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000040:00080000:0.0:1763334982.127668:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1174, 88 off100480 00000004:00080000:0.0:1763334982.127683:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1046761110426ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334982.127757:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1164, 88 off99424 00000004:00080000:0.0:1763334982.127765:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1046761192844ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334982.127793:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1165, 88 off99512 00000004:00080000:0.0:1763334982.127798:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1046761226282ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334982.127814:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1175, 88 off100568 00000004:00080000:0.0:1763334982.127819:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1046761247152ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334982.127833:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1166, 88 off99600 00000004:00080000:0.0:1763334982.127837:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1046761265559ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334982.127852:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1176, 88 off100656 00000004:00080000:0.0:1763334982.127856:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1046761283955ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334982.127869:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1177, 88 off100744 00000004:00080000:0.0:1763334982.127873:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1046761300890ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334982.127887:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1167, 88 off99688 00000004:00080000:0.0:1763334982.127890:0:29630:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1046761318710ns, next at 1047075229764ns, rc = 0 00000001:00080000:1.0:1763334982.163164:0:32484:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939209 is committed 00000004:00080000:1.0:1763334982.163184:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 777 committed 00000004:00080000:1.0:1763334982.163328:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 789 committed 00000004:00080000:1.0:1763334982.163342:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 788 committed 00000004:00080000:1.0:1763334982.163344:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 776 committed 00000100:00100000:2.0:1763334982.163493:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701887360:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334982.163614:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334982.163668:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1763334982.163674:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701887744:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334982.163696:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334982.163725:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701887488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334982.163748:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334982.163768:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1763334982.163772:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701887616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334982.163791:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1763334982.164165:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 787 committed 00000004:00080000:1.0:1763334982.164170:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 775 committed 00000004:00080000:1.0:1763334982.164173:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 774 committed 00000004:00080000:1.0:1763334982.164176:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 786 committed 00000020:00080000:1.0:1763334982.164187:0:32484:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969318 batchid updated 00000020:00080000:1.0:1763334982.164223:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969318 00000020:00080000:1.0:1763334982.164492:0:29663:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969318 cancel update log [0x200000bd0:0x1:0x0].12: rc = 0 00000020:00080000:1.0:1763334982.164505:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969318 00000004:00010000:0.0:1763334982.164745:0:29630:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f1cbdbae reply state 0000000094854ff9 transno 8589939209 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:0.0:1763334982.164760:0:29630:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1763334982.164771:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:0.0:1763334982.164774:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334982.164784:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cae6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0522 expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1763334982.164930:0:29630:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1763334982.164946:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53661:x1848989694621568:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 49221us (50013us total) trans 8589939209 rc 0/0 00000100:00100000:0.0:1763334982.164966:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1820 00000100:00100000:0.0:1763334982.166100:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701887360 00000100:00100000:0.0:1763334982.166116:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701887360 00000100:00100000:0.0:1763334982.166176:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701887744 00000100:00100000:0.0:1763334982.166180:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701887744 00000100:00100000:0.0:1763334982.166197:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701887488 00000100:00100000:0.0:1763334982.166200:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701887488 00000100:00100000:0.0:1763334982.166219:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701887616 00000100:00100000:0.0:1763334982.166222:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701887616 00000100:00100000:0.0:1763334982.166243:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5092 00000100:00100000:0.0:1763334982.166255:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3290:x1848989701887360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334982.166554:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334982.166560:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334982.166563:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334982.166565:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334982.166568:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334982.166675:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3290:x1848989701887360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 422us (3060us total) trans 21474838494 rc 0/0 00000100:00100000:0.0:1763334982.166684:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5092 00000100:00100000:0.0:1763334982.166709:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5093 00000100:00100000:0.0:1763334982.166717:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3290:x1848989701887744:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334982.166822:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334982.166825:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334982 -> 1763334982 00002000:00010000:0.0:1763334982.166828:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334982.166831:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:0.0:1763334982.166842:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334982.166846:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5094 00000100:00100000:0.0:1763334982.166884:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3290:x1848989701887744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (3179us total) trans 21474838495 rc 0/0 00000100:00100000:2.0:1763334982.166886:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701887488:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334982.166902:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5093 00000100:00100000:0.0:1763334982.166923:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5095 00000100:00100000:0.0:1763334982.166932:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3291:x1848989701887616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334982.167095:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 200814 -> 200814 00002000:00010000:0.0:1763334982.167099:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334982 -> 1763334982 00002000:00010000:0.0:1763334982.167102:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334982.167104:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:0.0:1763334982.167107:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1763334982.167142:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701887616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 212us (3349us total) trans 21474838496 rc 0/0 00000100:00100000:0.0:1763334982.167155:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5095 00002000:00010000:2.0:1763334982.167219:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334982.167225:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:2.0:1763334982.167228:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334982.167231:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:2.0:1763334982.167233:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334982.167318:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3291:x1848989701887488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 456us (3568us total) trans 21474838497 rc 0/0 00000100:00100000:2.0:1763334982.167333:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5094 00000100:00100000:2.0:1763334982.167384:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701888128:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334982.167424:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334982.167469:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763334982.167475:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701888000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334982.167496:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334982.167527:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701888256:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334982.167548:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334982.167568:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1763334982.167594:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701887872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334982.167615:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334982.167642:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701888128 00000100:00100000:2.0:1763334982.167648:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701888128 00000100:00100000:2.0:1763334982.167678:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701888000 00000100:00100000:2.0:1763334982.167680:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701888000 00000100:00100000:2.0:1763334982.167690:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701888256 00000100:00100000:2.0:1763334982.167692:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701888256 00000100:00100000:2.0:1763334982.167701:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701887872 00000100:00100000:2.0:1763334982.167702:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701887872 00000100:00100000:2.0:1763334982.167713:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5096 00000100:00100000:2.0:1763334982.167718:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3292:x1848989701888128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763334982.167808:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334982.167810:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334982 -> 1763334982 00002000:00010000:2.0:1763334982.167812:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334982.167814:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:2.0:1763334982.168200:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00010000:00010000:1.0:1763334982.168408:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334982.168424:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334982.168433:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334982.168440:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334982.168446:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334982.168454:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334982.168474:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:1.0:1763334982.168478:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334982.168483:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334982.168490:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cbaa lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00000100:00100000:1.0:1763334982.168537:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5097 00000100:00100000:1.0:1763334982.168551:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701888000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334982.168605:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701888128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 850us (1145us total) trans 17179871246 rc 0/0 00000100:00100000:2.0:1763334982.168617:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5096 00000100:00100000:2.0:1763334982.168648:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5098 00000100:00100000:2.0:1763334982.168659:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701888256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334982.168816:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334982.168822:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:1.0:1763334982.168825:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334982.168829:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:1.0:1763334982.168832:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:2.0:1763334982.168837:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 200814 -> 200814 00002000:00010000:2.0:1763334982.168843:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334982 -> 1763334982 00002000:00010000:2.0:1763334982.168845:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334982.168849:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:2.0:1763334982.168851:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334982.168969:0:3292:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871240 gen 2 00000004:00080000:3.0:1763334982.168976:0:3292:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179871234 committed transno 17179871240 00000004:00080000:3.0:1763334982.168995:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5501880, transno 17179871236 00000004:00080000:3.0:1763334982.169006:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5503b80, transno 17179871237 00000004:00080000:3.0:1763334982.169009:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5500380, transno 17179871238 00000004:00080000:3.0:1763334982.169012:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5501180, transno 17179871239 00000004:00080000:3.0:1763334982.169014:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5502300, transno 17179871240 00000100:00100000:3.0:1763334982.169020:0:3292:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5afab35f80 x1848989701888128/t17179871246(17179871246) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334998 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763334982.169030:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab35f80/2, rc 0, transno 17179871246 00000100:00100000:3.0:1763334982.169035:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701888128:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334982.169050:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab36d80/2, rc 0, transno 17179871247 00000100:00100000:3.0:1763334982.169054:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701888000:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334982.169197:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 2 in flight, 5 done 00000100:00100000:2.0:1763334982.169302:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701888256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 646us (1752us total) trans 17179871248 rc 0/0 00000100:00100000:2.0:1763334982.169309:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5098 00000100:00100000:2.0:1763334982.169325:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5099 00000100:00100000:2.0:1763334982.169333:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701887872:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763334982.169427:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 200814 -> 200814 00002000:00010000:2.0:1763334982.169430:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:2.0:1763334982.169433:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334982.169435:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:2.0:1763334982.169437:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 71 -> 71 00000100:00100000:2.0:1763334982.169462:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701887872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (1846us total) trans 17179871249 rc 0/0 00000100:00100000:2.0:1763334982.169469:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5099 00000100:00100000:2.0:1763334982.169510:0:3291:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838489 gen 2 00000004:00080000:2.0:1763334982.169514:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fc380, transno 21474838461 00000004:00080000:2.0:1763334982.169525:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81ff480, transno 21474838462 00000004:00080000:2.0:1763334982.169528:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fce00, transno 21474838463 00000004:00080000:2.0:1763334982.169531:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad81fd500, transno 21474838464 00000004:00080000:2.0:1763334982.169533:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77f800, transno 21474838465 00000004:00080000:2.0:1763334982.169536:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77ea00, transno 21474838466 00000004:00080000:2.0:1763334982.169540:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77e300, transno 21474838467 00000004:00080000:2.0:1763334982.169542:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa77dc00, transno 21474838468 00000004:00080000:2.0:1763334982.169546:0:3291:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474838473 committed transno 21474838489 00000004:00080000:2.0:1763334982.169556:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa744000, transno 21474838474 00000004:00080000:2.0:1763334982.169559:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d5c00, transno 21474838475 00000004:00080000:2.0:1763334982.169562:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d6d80, transno 21474838476 00000004:00080000:2.0:1763334982.169564:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa745500, transno 21474838477 00000004:00080000:2.0:1763334982.169566:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d4000, transno 21474838478 00000004:00080000:2.0:1763334982.169591:0:3291:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474838484 committed transno 21474838489 00000004:00080000:2.0:1763334982.169601:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c4700, transno 21474838485 00000004:00080000:2.0:1763334982.169604:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c5f80, transno 21474838486 00000004:00080000:2.0:1763334982.169607:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c6a00, transno 21474838487 00000004:00080000:2.0:1763334982.169610:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c4000, transno 21474838488 00000004:00080000:2.0:1763334982.169612:0:3291:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c7800, transno 21474838489 00000100:00100000:2.0:1763334982.169618:0:3291:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a59c9e85500 x1848989701887616/t21474838496(21474838496) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334998 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1763334982.169626:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c9e85500/2, rc 0, transno 21474838496 00000100:00100000:2.0:1763334982.169630:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701887616:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334982.169643:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c9e84a80/2, rc 0, transno 21474838497 00000100:00100000:2.0:1763334982.169649:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701887488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334982.169682:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701888000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1130us (2178us total) trans 17179871247 rc 0/0 00000100:00100000:1.0:1763334982.169696:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5097 00000004:00080000:1.0:1763334982.169783:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c9e84700/2, rc 0, transno 21474838495 00000100:00100000:1.0:1763334982.169790:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701887744:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334982.169809:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c9e86680/2, rc 0, transno 21474838494 00000100:00100000:1.0:1763334982.169814:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701887360:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334982.169878:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 0 in flight, 18 done 00000004:00080000:3.0:1763334982.170094:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab34a80/2, rc 0, transno 17179871248 00000100:00100000:3.0:1763334982.170101:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701888256:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334982.170113:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afab34700/2, rc 0, transno 17179871249 00000100:00100000:3.0:1763334982.170117:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701887872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334982.170277:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.170345:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694621824 00000100:00100000:1.0:1763334982.170357:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694621824 00000100:00100000:1.0:1763334982.170438:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4998 00000100:00100000:1.0:1763334982.170447:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53661:x1848989694621824:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334982.170473:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334982.170507:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849cbb1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b057d expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.171060:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849cbb1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b057d expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.171086:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849cbb1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b057d expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.171114:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:1.0:1763334982.171118:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334982.171122:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478800, rc 0) 00000100:00100000:1.0:1763334982.171188:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53661:x1848989694621824:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 743us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334982.171195:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4998 00000100:00100000:1.0:1763334982.177570:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.178057:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694622080 00000100:00100000:0.0:1763334982.178076:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694622080 00000100:00100000:0.0:1763334982.178169:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1821 00000100:00100000:0.0:1763334982.178181:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37a8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53661:x1848989694622080:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334982.179442:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37a8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53661:x1848989694622080:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1253us (1873us total) trans 8589939210 rc 0/0 00000100:00100000:2.0:1763334982.179456:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1821 00000100:00100000:3.0:1763334982.198528:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.204654:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694622208 00000100:00100000:1.0:1763334982.204687:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694622208 00000100:00100000:2.0:1763334982.205600:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4999 00000100:00100000:2.0:1763334982.205616:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53662:x1848989694622208:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334982.205651:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334982.205692:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbb8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0584 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.205789:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849cbbf lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.205805:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849cbbf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.205819:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849cbbf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.205835:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbc6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.205842:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.205848:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206012:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cbcd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206022:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cbcd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206029:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cbcd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334982.206076:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00000004:00200000:2.0:1763334982.206081:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334982.206103:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cbcd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206117:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cbcd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206127:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849cbbf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206135:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849cbbf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206142:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849cbbf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206149:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334982.206154:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849cbbf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206163:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849cbbf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206177:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334982.206181:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334982.206187:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849cbbf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206194:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849cbbf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206211:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206217:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbc6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206234:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbc6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206240:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334982.206243:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbc6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206249:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbc6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206257:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334982.206260:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334982.206263:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbc6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206268:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbc6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.206307:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbb8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0584 expref: 191 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.206324:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cbcd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0584 expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.206332:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:2.0:1763334982.206334:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334982.206338:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430800, rc 0) 00000100:00100000:2.0:1763334982.206457:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53662:x1848989694622208:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 843us (7944us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.206466:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4999 00000100:00100000:3.0:1763334982.210651:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.210783:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694622464 00000100:00100000:2.0:1763334982.210798:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694622464 00000100:00100000:2.0:1763334982.210870:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5000 00000100:00100000:2.0:1763334982.210884:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53662:x1848989694622464:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334982.210915:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334982.210972:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cbd4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b058b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.211107:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cbdb lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.211125:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cbdb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.211141:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cbdb lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334982.211154:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:2.0:1763334982.211342:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cbd4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b058b expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.211365:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cbdb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b058b expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.211376:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:2.0:1763334982.211379:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1763334982.211383:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431c00, rc 0) 00000100:00100000:2.0:1763334982.213039:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53662:x1848989694622464:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2142us (2387us total) trans 8589939211 rc 0/0 00000100:00100000:2.0:1763334982.213055:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5000 00000100:00100000:0.0:1763334982.216670:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.217167:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694622720 00000100:00100000:2.0:1763334982.217181:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694622720 00000100:00100000:2.0:1763334982.217473:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5001 00000100:00100000:2.0:1763334982.217486:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53662:x1848989694622720:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334982.217518:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334982.217548:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbe9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0592 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.217703:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbf0 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.217721:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbf0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.217735:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbf0 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334982.217750:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:2.0:1763334982.217920:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbe9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0592 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.217941:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbf0 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0592 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.217951:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:2.0:1763334982.217970:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334982.217975:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430200, rc 0) 00000100:00100000:2.0:1763334982.218063:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53662:x1848989694622720:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 580us (1406us total) trans 8589939212 rc 0/0 00000100:00100000:2.0:1763334982.218071:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5001 00000100:00100000:1.0:1763334982.264268:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.267074:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694622848 00000100:00100000:2.0:1763334982.267098:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694622848 00000100:00100000:2.0:1763334982.267232:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1921 00000100:00100000:2.0:1763334982.267245:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694622848:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334982.267298:0:25999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.267323:0:25999:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cb95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0568 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.267334:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334982.267337:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334982.267341:0:25999:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.267389:0:25999:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cb95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0568 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.267419:0:25999:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cb95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0568 expref: 25 pid: 6519 timeout: 1146 lvb_type: 0 00000100:00100000:2.0:1763334982.267438:0:25999:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca872d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0001_UUID:25999:1848989701888384:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334982.270920:0:25999:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad82cc780 going to sleep for 11 seconds 00000100:00100000:3.0:1763334982.272461:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.272767:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694622976 00000100:00100000:1.0:1763334982.272781:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694622976 00010000:00010000:1.0:1763334982.272835:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cb95 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0568 expref: 26 pid: 6519 timeout: 1146 lvb_type: 0 00000100:00100000:1.0:1763334982.272894:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2667 00000100:00100000:1.0:1763334982.272906:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694622976:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334982.272926:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334982.272964:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cb95 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0568 expref: 26 pid: 6519 timeout: 1146 lvb_type: 0 00010000:00010000:1.0:1763334982.272979:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cb95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0568 expref: 26 pid: 6519 timeout: 1146 lvb_type: 0 00010000:00010000:1.0:1763334982.273017:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334982.273020:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334982.273025:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.273038:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.273064:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334982.273377:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cb95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0568 expref: 26 pid: 6519 timeout: 1146 lvb_type: 0 00000100:00100000:2.0:1763334982.273398:0:25999:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca872d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0001_UUID:25999:1848989701888384:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334982.273426:0:25999:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.273442:0:25999:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.273449:0:25999:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334982.274354:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694622976:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1438us (1895us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334982.274369:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2667 00010000:00010000:0.0:1763334982.282520:0:25999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.282547:0:25999:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.282557:0:25999:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.282565:0:25999:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334982.282596:0:25999:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.282607:0:25999:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.282634:0:25999:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.282642:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cbfe lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334982.282785:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694622848:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 15536us (18535us total) trans 0 rc 200814/200814 00000100:00100000:0.0:1763334982.282798:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1921 00000100:00100000:1.0:1763334982.288930:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.289038:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694623104 00000100:00100000:0.0:1763334982.289053:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694623104 00000100:00100000:0.0:1763334982.289152:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1922 00000100:00100000:0.0:1763334982.289165:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2361:x1848989694623104:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334982.289211:0:25999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.289233:0:25999:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cb64 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b054c expref: 17 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.289241:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334982.289244:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334982.289249:0:25999:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.289293:0:25999:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cb64 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b054c expref: 17 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.289309:0:25999:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cb64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b054c expref: 17 pid: 6519 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334982.289327:0:25999:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0000_UUID:25999:1848989701888512:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334982.289436:0:25999:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98480 going to sleep for 11 seconds 00000100:00100000:3.0:1763334982.292787:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.293038:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694623232 00000100:00100000:1.0:1763334982.293051:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694623232 00010000:00010000:1.0:1763334982.293100:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cb64 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b054c expref: 18 pid: 6519 timeout: 1146 lvb_type: 0 00000100:00100000:1.0:1763334982.293153:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2668 00000100:00100000:1.0:1763334982.293164:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2362:x1848989694623232:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334982.293183:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334982.293210:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cb64 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b054c expref: 18 pid: 6519 timeout: 1146 lvb_type: 0 00010000:00010000:1.0:1763334982.293224:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cb64 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b054c expref: 18 pid: 6519 timeout: 1146 lvb_type: 0 00010000:00010000:1.0:1763334982.293272:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334982.293275:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334982.293281:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.293293:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.293319:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334982.293385:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2362:x1848989694623232:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 221us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334982.293392:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2668 00010000:00010000:0.0:1763334982.294393:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cb64 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b054c expref: 17 pid: 6519 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334982.294419:0:25999:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0000_UUID:25999:1848989701888512:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334982.294448:0:25999:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.294459:0:25999:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.294467:0:25999:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.299678:0:25999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.299703:0:25999:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.299713:0:25999:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.299722:0:25999:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334982.299727:0:25999:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.299737:0:25999:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.299766:0:25999:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.299774:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc05 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334982.300017:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694623104:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 10846us (11094us total) trans 0 rc 200814/200814 00000100:00100000:0.0:1763334982.300030:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1922 00000100:00100000:2.0:1763334982.304344:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.305132:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694623360 00000100:00100000:0.0:1763334982.305151:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694623360 00000100:00100000:0.0:1763334982.305254:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1923 00000100:00100000:0.0:1763334982.305267:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694623360:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334982.305325:0:25999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.305349:0:25999:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cb80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b055a expref: 24 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.305359:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334982.305361:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334982.305366:0:25999:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.305413:0:25999:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cb80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b055a expref: 24 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.305435:0:25999:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cb80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b055a expref: 24 pid: 6519 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334982.305453:0:25999:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0001_UUID:25999:1848989701888640:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334982.305591:0:25999:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98480 going to sleep for 11 seconds 00000100:00100000:0.0:1763334982.308933:0:25999:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0001_UUID:25999:1848989701888640:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334982.308986:0:25999:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334982.310683:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.310884:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694623488 00000100:00100000:0.0:1763334982.310898:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694623488 00010000:00010000:0.0:1763334982.310959:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cb80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b055a expref: 25 pid: 6519 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334982.311007:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2669 00000100:00100000:0.0:1763334982.311018:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca870000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694623488:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334982.311038:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334982.311063:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cb80 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b055a expref: 25 pid: 6519 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334982.311078:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cb80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b055a expref: 25 pid: 6519 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334982.311106:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cb80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b055a expref: 25 pid: 6519 timeout: 1146 lvb_type: 0 00010000:00010000:0.0:1763334982.311126:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.311129:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.311134:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.311146:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.311175:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334982.311249:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca870000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694623488:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 232us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334982.311265:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2669 00010000:00010000:3.0:1763334982.311633:0:25999:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.311647:0:25999:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.316093:0:25999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.316120:0:25999:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.316131:0:25999:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.316138:0:25999:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334982.316144:0:25999:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.316153:0:25999:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.316178:0:25999:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.316192:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849cc0c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->204799] (req 0->204799) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334982.316799:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694623360:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 11524us (12464us total) trans 0 rc 200814/200814 00000100:00100000:3.0:1763334982.316814:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1923 00000100:00100000:2.0:1763334982.328764:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.328893:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694623616 00000100:00100000:1.0:1763334982.328909:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694623616 00000100:00100000:0.0:1763334982.329556:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 413 00000100:00100000:0.0:1763334982.329605:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53662:x1848989694623616:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:0.0:1763334982.329627:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334982.329661:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cbf0 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0592 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.329688:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:0.0:1763334982.329696:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334982.329896:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53662:x1848989694623616:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 326us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334982.329904:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 413 00000100:00100000:2.0:1763334982.332731:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.332847:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694623872 00000100:00100000:0.0:1763334982.332862:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694623872 00000100:00100000:0.0:1763334982.333120:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1822 00000100:00100000:0.0:1763334982.333134:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53662:x1848989694623872:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334982.333618:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53662:x1848989694623872:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 485us (900us total) trans 8589939213 rc 0/0 00000100:00100000:0.0:1763334982.333628:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1822 00000100:00100000:2.0:1763334982.339829:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.340091:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694624128 00000100:00100000:3.0:1763334982.340106:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694624128 00000100:00100000:3.0:1763334982.340210:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5002 00000100:00100000:3.0:1763334982.340222:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53644:x1848989694624128:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334982.340366:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334982.340395:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849cc13 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0599 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.340530:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.340549:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cbcd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0584 expref: 195 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.340560:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.340793:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cbcd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0584 expref: 195 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.340810:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cbcd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0584 expref: 195 pid: 29628 timeout: 1146 lvb_type: 0 00000100:00100000:2.0:1763334982.340826:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701888768:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334982.341640:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad82cc780 going to sleep for 11 seconds 00000100:00100000:2.0:1763334982.345346:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.345561:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694624256 00000100:00100000:3.0:1763334982.345588:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694624256 00010000:00010000:3.0:1763334982.345643:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cbcd lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0584 expref: 196 pid: 29628 timeout: 1146 lvb_type: 0 00000100:00100000:3.0:1763334982.345699:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2670 00000100:00100000:3.0:1763334982.345710:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694624256:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334982.345730:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334982.345738:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cbcd lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0584 expref: 196 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334982.345753:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cbcd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0584 expref: 196 pid: 29628 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334982.345782:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:3.0:1763334982.345788:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.345800:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.345808:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.345829:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334982.346176:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cbcd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0584 expref: 196 pid: 29628 timeout: 1146 lvb_type: 0 00000100:00100000:0.0:1763334982.346198:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701888768:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334982.346225:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.346235:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.346240:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334982.346278:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00010000:00010000:0.0:1763334982.346483:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849cc13 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0599 expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.346500:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0599 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.346508:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:0.0:1763334982.346512:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763334982.346515:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067600, rc 0) 00000100:00100000:3.0:1763334982.347015:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694624256:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1300us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334982.347029:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2670 00000100:00100000:0.0:1763334982.347297:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694624128:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 7077us (7483us total) trans 8589939214 rc 0/0 00000100:00100000:0.0:1763334982.347308:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5002 00000100:00100000:2.0:1763334982.351022:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.351981:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694624384 00000100:00100000:0.0:1763334982.352000:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694624384 00000100:00100000:1.0:1763334982.352214:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5003 00000100:00100000:1.0:1763334982.352229:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694624384:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334982.352406:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334982.352439:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cc28 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05a0 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.352559:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cc2f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.352602:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0599 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.352614:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cc2f lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.352664:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0599 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.352679:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0599 expref: 196 pid: 30972 timeout: 1146 lvb_type: 0 00000100:00100000:1.0:1763334982.352696:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701888896:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334982.352873:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334982.356472:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701888896:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334982.356517:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cc2f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334982.356963:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.357222:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694624512 00000100:00100000:3.0:1763334982.357234:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694624512 00010000:00010000:3.0:1763334982.357300:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0599 expref: 197 pid: 30972 timeout: 1146 lvb_type: 0 00000100:00100000:3.0:1763334982.357355:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2671 00000100:00100000:3.0:1763334982.357366:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca870a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694624512:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334982.357386:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334982.357394:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0599 expref: 197 pid: 30972 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334982.357408:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0599 expref: 197 pid: 30972 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334982.357437:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc1a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0599 expref: 197 pid: 30972 timeout: 1146 lvb_type: 0 00010000:00010000:3.0:1763334982.357456:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:3.0:1763334982.357462:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cc2f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.357473:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cc2f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.357482:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cc2f lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.357517:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334982.357629:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca870a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694624512:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 263us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334982.357638:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2671 00010000:00010000:2.0:1763334982.358383:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cc2f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.358396:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cc2f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334982.358458:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00000004:00200000:2.0:1763334982.358464:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334982.358486:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cc2f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.358528:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cc28 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05a0 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.358547:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cc2f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05a0 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.358555:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:2.0:1763334982.358558:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334982.358561:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:2.0:1763334982.358922:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694624384:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 6694us (7909us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.358932:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5003 00000100:00100000:2.0:1763334982.362646:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.362727:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694624640 00000100:00100000:0.0:1763334982.362741:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694624640 00000100:00100000:0.0:1763334982.362808:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5100 00000100:00100000:0.0:1763334982.362818:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694624640:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334982.362840:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334982.362869:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cc36 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05a7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334982.362901:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 200814, mtime: 0x691a5b45, atime: 0x691a5b44, ctime: 0x691a5b46, blocks: 0x47 00010000:00010000:0.0:1763334982.362926:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.362928:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.362941:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cc36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05a7 expref: 24 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334982.362973:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cc36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05a7 expref: 24 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334982.362989:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334982.363058:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694624640:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 242us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334982.363066:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5100 00000100:00100000:3.0:1763334982.366421:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.366471:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694624768 00000100:00100000:2.0:1763334982.366485:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694624768 00000100:00100000:2.0:1763334982.366552:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5101 00000100:00100000:2.0:1763334982.366563:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+24:53644:x1848989694624768:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334982.366603:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334982.366629:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cc3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05ae expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.366670:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cc36 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05a7 expref: 25 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334982.366685:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334982.366688:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334982.366693:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cc3d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ae expref: 25 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.366737:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cc36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05a7 expref: 25 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334982.366843:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cc36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05a7 expref: 25 pid: 6517 timeout: 1146 lvb_type: 1 00000100:00100000:2.0:1763334982.366863:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca870700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701889024:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334982.366976:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad82cc840 going to sleep for 11 seconds 00000100:00100000:1.0:1763334982.369725:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.369783:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694624896 00000100:00100000:0.0:1763334982.369797:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694624896 00000100:00100000:2.0:1763334982.369853:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca870700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701889024:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334982.369853:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cc36 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05a7 expref: 26 pid: 6517 timeout: 1146 lvb_type: 1 00010000:00010000:2.0:1763334982.369894:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cc3d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [98304->102399] (req 98304->102399) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ae expref: 26 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334982.369905:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2672 00010000:00010000:2.0:1763334982.369914:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430400, rc 0) 00000100:00100000:0.0:1763334982.369916:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694624896:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334982.369940:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334982.369978:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cc36 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05a7 expref: 26 pid: 6517 timeout: 1146 lvb_type: 1 00010000:00010000:0.0:1763334982.369994:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cc36 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05a7 expref: 26 pid: 6517 timeout: 1146 lvb_type: 1 00000100:00100000:2.0:1763334982.370004:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+26:53644:x1848989694624768:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 3444us (3597us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.370014:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5101 00010000:00010000:0.0:1763334982.370032:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cc36 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05a7 expref: 25 pid: 6517 timeout: 1146 lvb_type: 1 00010000:00010000:0.0:1763334982.370047:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.370049:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.370058:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cc3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ae expref: 24 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.370072:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cc3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ae expref: 24 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.370121:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cc3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ae expref: 24 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334982.370138:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701889152:192.168.201.60@tcp:105: 00000100:00100000:0.0:1763334982.370204:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334982.373052:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701889152:192.168.201.60@tcp:105: 00010000:00010000:0.0:1763334982.373084:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334982.373411:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694624896:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 3493us (3694us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334982.373424:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2672 00000100:00100000:1.0:1763334982.373775:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.373969:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694625024 00000100:00100000:0.0:1763334982.373979:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694625024 00002000:00100000:0.0:1763334982.374036:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (98304->102399) req@ffff9a5afa44ca80 x1848989694625024/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 488/0 e 0 to 0 dl 1763334993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334982.374048:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44ca80 with x1848989694625024 ext(98304->102399) 00002000:00010000:0.0:1763334982.374056:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44ca80 00000100:00100000:0.0:1763334982.374149:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1924 00000100:00100000:0.0:1763334982.374161:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694625024:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:0.0:1763334982.375026:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694625024:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 859us (1246us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334982.375037:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1924 00002000:00100000:0.0:1763334982.375046:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (98304->102399) req@ffff9a5afa44ca80 x1848989694625024/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 488/4536 e 0 to 0 dl 1763334993 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334982.375055:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44ca80 with x1848989694625024 ext(98304->102399) 00002000:00010000:0.0:1763334982.375061:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44ca80 00000100:00100000:3.0:1763334982.378652:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.378713:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694625280 00000100:00100000:0.0:1763334982.378728:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694625280 00000100:00100000:0.0:1763334982.378809:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1823 00000100:00100000:0.0:1763334982.378823:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694625280:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:0.0:1763334982.380135:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53644:x1848989694625280:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 1303us (1489us total) trans 8589939215 rc 0/0 00000100:00100000:0.0:1763334982.380152:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1823 00000100:00100000:3.0:1763334982.381874:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.382023:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694625536 00000100:00100000:2.0:1763334982.382038:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694625536 00000100:00100000:2.0:1763334982.382106:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5004 00000100:00100000:2.0:1763334982.382116:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53644:x1848989694625536:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334982.382147:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334982.382150:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:2.0:1763334982.382188:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cc2f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05a0 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.382211:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cbdb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b058b expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.382223:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849cbb1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b057d expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.382235:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fab00) 00010000:00010000:2.0:1763334982.382248:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334982.382279:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849cc44 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05b5 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.382344:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cc4b lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.382358:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cc4b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.382368:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cc4b lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:2.0:1763334982.382969:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1178, 88 off100832 00000004:00080000:2.0:1763334982.382982:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047016408870ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334982.383033:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1168, 88 off99776 00000004:00080000:2.0:1763334982.383037:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047016465292ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334982.383068:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1169, 88 off99864 00000004:00080000:2.0:1763334982.383072:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047016500292ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334982.383084:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1179, 88 off100920 00000004:00080000:2.0:1763334982.383087:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047016515615ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334982.383098:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1170, 88 off99952 00000004:00080000:2.0:1763334982.383101:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047016529552ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334982.383112:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1180, 88 off101008 00000004:00080000:2.0:1763334982.383115:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047016543468ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334982.383126:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1181, 88 off101096 00000004:00080000:2.0:1763334982.383129:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047016557350ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334982.383139:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1171, 88 off100040 00000004:00080000:2.0:1763334982.383143:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047016571237ns, next at 1047075229764ns, rc = 0 00000001:00080000:1.0:1763334982.420251:0:32484:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939215 is committed 00000001:00080000:1.0:1763334982.420293:0:32484:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939216 is committed 00000004:00080000:1.0:1763334982.420300:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 781 committed 00000004:00080000:1.0:1763334982.420319:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 793 committed 00000004:00080000:1.0:1763334982.420334:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 792 committed 00000004:00080000:1.0:1763334982.420337:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 780 committed 00000004:00080000:1.0:1763334982.420339:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 791 committed 00000004:00080000:1.0:1763334982.420341:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 779 committed 00000004:00080000:1.0:1763334982.420344:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 778 committed 00000004:00080000:1.0:1763334982.420346:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 790 committed 00000100:00100000:1.0:1763334982.421056:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701889280:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334982.421234:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701889408:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1763334982.421325:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cc4b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05b5 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.421341:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334982.421345:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334982.421369:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849cc44 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05b5 expref: 189 pid: 30972 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763334982.421393:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cc4b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05b5 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.421440:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334982.421443:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334982.421445:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:1.0:1763334982.421460:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334982.421522:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694625536:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 39405us (39656us total) trans 8589939216 rc 0/0 00000100:00100000:3.0:1763334982.421533:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5004 00000100:00100000:0.0:1763334982.421560:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701889280 00000100:00100000:0.0:1763334982.421590:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701889280 00000100:00100000:3.0:1763334982.421620:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701889664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334982.421644:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5102 00000100:00100000:3.0:1763334982.421819:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334982.421845:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701890176:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334982.421852:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701889664 00000100:00100000:2.0:1763334982.421856:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701889664 00000100:00100000:3.0:1763334982.421868:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334982.421896:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701889792:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334982.421911:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701889536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334982.421923:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334982.421942:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3290:x1848989701889280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334982.422158:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701890176 00000100:00100000:2.0:1763334982.422162:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701890176 00000100:00100000:2.0:1763334982.422201:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5103 00000100:00100000:2.0:1763334982.422210:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701889664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334982.422435:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334982.422439:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334982 -> 1763334982 00002000:00010000:2.0:1763334982.422441:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334982.422444:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:2.0:1763334982.422447:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1763334982.422495:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701889664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 285us (674us total) trans 21474838498 rc 0/0 00000100:00100000:2.0:1763334982.422502:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5103 00000100:00100000:2.0:1763334982.422520:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5104 00000100:00100000:2.0:1763334982.422528:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701890176:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334982.422689:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701890176:12345-0@lo:2:osp-syn-1-0.0 Request processed in 161us (818us total) trans 17179871250 rc 0/0 00000100:00100000:2.0:1763334982.422695:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5104 00002000:00010000:0.0:1763334982.422859:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334982.422862:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334982.422865:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1763334982.422867:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334982.422869:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334982.422900:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3290:x1848989701889280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1248us (1440us total) trans 21474838499 rc 0/0 00000100:00100000:0.0:1763334982.422907:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5102 00000100:00100000:3.0:1763334982.423246:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701889792 00000100:00100000:3.0:1763334982.423255:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701889792 00000100:00100000:3.0:1763334982.423305:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5105 00000004:00080000:1.0:1763334982.423313:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca870700/2, rc 0, transno 21474838499 00000100:00100000:3.0:1763334982.423314:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3290:x1848989701889792:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334982.423380:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca870700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701889280:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334982.423445:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 200814 -> 200814 00002000:00010000:3.0:1763334982.423449:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:3.0:1763334982.423451:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334982.423453:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:3.0:1763334982.423455:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 71 -> 71 00000100:00100000:3.0:1763334982.423558:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3290:x1848989701889792:12345-0@lo:2:osp-syn-1-0.0 Request processed in 246us (1633us total) trans 17179871251 rc 0/0 00000100:00100000:3.0:1763334982.423564:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5105 00000100:00100000:3.0:1763334982.423617:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334982.423654:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701889920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334982.423695:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334982.423735:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701889408 00000100:00100000:3.0:1763334982.423739:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701889408 00000100:00100000:3.0:1763334982.423763:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701889920 00000100:00100000:3.0:1763334982.423766:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701889920 00000100:00100000:3.0:1763334982.423786:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5106 00000100:00100000:3.0:1763334982.423792:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701889408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334982.423896:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334982.423899:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:3.0:1763334982.423901:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334982.423904:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:3.0:1763334982.423906:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334982.423937:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3291:x1848989701889408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 145us (319us total) trans 21474838500 rc 0/0 00000100:00100000:3.0:1763334982.423943:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5106 00000100:00100000:3.0:1763334982.423972:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5107 00000100:00100000:3.0:1763334982.423980:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701889920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334982.424063:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334982.424067:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334981 -> 1763334981 00002000:00010000:3.0:1763334982.424069:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334982.424072:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:3.0:1763334982.424074:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334982.424101:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3291:x1848989701889920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (405us total) trans 17179871252 rc 0/0 00000100:00100000:3.0:1763334982.424107:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5107 00000004:00080000:3.0:1763334982.424150:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c9e87800/2, rc 0, transno 21474838498 00000100:00100000:3.0:1763334982.424155:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701889664:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334982.424166:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a82300/2, rc 0, transno 17179871250 00000100:00100000:3.0:1763334982.424170:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701890176:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334982.424190:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a83800/2, rc 0, transno 17179871252 00000100:00100000:3.0:1763334982.424194:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701889920:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334982.424204:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca871f80/2, rc 0, transno 21474838500 00000100:00100000:3.0:1763334982.424208:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701889408:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334982.424863:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a81f80/2, rc 0, transno 17179871251 00000100:00100000:1.0:1763334982.424873:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a81f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701889792:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334982.424924:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334982.424986:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701890048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334982.425034:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334982.425075:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701889536 00000100:00100000:3.0:1763334982.425083:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701889536 00000100:00100000:1.0:1763334982.425804:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701890048 00000100:00100000:1.0:1763334982.425811:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701890048 00000100:00100000:0.0:1763334982.425815:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5108 00000100:00100000:0.0:1763334982.425827:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3292:x1848989701889536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334982.425856:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5109 00000100:00100000:1.0:1763334982.425862:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3292:x1848989701890048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334982.426076:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334982.426080:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334982 -> 1763334982 00002000:00010000:1.0:1763334982.426083:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334982.426085:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:1.0:1763334982.426088:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334982.426928:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3292:x1848989701889536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1097us (1998us total) trans 21474838501 rc 0/0 00000100:00100000:0.0:1763334982.426942:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5108 00000100:00100000:1.0:1763334982.427286:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3292:x1848989701890048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1422us (2249us total) trans 17179871253 rc 0/0 00000100:00100000:1.0:1763334982.427296:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5109 00000004:00080000:2.0:1763334982.427376:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca870000/2, rc 0, transno 21474838501 00000100:00100000:2.0:1763334982.427387:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701889536:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334982.427407:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a83100/2, rc 0, transno 17179871253 00000100:00100000:2.0:1763334982.427412:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701890048:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334982.440549:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.440880:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694625664 00000100:00100000:0.0:1763334982.440898:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694625664 00002000:00100000:0.0:1763334982.440992:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (98304->102399) req@ffff9a5afa44df80 x1848989694625664/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 488/0 e 0 to 0 dl 1763334993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334982.441005:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44df80 with x1848989694625664 ext(98304->102399) 00002000:00010000:0.0:1763334982.441013:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44df80 00000100:00100000:0.0:1763334982.441060:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1925 00000100:00100000:0.0:1763334982.441073:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694625664:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:0.0:1763334982.441457:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694625664:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 384us (924us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334982.441466:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1925 00002000:00100000:0.0:1763334982.441474:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (98304->102399) req@ffff9a5afa44df80 x1848989694625664/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 488/4536 e 0 to 0 dl 1763334993 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334982.441483:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44df80 with x1848989694625664 ext(98304->102399) 00002000:00010000:0.0:1763334982.441487:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44df80 00000100:00100000:3.0:1763334982.451478:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.451974:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694625792 00000100:00100000:0.0:1763334982.451990:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694625792 00002000:00100000:0.0:1763334982.452071:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (73728->139263) req@ffff9a5afab37100 x1848989694625792/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 504/0 e 0 to 0 dl 1763334993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334982.452084:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab37100 with x1848989694625792 ext(73728->139263) 00002000:00010000:0.0:1763334982.452092:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab37100 00000100:00100000:0.0:1763334982.452136:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1926 00000100:00100000:0.0:1763334982.452148:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694625792:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:1.0:1763334982.459271:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694625792:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 7107us (7792us total) trans 0 rc 61440/61440 00000100:00100000:1.0:1763334982.459290:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1926 00002000:00100000:1.0:1763334982.459305:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (73728->139263) req@ffff9a5afab37100 x1848989694625792/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 504/440 e 0 to 0 dl 1763334993 ref 1 fl Complete:/600/0 rc 61440/61440 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334982.459317:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab37100 with x1848989694625792 ext(73728->139263) 00002000:00010000:1.0:1763334982.459325:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab37100 00000100:00100000:1.0:1763334982.471549:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.471738:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694625920 00000100:00100000:3.0:1763334982.471753:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694625920 00002000:00100000:3.0:1763334982.471986:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (98304->114687) req@ffff9a5afa44f800 x1848989694625920/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 16872/0 e 0 to 0 dl 1763334993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334982.472000:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44f800 with x1848989694625920 ext(98304->114687) 00002000:00010000:3.0:1763334982.472011:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44f800 00000100:00100000:0.0:1763334982.472229:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1927 00000100:00100000:0.0:1763334982.472247:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694625920:12345-192.168.201.60@tcp:4:lfs.0 00000100:00100000:0.0:1763334982.473122:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694625920:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 873us (1582us total) trans 17179871254 rc 0/0 00000100:00100000:0.0:1763334982.473297:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1927 00002000:00100000:0.0:1763334982.473313:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (98304->114687) req@ffff9a5afa44f800 x1848989694625920/t17179871254(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 16872/448 e 0 to 0 dl 1763334993 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334982.473333:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44f800 with x1848989694625920 ext(98304->114687) 00002000:00010000:0.0:1763334982.473340:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44f800 00000100:00100000:3.0:1763334982.477067:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.477199:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694626048 00000100:00100000:1.0:1763334982.477214:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694626048 00000100:00100000:1.0:1763334982.477288:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5110 00000100:00100000:1.0:1763334982.477300:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694626048:12345-192.168.201.60@tcp:16:fsx.0 00010000:00010000:3.0:1763334982.503175:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1763334982.535791:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871254 is committed 00000001:00080000:2.0:1763334982.535838:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871253 is committed 00000100:00100000:1.0:1763334982.537386:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694626048:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 60074us (60320us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334982.537403:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5110 00000100:00100000:2.0:1763334982.545634:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.548420:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694626176 00000100:00100000:3.0:1763334982.548445:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694626176 00000100:00100000:3.0:1763334982.548555:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5005 00000100:00100000:3.0:1763334982.548607:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694626176:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334982.548641:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334982.551857:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849cc52 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05bc expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.552175:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849cc59 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.552195:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849cc59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.552210:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849cc59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334982.552256:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 200814 00000004:00200000:2.0:1763334982.552263:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334982.552288:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849cc59 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.552331:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066600/0xcedf0054f849cc52 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05bc expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.552356:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849cc59 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05bc expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.552366:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334982.552370:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334982.552375:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334982.552486:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694626176:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 3919us (6923us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.552498:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5005 00000100:00100000:0.0:1763334982.568278:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.570419:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694626432 00000100:00100000:2.0:1763334982.570443:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694626432 00000100:00100000:2.0:1763334982.570558:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5006 00000100:00100000:2.0:1763334982.570629:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694626432:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334982.570710:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1763334982.570747:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849cc59 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05bc expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.570776:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cc4b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05b5 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.570789:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334982.570801:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334982.571197:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cc60 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.571214:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cc60 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.571245:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cc60 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:2.0:1763334982.571320:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939217 00000004:00010000:2.0:1763334982.571349:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000005849a37 reply state 000000000d2396c0 transno 8589939218 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cc60 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334982.571360:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334982.571494:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694626432:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 923us (3230us total) trans 8589939218 rc 0/0 00000100:00100000:2.0:1763334982.571503:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5006 00000020:00080000:2.0:1763334982.571510:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1763334982.577061:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cc60 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.577088:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cc60 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.577096:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cc60 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.577102:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334982.577108:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cc60 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.577117:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cc60 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.577139:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:0.0:1763334982.577143:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334982.577149:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cc60 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.577156:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cc60 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334982.579402:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.579495:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694626560 00000100:00100000:3.0:1763334982.579509:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694626560 00000100:00100000:2.0:1763334982.579620:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5007 00000100:00100000:2.0:1763334982.579634:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694626560:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334982.579666:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334982.579694:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cc67 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05c3 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.579774:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cc67 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05c3 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.579790:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cc67 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05c3 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.579812:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334982.579816:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334982.579820:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:2.0:1763334982.579902:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694626560:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 271us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.581347:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5007 00000100:00100000:0.0:1763334982.591870:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.591932:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.593028:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694626688 00000100:00100000:3.0:1763334982.593035:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694626816 00000100:00100000:2.0:1763334982.593048:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694626688 00000100:00100000:3.0:1763334982.593049:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694626816 00002000:00010000:3.0:1763334982.593125:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:3.0:1763334982.593132:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a80e00 with x1848989694626816 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334982.593147:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6a80e00. 00000100:00100000:0.0:1763334982.593547:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00002000:00010000:2.0:1763334982.593825:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (262144->18446744073709551615) 00002000:00100000:2.0:1763334982.593831:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a81500 with x1848989694626688 ext(262144->18446744073709551615) 00002000:00010000:2.0:1763334982.593840:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a81500. 00000100:00100000:1.0:1763334982.595927:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694626944 00000100:00100000:1.0:1763334982.595958:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694626944 00002000:00010000:1.0:1763334982.596009:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763334982.596015:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a82d80 with x1848989694626944 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334982.596029:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a82d80. 00000100:00100000:1.0:1763334982.596067:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1928 00000100:00100000:1.0:1763334982.596079:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694626816:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:0.0:1763334982.596428:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1929 00000100:00100000:0.0:1763334982.596440:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694626688:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:3.0:1763334982.596659:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1930 00000100:00100000:3.0:1763334982.596671:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694626944:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334982.597969:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334982.597978:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334981 -> 1763334983 00002000:00010000:1.0:1763334982.597981:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334982.597984:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334982 -> 1763334983 00002000:00010000:1.0:1763334982.597986:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334982.598087:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694626816:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 2006us (6149us total) trans 21474838502 rc 0/0 00000100:00100000:1.0:1763334982.598099:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1928 00002000:00010000:1.0:1763334982.598106:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00010000:3.0:1763334982.598108:0:25999:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00100000:1.0:1763334982.598110:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a80e00 with x1848989694626816 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334982.598112:0:25999:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334981 -> 1763334983 00002000:00010000:3.0:1763334982.598114:0:25999:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334982.598116:0:25999:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334982 -> 1763334983 00002000:00010000:3.0:1763334982.598118:0:25999:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1763334982.598118:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5af6a80e00. 00000100:00100000:3.0:1763334982.598144:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694626944:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 1476us (4600us total) trans 17179871255 rc 0/0 00000100:00100000:3.0:1763334982.598157:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1930 00002000:00010000:3.0:1763334982.598161:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:3.0:1763334982.598164:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a82d80 with x1848989694626944 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334982.598169:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a82d80. 00002000:00010000:0.0:1763334982.598268:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 200814 -> 262144 00002000:00010000:0.0:1763334982.598272:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334981 -> 1763334983 00002000:00010000:0.0:1763334982.598274:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334982.598276:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334982 -> 1763334983 00002000:00010000:0.0:1763334982.598280:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 71 -> 105 00000100:00100000:0.0:1763334982.598304:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694626688:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 1867us (6454us total) trans 17179871256 rc 0/0 00000100:00100000:0.0:1763334982.598311:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1929 00002000:00010000:0.0:1763334982.598315:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (262144->18446744073709551615) 00002000:00100000:0.0:1763334982.598318:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a81500 with x1848989694626688 ext(262144->18446744073709551615) 00002000:00010000:0.0:1763334982.598328:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a81500. 00000100:00100000:0.0:1763334982.605463:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.606062:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694627072 00000100:00100000:1.0:1763334982.606077:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694627072 00002000:00100000:1.0:1763334982.606148:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (204800->262143) req@ffff9a5af6a81c00 x1848989694627072/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 488/0 e 0 to 0 dl 1763334993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334982.606161:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a81c00 with x1848989694627072 ext(204800->262143) 00002000:00010000:1.0:1763334982.606170:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a81c00 00000100:00100000:1.0:1763334982.606212:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1931 00000100:00100000:1.0:1763334982.606224:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694627072:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:1.0:1763334982.611896:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694627072:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 5655us (6431us total) trans 0 rc 57344/57344 00000100:00100000:1.0:1763334982.611915:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1931 00002000:00100000:1.0:1763334982.611933:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (204800->262143) req@ffff9a5af6a81c00 x1848989694627072/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 488/440 e 0 to 0 dl 1763334993 ref 1 fl Complete:/600/0 rc 57344/57344 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334982.611945:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a81c00 with x1848989694627072 ext(204800->262143) 00002000:00010000:1.0:1763334982.611965:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a81c00 00000100:00100000:2.0:1763334982.625119:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.625251:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694627200 00000100:00100000:1.0:1763334982.625267:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694627200 00002000:00100000:1.0:1763334982.625342:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (233472->262143) req@ffff9a5ad81fd500 x1848989694627200/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 488/0 e 0 to 0 dl 1763334993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334982.625356:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad81fd500 with x1848989694627200 ext(233472->262143) 00002000:00010000:1.0:1763334982.625363:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad81fd500 00000100:00100000:0.0:1763334982.626094:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1932 00000100:00100000:0.0:1763334982.626114:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694627200:12345-192.168.201.60@tcp:4:lfs.0 00000100:00100000:3.0:1763334982.634359:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694627200:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 8234us (9238us total) trans 17179871257 rc 0/0 00000100:00100000:3.0:1763334982.634377:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1932 00002000:00100000:3.0:1763334982.634395:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (233472->262143) req@ffff9a5ad81fd500 x1848989694627200/t17179871257(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 488/448 e 0 to 0 dl 1763334993 ref 1 fl Complete:/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334982.634406:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad81fd500 with x1848989694627200 ext(233472->262143) 00002000:00010000:3.0:1763334982.634414:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad81fd500 00000100:00100000:2.0:1763334982.644109:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.644252:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694627328 00000100:00100000:1.0:1763334982.644268:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694627328 00000100:00100000:1.0:1763334982.644348:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5111 00000100:00100000:1.0:1763334982.644360:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694627328:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:2.0:1763334982.683352:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871256 is committed 00000001:00080000:2.0:1763334982.683396:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871257 is committed 00000100:00100000:1.0:1763334982.683842:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694627328:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 39474us (39741us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334982.683857:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5111 00000100:00100000:0.0:1763334982.694142:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.694317:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694627456 00000100:00100000:2.0:1763334982.694333:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694627456 00000100:00100000:2.0:1763334982.695014:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5008 00000100:00100000:2.0:1763334982.695028:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694627456:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334982.695058:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334982.695090:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cc6e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05ca expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.695246:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cc75 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.695263:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cc75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.695276:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cc75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334982.695312:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 262144 00000004:00200000:2.0:1763334982.695317:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334982.695355:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cc75 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334982.695387:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cc6e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ca expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.695407:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cc75 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ca expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.695417:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334982.695421:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334982.695426:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430e00, rc 0) 00000100:00100000:2.0:1763334982.696420:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694627456:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 1389us (2289us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.696433:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5008 00000100:00100000:0.0:1763334982.700103:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.700200:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694627584 00000100:00100000:3.0:1763334982.700215:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694627584 00002000:00100000:3.0:1763334982.700292:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (151552->204799) req@ffff9a5af6a80700 x1848989694627584/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 488/0 e 0 to 0 dl 1763334993 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334982.700305:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a80700 with x1848989694627584 ext(151552->204799) 00002000:00010000:3.0:1763334982.700313:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a80700 00000100:00100000:3.0:1763334982.700356:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1933 00000100:00100000:3.0:1763334982.700367:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2361:x1848989694627584:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:3.0:1763334982.703864:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2361:x1848989694627584:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 3482us (3762us total) trans 0 rc 53248/53248 00000100:00100000:3.0:1763334982.703882:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1933 00002000:00100000:3.0:1763334982.703898:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (151552->204799) req@ffff9a5af6a80700 x1848989694627584/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:28/0 lens 488/440 e 0 to 0 dl 1763334993 ref 1 fl Complete:/600/0 rc 53248/53248 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334982.703912:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5af6a80700 with x1848989694627584 ext(151552->204799) 00002000:00010000:3.0:1763334982.703919:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5af6a80700 00000100:00100000:2.0:1763334982.712377:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.712929:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694627840 00000100:00100000:0.0:1763334982.712943:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694627840 00000100:00100000:0.0:1763334982.713072:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5009 00000100:00100000:0.0:1763334982.713085:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694627840:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:0.0:1763334982.713161:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334982.713201:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849cc75 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ca expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.713231:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334982.713238:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334982.713914:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cc7c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.713934:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cc7c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.713943:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cc7c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:0.0:1763334982.714021:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939219 00000004:00010000:0.0:1763334982.714047:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000a838e357 reply state 0000000046b371e7 transno 8589939220 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cc7c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334982.714056:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334982.714867:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53644:x1848989694627840:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 1777us (2498us total) trans 8589939220 rc 0/0 00000100:00100000:0.0:1763334982.714880:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5009 00000020:00080000:0.0:1763334982.714889:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763334982.718254:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:1.0:1763334982.718352:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cc7c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.718369:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cc7c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.718377:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cc7c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.718384:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334982.718390:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cc7c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.718399:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cc7c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.718423:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:1.0:1763334982.718426:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334982.718431:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cc7c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334982.718436:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cc7c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334982.718668:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694627968 00000100:00100000:3.0:1763334982.718684:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694627968 00002000:00010000:3.0:1763334982.718741:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (85452->18446744073709551615) 00002000:00100000:3.0:1763334982.718748:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809c380 with x1848989694627968 ext(85452->18446744073709551615) 00002000:00010000:3.0:1763334982.718762:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad809c380. 00000100:00100000:3.0:1763334982.718799:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1934 00000100:00100000:3.0:1763334982.718811:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694627968:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334982.719484:0:25999:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 262144 -> 85452 00002000:00010000:3.0:1763334982.719494:0:25999:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334982.719497:0:25999:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334982.719500:0:25999:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334982.719502:0:25999:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 105 -> 161 00000100:00100000:3.0:1763334982.719690:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694627968:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 876us (1450us total) trans 17179871258 rc 0/0 00000100:00100000:3.0:1763334982.719704:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1934 00002000:00010000:3.0:1763334982.719710:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (85452->18446744073709551615) 00002000:00100000:3.0:1763334982.719714:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad809c380 with x1848989694627968 ext(85452->18446744073709551615) 00002000:00010000:3.0:1763334982.719721:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad809c380. 00000100:00100000:2.0:1763334982.722396:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.723100:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.723184:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694628224 00000100:00100000:3.0:1763334982.723198:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694628224 00002000:00010000:3.0:1763334982.723258:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:3.0:1763334982.723264:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77e300 with x1848989694628224 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334982.723281:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77e300. 00000100:00100000:1.0:1763334982.725195:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694628096 00000100:00100000:1.0:1763334982.725216:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694628096 00002000:00010000:1.0:1763334982.725271:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334982.725278:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77dc00 with x1848989694628096 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334982.725293:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa77dc00. 00000100:00100000:1.0:1763334982.725340:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1935 00000100:00100000:1.0:1763334982.725353:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694628224:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:2.0:1763334982.725366:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1936 00000100:00100000:2.0:1763334982.725376:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694628096:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334982.725644:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334982.725644:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334982.725648:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334982.725648:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:2.0:1763334982.725652:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334982.725652:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334982.725655:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334982.725655:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:2.0:1763334982.725658:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1763334982.725658:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334982.725915:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694628224:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 562us (3531us total) trans 17179871259 rc 0/0 00000100:00100000:1.0:1763334982.725923:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1935 00002000:00010000:1.0:1763334982.725928:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763334982.725931:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77e300 with x1848989694628224 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334982.725936:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa77e300. 00000100:00100000:2.0:1763334982.728808:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694628096:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 3416us (5694us total) trans 21474838503 rc 0/0 00000100:00100000:2.0:1763334982.728826:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1936 00002000:00010000:2.0:1763334982.728835:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:2.0:1763334982.728839:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa77dc00 with x1848989694628096 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334982.728853:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afa77dc00. 00000100:00100000:2.0:1763334982.732485:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.732785:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694628352 00000100:00100000:0.0:1763334982.732799:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694628352 00000100:00100000:0.0:1763334982.732871:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5010 00000100:00100000:0.0:1763334982.732883:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53644:x1848989694628352:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334982.732913:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334982.732940:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cc83 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05d1 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.733065:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc8a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.733081:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.733094:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334982.733126:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 85452 00000004:00200000:0.0:1763334982.733131:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334982.733152:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc8a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.733179:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cc83 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d1 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.733201:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc8a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d1 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.733212:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334982.733215:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334982.733219:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334982.733300:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53644:x1848989694628352:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 420us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334982.733308:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5010 00000100:00100000:1.0:1763334982.739307:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.740832:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694628608 00000100:00100000:0.0:1763334982.740850:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694628608 00000100:00100000:0.0:1763334982.740930:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1824 00000100:00100000:0.0:1763334982.740943:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53644:x1848989694628608:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:0.0:1763334982.741443:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53644:x1848989694628608:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 501us (2150us total) trans 8589939221 rc 0/0 00000100:00100000:0.0:1763334982.741452:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1824 00000100:00100000:1.0:1763334982.753717:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.753846:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694628736 00000100:00100000:3.0:1763334982.753860:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694628736 00000100:00100000:3.0:1763334982.753936:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5011 00000100:00100000:3.0:1763334982.753960:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53663:x1848989694628736:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334982.753991:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334982.754020:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc91 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05d8 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.754116:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cc98 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754135:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cc98 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754149:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cc98 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754168:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cc9f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754175:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cc9f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754189:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cc9f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754362:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754374:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754388:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:3.0:1763334982.754440:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 85452 00000004:00200000:3.0:1763334982.754446:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334982.754474:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754491:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754502:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cc98 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754510:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cc98 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754519:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cc98 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754526:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334982.754532:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cc98 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754542:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cc98 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754558:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:3.0:1763334982.754563:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334982.754634:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cc98 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754643:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cc98 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754662:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cc9f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754669:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cc9f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754675:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cc9f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754680:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334982.754683:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cc9f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754688:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cc9f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754696:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5af66de100) 00010000:00010000:3.0:1763334982.754700:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334982.754703:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cc9f lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754709:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cc9f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.754747:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849cc91 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d8 expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.754763:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d8 expref: 195 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.754771:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334982.754774:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334982.754777:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:3.0:1763334982.754854:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53663:x1848989694628736:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 907us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334982.754864:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5011 00000100:00100000:2.0:1763334982.761614:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.761694:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.761717:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694628992 00000100:00100000:0.0:1763334982.761732:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694628992 00000100:00100000:0.0:1763334982.761807:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5012 00000100:00100000:0.0:1763334982.761819:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53663:x1848989694628992:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334982.761847:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334982.761876:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ccad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05df expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.762051:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.762070:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc8a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d1 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.762079:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d8 expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.762088:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.762131:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d8 expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.762148:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d8 expref: 196 pid: 29628 timeout: 1147 lvb_type: 0 00000100:00100000:0.0:1763334982.762170:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701890304:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334982.763409:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694629120 00000100:00100000:3.0:1763334982.763423:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694629120 00010000:00010000:3.0:1763334982.763469:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 6/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d8 expref: 197 pid: 29628 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334982.764391:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc8a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d1 expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.764410:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc8a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d1 expref: 197 pid: 30972 timeout: 1147 lvb_type: 0 00000100:00100000:0.0:1763334982.764428:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701890432:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334982.764520:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98840 going to sleep for 11 seconds 00000100:00100000:3.0:1763334982.764625:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2673 00000100:00100000:3.0:1763334982.764638:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2360:x1848989694629120:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334982.764653:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334982.764662:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d8 expref: 197 pid: 29628 timeout: 1147 lvb_type: 0 00010000:00010000:3.0:1763334982.764678:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d8 expref: 197 pid: 29628 timeout: 1147 lvb_type: 0 00010000:00010000:3.0:1763334982.764705:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334982.764710:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.764719:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.764726:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334982.764776:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2360:x1848989694629120:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 141us (3081us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334982.764841:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2673 00000100:00100000:2.0:1763334982.768692:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.769026:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694629248 00000100:00100000:3.0:1763334982.769036:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694629248 00010000:00010000:0.0:1763334982.769064:0:30972:0:(ldlm_lockd.c:740:ldlm_handle_ast_error()) ### client (nid 192.168.201.60@tcp) returned -22 from blocking AST (req@00000000fd64ff85 x1848989701890304) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 1/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d8 expref: 197 pid: 29628 timeout: 1147 lvb_type: 0 00010000:00010000:3.0:1763334982.769080:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc8a lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d1 expref: 197 pid: 30972 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334982.769089:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849cca6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d8 expref: 197 pid: 29628 timeout: 1147 lvb_type: 0 00000100:00100000:0.0:1763334982.769108:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701890304:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334982.769110:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2674 00000100:00100000:3.0:1763334982.769119:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2360:x1848989694629248:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1763334982.769123:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701890432:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334982.769138:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334982.769143:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc8a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d1 expref: 196 pid: 30972 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334982.769151:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334982.769156:0:30972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.769166:0:30972:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.769494:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc8a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d1 expref: 196 pid: 30972 timeout: 1147 lvb_type: 0 00010000:00010000:3.0:1763334982.769521:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cc8a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05d1 expref: 196 pid: 30972 timeout: 1147 lvb_type: 0 00010000:00010000:3.0:1763334982.769534:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334982.769537:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.769545:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.769554:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334982.769612:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334982.769688:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2360:x1848989694629248:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 569us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334982.769697:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2674 00010000:00010000:0.0:1763334982.770522:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.770562:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334982.770568:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334982.770617:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 85452 00010000:00010000:0.0:1763334982.770822:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ccad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05df expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.770842:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05df expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.770851:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334982.770854:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763334982.770857:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334982.770918:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53663:x1848989694628992:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 9101us (9360us total) trans 8589939222 rc 0/0 00000100:00100000:0.0:1763334982.770926:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5012 00000100:00100000:2.0:1763334982.775484:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.775544:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694629376 00000100:00100000:0.0:1763334982.775558:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694629376 00000100:00100000:2.0:1763334982.775694:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5013 00000100:00100000:2.0:1763334982.775708:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53663:x1848989694629376:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334982.775738:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334982.775763:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccc2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05e6 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.775866:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849ccc9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.775882:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05df expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.775890:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849ccc9 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.775931:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05df expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.775956:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05df expref: 196 pid: 30972 timeout: 1147 lvb_type: 0 00000100:00100000:2.0:1763334982.775977:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab33480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701890560:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334982.777290:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68000 going to sleep for 11 seconds 00000100:00100000:1.0:1763334982.785243:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.785514:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694629504 00000100:00100000:0.0:1763334982.785528:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694629504 00010000:00010000:0.0:1763334982.785615:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05df expref: 197 pid: 30972 timeout: 1147 lvb_type: 0 00000100:00100000:0.0:1763334982.785658:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2675 00000100:00100000:0.0:1763334982.785670:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694629504:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334982.785694:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334982.785702:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05df expref: 197 pid: 30972 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334982.785717:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05df expref: 197 pid: 30972 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334982.785746:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334982.785752:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849ccc9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.785764:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849ccc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.785774:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849ccc9 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.785799:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334982.785879:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694629504:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 210us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334982.785888:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2675 00010000:00010000:2.0:1763334982.787473:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849ccb4 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05df expref: 196 pid: 30972 timeout: 1147 lvb_type: 0 00000100:00100000:2.0:1763334982.787506:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab33480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701890560:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334982.787538:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849ccc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.787548:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849ccc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.787556:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849ccc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334982.787651:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 85452 00000004:00200000:2.0:1763334982.787657:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334982.787684:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849ccc9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.787728:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccc2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05e6 expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.787747:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849ccc9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05e6 expref: 195 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.787758:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334982.787762:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334982.787767:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431600, rc 0) 00000100:00100000:2.0:1763334982.787851:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53663:x1848989694629376:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 12146us (12379us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.787862:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5013 00000100:00100000:1.0:1763334982.795005:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.795095:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694629760 00000100:00100000:2.0:1763334982.795110:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694629760 00000100:00100000:2.0:1763334982.795223:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5014 00000100:00100000:2.0:1763334982.795236:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53663:x1848989694629760:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334982.795264:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334982.795292:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ccd0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05ed expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.795427:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ccd7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.795447:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ccd7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.795459:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ccd7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334982.795476:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 85452 00010000:00010000:2.0:1763334982.795784:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ccd0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ed expref: 198 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.795808:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ccd7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ed expref: 197 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.795818:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334982.795821:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334982.795826:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431c00, rc 0) 00000100:00100000:2.0:1763334982.795909:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53663:x1848989694629760:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 675us (919us total) trans 8589939223 rc 0/0 00000100:00100000:2.0:1763334982.795919:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5014 00000100:00100000:1.0:1763334982.800595:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.800774:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.800961:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.801031:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694630016 00000100:00100000:3.0:1763334982.801044:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694630016 00000100:00100000:1.0:1763334982.801139:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694629888 00000100:00100000:1.0:1763334982.801144:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694629888 00000100:00100000:1.0:1763334982.801199:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5112 00000100:00100000:1.0:1763334982.801211:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694629888:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334982.801272:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.801303:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cc3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ae expref: 22 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.801313:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334982.801316:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334982.801320:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.801365:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cc3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ae expref: 22 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.801383:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cc3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ae expref: 22 pid: 26564 timeout: 1147 lvb_type: 0 00000100:00100000:1.0:1763334982.801402:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701890688:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334982.801497:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b540 going to sleep for 11 seconds 00000100:00100000:1.0:1763334982.801518:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694630144 00000100:00100000:1.0:1763334982.801522:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694630144 00000100:00100000:1.0:1763334982.801552:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5113 00000100:00100000:1.0:1763334982.801560:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694630144:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334982.801608:0:32241:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.801623:0:32241:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849cba3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0576 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.801637:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334982.801639:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334982.801642:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.801667:0:32241:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849cba3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0576 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.801677:0:32241:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849cba3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0576 expref: 23 pid: 6519 timeout: 1147 lvb_type: 0 00000100:00100000:1.0:1763334982.801688:0:32241:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701890816:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334982.801713:0:32241:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334982.803335:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5114 00000100:00100000:2.0:1763334982.803350:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694630016:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334982.803399:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.803421:0:32239:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb9c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b056f expref: 18 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.803429:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334982.803432:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334982.803435:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.803472:0:32239:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b056f expref: 18 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.803485:0:32239:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b056f expref: 18 pid: 6519 timeout: 1147 lvb_type: 0 00000100:00100000:2.0:1763334982.803502:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701890944:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334982.803598:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68000 going to sleep for 11 seconds 00000100:00100000:0.0:1763334982.810009:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.810339:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701890688:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334982.810377:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334982.810648:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694630272 00000100:00100000:3.0:1763334982.810657:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694630272 00010000:00010000:2.0:1763334982.811071:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cc3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ae expref: 24 pid: 26564 timeout: 1147 lvb_type: 0 00000100:00100000:2.0:1763334982.811125:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2676 00000100:00100000:2.0:1763334982.811134:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694630272:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334982.811153:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334982.811178:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cc3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ae expref: 24 pid: 26564 timeout: 1147 lvb_type: 0 00010000:00010000:2.0:1763334982.811191:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cc3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ae expref: 24 pid: 26564 timeout: 1147 lvb_type: 0 00010000:00010000:2.0:1763334982.811218:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cc3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 98304->102399) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ae expref: 24 pid: 26564 timeout: 1147 lvb_type: 0 00010000:00010000:2.0:1763334982.811236:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334982.811238:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334982.811244:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.811265:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.811298:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334982.811402:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab33480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701890944:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334982.811408:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694630272:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 233us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.811416:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2676 00010000:00010000:0.0:1763334982.811420:0:32239:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334982.811742:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.811776:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.811784:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694630400 00000100:00100000:0.0:1763334982.811789:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694630528 00000100:00100000:3.0:1763334982.811790:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694630400 00000100:00100000:0.0:1763334982.811793:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694630528 00010000:00010000:0.0:1763334982.811810:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b056f expref: 19 pid: 6519 timeout: 1147 lvb_type: 0 00010000:00010000:3.0:1763334982.811813:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849cba3 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0576 expref: 23 pid: 6519 timeout: 1147 lvb_type: 0 00000100:00100000:0.0:1763334982.811832:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2677 00000100:00100000:0.0:1763334982.811839:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2361:x1848989694630528:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334982.811849:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334982.811866:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb9c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b056f expref: 19 pid: 6519 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334982.811875:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb9c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b056f expref: 19 pid: 6519 timeout: 1147 lvb_type: 0 00000100:00100000:1.0:1763334982.812056:0:32241:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:32241:1848989701890816:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334982.812072:0:32241:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.812092:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.812100:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.812131:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.812139:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.812147:0:26564:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.812153:0:26564:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334982.812158:0:26564:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334982.812223:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2678 00000100:00100000:3.0:1763334982.812232:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2361:x1848989694630400:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334982.812241:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334982.812346:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849cba3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0576 expref: 23 pid: 6519 timeout: 1147 lvb_type: 0 00010000:00010000:3.0:1763334982.812357:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849cba3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0576 expref: 23 pid: 6519 timeout: 1147 lvb_type: 0 00010000:00010000:3.0:1763334982.812375:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849cba3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0576 expref: 23 pid: 6519 timeout: 1147 lvb_type: 0 00010000:00010000:1.0:1763334982.812385:0:26564:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.812388:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.812390:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334982.812394:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.812398:0:26564:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.812407:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cce5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.812409:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.812485:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849cb9c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b056f expref: 19 pid: 6519 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334982.812495:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.812497:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.812501:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.812509:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.812531:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334982.812559:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2361:x1848989694630528:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 720us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334982.812566:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2677 00010000:00010000:0.0:1763334982.812616:0:32239:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.812625:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.812645:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.812654:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.812663:0:32239:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.812668:0:32239:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334982.812671:0:32239:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.812679:0:32239:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.812689:0:32239:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334982.812696:0:32239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ccf3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334982.812741:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694630016:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 9393us (12182us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334982.812750:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5114 00000100:00100000:1.0:1763334982.813056:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694629888:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 11846us (12282us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334982.813063:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5112 00010000:00010000:2.0:1763334982.813436:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334982.813444:0:32241:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.813455:0:32241:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334982.813465:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694630400:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1235us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.813473:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2678 00010000:00010000:1.0:1763334982.813477:0:32241:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.813484:0:32241:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.813491:0:32241:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.813499:0:32241:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334982.813501:0:32241:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.813509:0:32241:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.813776:0:32241:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.813786:0:32241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849ccec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334982.813845:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694630144:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 12284us (12883us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334982.813853:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5113 00000100:00100000:2.0:1763334982.816747:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.816883:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694630784 00000100:00100000:3.0:1763334982.816897:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694630784 00000100:00100000:3.0:1763334982.816983:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5015 00000100:00100000:3.0:1763334982.816994:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53663:x1848989694630784:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:3.0:1763334982.817063:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1763334982.817098:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849ccc9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05e6 expref: 197 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.817124:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cc67 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05c3 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.817137:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334982.817143:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334982.817185:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ccfa lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.817201:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ccfa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334982.817212:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ccfa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000040:00080000:2.0:1763334982.818785:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1182, 88 off101184 00000004:00080000:2.0:1763334982.818803:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047452230384ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334982.819039:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1172, 88 off100128 00000004:00080000:2.0:1763334982.819045:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047452472782ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334982.819430:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1173, 88 off100216 00000004:00080000:2.0:1763334982.819437:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047452864950ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334982.819567:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1183, 88 off101272 00000004:00080000:2.0:1763334982.819705:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047453133022ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334982.819773:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1174, 88 off100304 00000004:00080000:2.0:1763334982.819779:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047453207592ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334982.819861:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1184, 88 off101360 00000004:00080000:2.0:1763334982.819867:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047453294828ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334982.819960:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1185, 88 off101448 00000004:00080000:2.0:1763334982.819966:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047453394022ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334982.820070:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1175, 88 off100392 00000004:00080000:2.0:1763334982.820076:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047453503860ns, next at 1047075229764ns, rc = 0 00000001:00080000:1.0:1763334982.852894:0:32484:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939222 is committed 00000001:00080000:1.0:1763334982.852956:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939224 is committed 00000004:00080000:1.0:1763334982.852963:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 785 committed 00000004:00080000:1.0:1763334982.852974:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 797 committed 00000004:00080000:1.0:1763334982.852981:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 796 committed 00000004:00080000:1.0:1763334982.852984:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 784 committed 00000004:00080000:1.0:1763334982.852987:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 795 committed 00000004:00080000:1.0:1763334982.852989:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 783 committed 00000004:00080000:1.0:1763334982.852991:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 782 committed 00000004:00080000:1.0:1763334982.852994:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 794 committed 00000100:00100000:1.0:1763334982.853200:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701891072:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334982.853292:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334982.853340:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763334982.853347:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701891456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334982.853369:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334982.853397:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701891328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334982.853421:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334982.853437:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763334982.853443:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701891200:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334982.853464:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334982.853495:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701891072 00000100:00100000:1.0:1763334982.853506:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701891072 00000100:00100000:1.0:1763334982.853557:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701891456 00000100:00100000:1.0:1763334982.853560:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701891456 00000100:00100000:1.0:1763334982.853601:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701891328 00000100:00100000:1.0:1763334982.853604:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701891328 00000100:00100000:1.0:1763334982.853623:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701891200 00000100:00100000:1.0:1763334982.853626:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701891200 00000100:00100000:1.0:1763334982.853649:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5115 00000100:00100000:1.0:1763334982.853659:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701891072:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334982.853890:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334982.853894:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334982.853898:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334982.853900:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334982.853903:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334982.853965:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701891072:12345-0@lo:2:osp-syn-0-0.0 Request processed in 307us (673us total) trans 21474838504 rc 0/0 00000100:00100000:1.0:1763334982.853974:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5115 00000100:00100000:1.0:1763334982.853993:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5116 00000100:00100000:1.0:1763334982.854000:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701891456:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334982.854082:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334982.854085:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334982 -> 1763334982 00002000:00010000:1.0:1763334982.854088:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334982.854090:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:1.0:1763334982.854093:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334982.854118:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701891456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 119us (748us total) trans 21474838505 rc 0/0 00000100:00100000:1.0:1763334982.854125:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5116 00000100:00100000:1.0:1763334982.854137:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5117 00000100:00100000:1.0:1763334982.854144:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3292:x1848989701891328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334982.854244:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3292:x1848989701891328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (821us total) trans 21474838506 rc 0/0 00000100:00100000:1.0:1763334982.854252:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5117 00000100:00100000:1.0:1763334982.854265:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5118 00000100:00100000:1.0:1763334982.854271:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3292:x1848989701891200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334982.854366:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3292:x1848989701891200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (900us total) trans 21474838507 rc 0/0 00000100:00100000:1.0:1763334982.854373:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5118 00000004:00080000:1.0:1763334982.854440:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b5f80/2, rc 0, transno 21474838507 00000100:00100000:1.0:1763334982.854447:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701891200:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334982.854458:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b6d80/2, rc 0, transno 21474838506 00000100:00100000:1.0:1763334982.854462:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701891328:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334982.854482:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b4a80/2, rc 0, transno 21474838505 00000100:00100000:1.0:1763334982.854485:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701891456:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334982.854493:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b5880/2, rc 0, transno 21474838504 00000100:00100000:1.0:1763334982.854497:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701891072:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334982.854806:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701891840:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334982.854845:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334982.854866:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763334982.854872:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeeceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701891712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334982.854892:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334982.854914:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701891840 00000100:00100000:0.0:1763334982.854920:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701891840 00000100:00100000:0.0:1763334982.854967:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701891712 00000100:00100000:0.0:1763334982.854970:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701891712 00000100:00100000:0.0:1763334982.854988:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5119 00000100:00100000:0.0:1763334982.854995:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3292:x1848989701891840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334982.855156:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334982.855160:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334982 -> 1763334982 00002000:00010000:0.0:1763334982.855162:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334982.855165:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334982 -> 1763334982 00002000:00010000:0.0:1763334982.855168:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334982.855201:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3292:x1848989701891840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 206us (356us total) trans 17179871260 rc 0/0 00000100:00100000:0.0:1763334982.855209:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5119 00000100:00100000:0.0:1763334982.855234:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5120 00000100:00100000:0.0:1763334982.855241:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3292:x1848989701891712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334982.855432:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701891968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334982.855469:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334982.855494:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1763334982.855500:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701891584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334982.855520:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334982.855553:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701891968 00000100:00100000:3.0:1763334982.855558:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701891968 00000100:00100000:3.0:1763334982.855616:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701891584 00000100:00100000:3.0:1763334982.855620:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701891584 00000100:00100000:3.0:1763334982.855642:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5121 00000100:00100000:3.0:1763334982.855649:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701891968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334982.855784:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701891968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 135us (314us total) trans 17179871261 rc 0/0 00000100:00100000:3.0:1763334982.855791:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5121 00000100:00100000:3.0:1763334982.855806:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5122 00000100:00100000:3.0:1763334982.855812:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3289:x1848989701891584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334982.855909:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3289:x1848989701891584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 96us (387us total) trans 17179871262 rc 0/0 00000100:00100000:3.0:1763334982.855916:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5122 00000100:00100000:3.0:1763334982.855972:0:3289:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871253 gen 2 00000004:00080000:3.0:1763334982.855978:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab35f80, transno 17179871246 00000004:00080000:3.0:1763334982.855989:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab36d80, transno 17179871247 00000004:00080000:3.0:1763334982.855993:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab34a80, transno 17179871248 00000004:00080000:3.0:1763334982.855996:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afab34700, transno 17179871249 00000004:00080000:3.0:1763334982.855999:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a82300, transno 17179871250 00000004:00080000:3.0:1763334982.856002:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a81f80, transno 17179871251 00000004:00080000:3.0:1763334982.856005:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a83800, transno 17179871252 00000004:00080000:3.0:1763334982.856008:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a83100, transno 17179871253 00000100:00100000:3.0:1763334982.856015:0:3289:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5aeece8700 x1848989701891584/t17179871262(17179871262) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334998 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763334982.856026:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeece8700/2, rc 0, transno 17179871262 00000100:00100000:3.0:1763334982.856031:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701891584:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334982.856042:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeece9c00/2, rc 0, transno 17179871261 00000100:00100000:3.0:1763334982.856046:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701891968:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1763334982.856084:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000009c39e82 reply state 00000000ff10b085 transno 8589939224 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ccfa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:3.0:1763334982.856097:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1763334982.856192:0:29628:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763334982.856207:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53663:x1848989694630784:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 39213us (39474us total) trans 8589939224 rc 0/0 00000100:00100000:3.0:1763334982.856216:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5015 00000100:00100000:0.0:1763334982.856389:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701891712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1147us (1494us total) trans 17179871263 rc 0/0 00000100:00100000:0.0:1763334982.856398:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5120 00010000:00010000:0.0:1763334982.856591:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ccfa lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.856602:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ccfa lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.856611:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ccfa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.856619:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334982.856624:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ccfa lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.856633:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ccfa lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.856652:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334982.856656:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334982.856662:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ccfa lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334982.856669:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067600/0xcedf0054f849ccfa lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000004:00080000:0.0:1763334982.856901:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 2 in flight, 8 done 00000004:00080000:0.0:1763334982.856930:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeeceaa00/2, rc 0, transno 17179871263 00000100:00100000:0.0:1763334982.856936:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeeceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701891712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334982.856961:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aeece9f80/2, rc 0, transno 17179871260 00000100:00100000:0.0:1763334982.856966:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701891840:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334982.864083:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.864789:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694630912 00000100:00100000:3.0:1763334982.864807:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694630912 00000100:00100000:3.0:1763334982.864883:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5016 00000100:00100000:3.0:1763334982.864896:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53663:x1848989694630912:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334982.864931:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334982.864973:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cd01 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05f4 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.865055:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cd01 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05f4 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.865074:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cd01 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05f4 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334982.865098:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334982.865102:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334982.865107:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:3.0:1763334982.865774:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53663:x1848989694630912:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 874us (1702us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334982.865786:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5016 00000100:00100000:0.0:1763334982.872248:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334982.872568:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694631040 00000100:00100000:3.0:1763334982.872628:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694631040 00000100:00100000:2.0:1763334982.872803:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5017 00000100:00100000:2.0:1763334982.872819:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53663:x1848989694631040:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334982.872849:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334982.872878:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849cd08 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b05fb expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.873010:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cd0f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.873029:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cd0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.873043:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cd0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334982.873080:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 85452 00000004:00200000:2.0:1763334982.873086:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334982.873108:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cd0f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334982.873142:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430400/0xcedf0054f849cd08 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05fb expref: 191 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.873166:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cd0f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05fb expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.873176:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334982.873181:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334982.873185:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:2.0:1763334982.875599:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53663:x1848989694631040:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2743us (3328us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.875615:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5017 00000100:00100000:2.0:1763334982.878378:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.878430:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.878466:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694631168 00000100:00100000:2.0:1763334982.878473:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334982.878481:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694631168 00000100:00100000:0.0:1763334982.878554:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694631296 00000100:00100000:0.0:1763334982.878559:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694631296 00000100:00100000:0.0:1763334982.878608:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694631424 00000100:00100000:0.0:1763334982.878612:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694631424 00000100:00100000:0.0:1763334982.878638:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5123 00000100:00100000:0.0:1763334982.878649:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694631168:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334982.878674:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1763334982.878679:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5124 00000100:00100000:1.0:1763334982.878693:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694631296:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334982.878704:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334982.878706:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849cd16 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0602 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.878721:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cd1d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0609 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334982.878740:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 85452, mtime: 0x691a5b47, atime: 0x691a5b44, ctime: 0x691a5b47, blocks: 0xa1 00002000:00010000:1.0:1763334982.878744:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x248:0x0] initial LVB size: 0, mtime: 0x691a5b47, atime: 0x691a5b44, ctime: 0x691a5b47, blocks: 0x3 00010000:00010000:1.0:1763334982.878768:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.878768:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334982.878772:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334982.878773:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334982.878789:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cd1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0609 expref: 18 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334982.878790:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849cd16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0602 expref: 22 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334982.878826:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cd1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0609 expref: 18 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334982.878828:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849cd16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0602 expref: 22 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334982.878854:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00010000:00010000:1.0:1763334982.878855:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:2.0:1763334982.879183:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5125 00000100:00100000:2.0:1763334982.879195:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694631424:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334982.879203:0:6517:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334982.879464:0:6517:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cd24 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0610 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334982.879589:0:6517:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x691a5b47, atime: 0x691a5b44, ctime: 0x691a5b47, blocks: 0x3 00010000:00010000:2.0:1763334982.879603:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334982.880509:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334982.880524:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cd24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0610 expref: 23 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334982.880545:0:6517:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cd24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0610 expref: 23 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334982.880559:0:6517:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431600, rc 0) 00000100:00100000:0.0:1763334982.880696:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb347050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694631168:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2045us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334982.880710:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5123 00000100:00100000:1.0:1763334982.880711:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694631296:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2019us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334982.880723:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5124 00000100:00100000:2.0:1763334982.880752:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694631424:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1560us (2280us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334982.880760:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5125 00000100:00100000:1.0:1763334982.916908:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.917026:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694631552 00000100:00100000:2.0:1763334982.917040:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694631552 00000100:00100000:2.0:1763334982.917236:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1937 00000100:00100000:2.0:1763334982.917249:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694631552:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334982.917297:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cd2b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.917316:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334982.917320:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334982.917328:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cd2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.917345:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cd2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.923449:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cd2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.923477:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cd2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.923489:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cd2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.923498:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334982.923504:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cd2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.923515:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cd2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.923540:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cd2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.923556:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849cd2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334982.923726:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694631552:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 6472us (6826us total) trans 0 rc 85452/85452 00000100:00100000:1.0:1763334982.923739:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1937 00000100:00100000:1.0:1763334982.933353:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334982.933483:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694631680 00000100:00100000:2.0:1763334982.933497:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694631680 00000100:00100000:2.0:1763334982.933630:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1938 00000100:00100000:2.0:1763334982.933642:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694631680:12345-192.168.201.60@tcp:4:lfs.0 00002000:00010000:2.0:1763334982.933713:0:14384:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 200814, mtime: 0x691a5b46, atime: 0x691a5b40, ctime: 0x691a5b46, blocks: 0x203 00010000:00010000:2.0:1763334982.933724:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849cd32 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.933741:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334982.933743:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334982.933750:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849cd32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334982.933765:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849cd32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763334982.985039:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838501 is committed 00000001:00080000:0.0:1763334982.985073:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838493 is committed 00000001:00080000:0.0:1763334982.985080:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838507 is committed 00000001:00080000:0.0:1763334982.985096:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838502 is committed 00000001:00080000:0.0:1763334982.985111:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838508 is committed 00002000:00010000:1.0:1763334982.985357:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334982 -> 1763334983 00002000:00010000:1.0:1763334982.985363:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334982 -> 1763334983 00010000:00010000:1.0:1763334982.985382:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849cd32 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.985397:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849cd32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.985408:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849cd32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.985416:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334982.985421:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849cd32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.985432:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849cd32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.985458:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849cd32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.985472:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849cd32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334982.986514:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694631680:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 52861us (53163us total) trans 21474838508 rc 0/0 00000100:00100000:1.0:1763334982.986530:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1938 00000100:00100000:0.0:1763334982.992866:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334982.993971:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694631808 00000100:00100000:1.0:1763334982.993990:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694631808 00000100:00100000:1.0:1763334982.994096:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1939 00000100:00100000:1.0:1763334982.994108:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694631808:12345-192.168.201.60@tcp:4:lfs.0 00002000:00010000:1.0:1763334982.994176:0:14384:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 200814, mtime: 0x691a5b46, atime: 0x691a5b44, ctime: 0x691a5b46, blocks: 0x203 00010000:00010000:1.0:1763334982.994188:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cd39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.994207:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334982.994209:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334982.994215:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cd39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334982.994232:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cd39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763334983.040641:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871263 is committed 00000001:00080000:1.0:1763334983.040683:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871264 is committed 00002000:00010000:2.0:1763334983.040967:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334982 -> 1763334983 00002000:00010000:2.0:1763334983.040973:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334982 -> 1763334983 00010000:00010000:2.0:1763334983.040991:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cd39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.041004:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cd39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.041015:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cd39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.041023:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334983.041028:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cd39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.041037:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cd39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.041058:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cd39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.041065:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849cd39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334983.041293:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694631808:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 47180us (48437us total) trans 17179871264 rc 0/0 00000100:00100000:2.0:1763334983.041306:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1939 00000100:00100000:0.0:1763334983.053327:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.054165:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694632064 00000100:00100000:2.0:1763334983.054180:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694632064 00000100:00100000:2.0:1763334983.054281:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5018 00000100:00100000:2.0:1763334983.054294:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53663:x1848989694632064:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334983.054363:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334983.054399:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cd0f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05fb expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.054429:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334983.054435:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334983.054830:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd40 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.054850:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.054861:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000001:00080000:2.0:1763334983.054928:0:29628:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939225 00000004:00010000:2.0:1763334983.054970:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007ba7ea9b reply state 00000000264430ee transno 8589939226 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334983.054981:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334983.055098:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53663:x1848989694632064:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 806us (1786us total) trans 8589939226 rc 0/0 00000100:00100000:2.0:1763334983.055107:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5018 00000020:00080000:2.0:1763334983.055113:0:29628:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:3.0:1763334983.055479:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1763334983.058840:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd40 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334983.058868:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd40 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334983.058876:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd40 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334983.058883:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334983.058888:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd40 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334983.058897:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd40 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334983.058919:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334983.058922:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334983.058928:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd40 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334983.058934:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd40 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334983.058975:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.059050:0:32241:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694632192 00000100:00100000:0.0:1763334983.059063:0:32241:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694632192 00000100:00100000:0.0:1763334983.059150:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5126 00000100:00100000:0.0:1763334983.059163:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+13:53663:x1848989694632192:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334983.059185:0:32241:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334983.059212:0:32241:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cd47 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0617 expref: -99 pid: 32241 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334983.059243:0:32241:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 200814, mtime: 0x691a5b47, atime: 0x691a5b40, ctime: 0x691a5b47, blocks: 0x203 00010000:00010000:0.0:1763334983.059286:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.059289:0:32241:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.059298:0:32241:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cd47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0617 expref: 14 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.059316:0:32241:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cd47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0617 expref: 14 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.059329:0:32241:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:0.0:1763334983.059407:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:f4599faa-cf4a-4df6-8700-d383b4282dac+14:53663:x1848989694632192:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 245us (437us total) trans 0 rc 0/0 00000100:00080000:3.0:1763334983.059412:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1763334983.059414:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5126 00000100:00100000:2.0:1763334983.061379:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334983.062762:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694632320 00000100:00100000:1.0:1763334983.062781:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694632320 00000100:00100000:2.0:1763334983.062864:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334983.062915:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694632448 00000100:00100000:3.0:1763334983.062927:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694632448 00000100:00080000:0.0:1763334983.063018:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1763334983.063054:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/590 (0->18446744073709551615) 00002000:00010000:1.0:1763334983.063055:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/586 (85452->18446744073709551615) 00002000:00100000:1.0:1763334983.063064:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab30380 with x1848989694632320 ext(85452->18446744073709551615) 00002000:00100000:3.0:1763334983.063065:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab30a80 with x1848989694632448 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334983.063084:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab30a80. 00002000:00010000:1.0:1763334983.063085:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afab30380. 00000100:00100000:1.0:1763334983.063130:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1940 00000100:00100000:3.0:1763334983.063141:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1941 00000100:00100000:1.0:1763334983.063146:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694632320:12345-192.168.201.60@tcp:10:lfs.0 00000100:00100000:3.0:1763334983.063156:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694632448:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:3.0:1763334983.063688:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334983.063689:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 200814 -> 85452 00002000:00010000:3.0:1763334983.063695:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334982 -> 1763334983 00002000:00010000:1.0:1763334983.063696:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334983.063701:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334983.063702:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334983.063706:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334982 -> 1763334983 00002000:00010000:1.0:1763334983.063707:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334983.063714:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1763334983.063714:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334983.063799:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694632448:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 645us (936us total) trans 17179871265 rc 0/0 00000100:00100000:1.0:1763334983.063800:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694632320:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 656us (2430us total) trans 21474838509 rc 0/0 00000100:00100000:3.0:1763334983.063975:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1941 00002000:00010000:3.0:1763334983.063981:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/590 (0->18446744073709551615) 00000100:00100000:1.0:1763334983.063986:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1940 00002000:00100000:3.0:1763334983.063987:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab30a80 with x1848989694632448 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334983.063993:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/586 (85452->18446744073709551615) 00002000:00010000:3.0:1763334983.063995:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab30a80. 00002000:00100000:1.0:1763334983.063999:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab30380 with x1848989694632320 ext(85452->18446744073709551615) 00002000:00010000:1.0:1763334983.064007:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afab30380. 00000100:00100000:2.0:1763334983.065725:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.066016:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694632576 00000100:00100000:0.0:1763334983.066029:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694632576 00000100:00100000:0.0:1763334983.066153:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5019 00000100:00100000:0.0:1763334983.066166:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53663:x1848989694632576:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334983.066198:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334983.066226:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd4e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b061e expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.066346:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cd55 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.066364:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cd55 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.066378:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cd55 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334983.066415:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 85452 00000004:00200000:0.0:1763334983.066421:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334983.066446:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cd55 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.066484:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd4e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b061e expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.066510:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cd55 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b061e expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.066520:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334983.066524:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334983.066528:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334983.066696:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53663:x1848989694632576:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 532us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334983.066708:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5019 00000100:00100000:1.0:1763334983.072953:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.073053:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694632832 00000100:00100000:0.0:1763334983.073067:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694632832 00000100:00100000:0.0:1763334983.073148:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5020 00000100:00100000:0.0:1763334983.073159:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53663:x1848989694632832:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334983.073235:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334983.073270:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cd55 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b061e expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.073294:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334983.073300:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334983.074251:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd5c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.074278:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd5c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.074292:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd5c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:0.0:1763334983.074397:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939227 00000004:00010000:0.0:1763334983.074437:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006717100b reply state 00000000bedab9af transno 8589939228 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd5c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334983.074448:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334983.077692:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53663:x1848989694632832:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 4513us (4741us total) trans 8589939228 rc 0/0 00000100:00100000:0.0:1763334983.077710:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5020 00000020:00080000:0.0:1763334983.077723:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763334983.086164:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334983.086388:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694632960 00000100:00100000:1.0:1763334983.086402:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694632960 00000100:00100000:1.0:1763334983.086475:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5127 00000100:00100000:1.0:1763334983.086487:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:53663:x1848989694632960:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334983.086501:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd5c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.086517:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd5c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.086526:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd5c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.086534:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334983.086540:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd5c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.086550:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd5c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.086569:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334983.086609:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334983.086616:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd5c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.086625:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd5c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334983.086664:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334983.086701:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cd63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0625 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334983.086783:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 200814, mtime: 0x691a5b47, atime: 0x691a5b44, ctime: 0x691a5b47, blocks: 0x203 00010000:00010000:2.0:1763334983.086814:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334983.086817:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334983.086829:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cd63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0625 expref: 22 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.086854:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cd63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0625 expref: 22 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.086868:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:2.0:1763334983.086958:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+22:53663:x1848989694632960:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 471us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.086967:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5127 00000100:00100000:2.0:1763334983.091103:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.091159:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334983.091273:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694633216 00000100:00100000:1.0:1763334983.091289:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694633216 00002000:00010000:1.0:1763334983.091356:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/587 (0->18446744073709551615) 00002000:00100000:1.0:1763334983.091362:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab33800 with x1848989694633216 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334983.091380:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afab33800. 00000100:00100000:1.0:1763334983.091933:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694633088 00000100:00100000:1.0:1763334983.091951:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694633088 00002000:00010000:1.0:1763334983.091973:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/591 (85452->18446744073709551615) 00002000:00100000:1.0:1763334983.091976:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab32680 with x1848989694633088 ext(85452->18446744073709551615) 00002000:00010000:1.0:1763334983.091984:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab32680. 00000100:00100000:0.0:1763334983.092262:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1942 00000100:00100000:0.0:1763334983.092279:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694633216:12345-192.168.201.60@tcp:10:lfs.0 00000100:00100000:3.0:1763334983.093008:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1943 00000100:00100000:2.0:1763334983.093122:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694633088:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:2.0:1763334983.093423:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 200814 -> 85452 00002000:00010000:2.0:1763334983.093427:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:2.0:1763334983.093429:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334983.093432:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:2.0:1763334983.093435:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:0.0:1763334983.093796:0:25999:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334983.093800:0:25999:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334982 -> 1763334983 00002000:00010000:0.0:1763334983.093802:0:25999:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334983.093805:0:25999:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334982 -> 1763334983 00002000:00010000:0.0:1763334983.093807:0:25999:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 1 -> 3 00000100:00100000:2.0:1763334983.094382:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694633088:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 1359us (3217us total) trans 17179871266 rc 0/0 00000100:00100000:2.0:1763334983.094395:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1943 00002000:00010000:2.0:1763334983.094401:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/591 (85452->18446744073709551615) 00002000:00100000:2.0:1763334983.094405:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab32680 with x1848989694633088 ext(85452->18446744073709551615) 00002000:00010000:2.0:1763334983.094415:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab32680. 00000100:00100000:0.0:1763334983.094774:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694633216:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 2499us (3685us total) trans 21474838510 rc 0/0 00000100:00100000:0.0:1763334983.094783:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1942 00002000:00010000:0.0:1763334983.094786:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/587 (0->18446744073709551615) 00002000:00100000:0.0:1763334983.094789:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab33800 with x1848989694633216 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334983.094794:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afab33800. 00000100:00100000:1.0:1763334983.100785:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.100887:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694633472 00000100:00100000:0.0:1763334983.100902:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694633472 00000100:00100000:0.0:1763334983.100989:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5021 00000100:00100000:0.0:1763334983.101003:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53663:x1848989694633472:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334983.101150:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd6a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.101174:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd6a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.101190:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd6a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:0.0:1763334983.101391:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006aeb90f6 reply state 00000000e82639a3 transno 8589939229 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd6a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334983.101401:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334983.101524:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53663:x1848989694633472:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 523us (756us total) trans 8589939229 rc 0/0 00000100:00100000:0.0:1763334983.101532:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5021 00010000:00010000:3.0:1763334983.103196:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd6a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334983.103217:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd6a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334983.103226:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd6a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334983.103234:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334983.103240:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd6a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334983.103250:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd6a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334983.103270:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334983.103274:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334983.103283:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd6a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334983.103290:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd6a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334983.103899:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334983.103952:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334983.104007:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.104323:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694633728 00000100:00100000:0.0:1763334983.104338:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694633728 00000100:00100000:0.0:1763334983.104408:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5128 00000100:00100000:0.0:1763334983.104420:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694633728:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334983.104746:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334983.104750:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.104753:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334980 -> 1763334983 00002000:00010000:0.0:1763334983.104755:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.104758:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334983.104829:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694633728:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 411us (936us total) trans 21474838511 rc 0/0 00000100:00100000:0.0:1763334983.104838:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5128 00000100:00100000:0.0:1763334983.104869:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694633856 00000100:00100000:0.0:1763334983.104873:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694633856 00000100:00100000:0.0:1763334983.104893:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694633600 00000100:00100000:0.0:1763334983.104896:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694633600 00000100:00100000:0.0:1763334983.104916:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5129 00000100:00100000:0.0:1763334983.104922:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694633856:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334983.105053:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334983.105056:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.105058:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334980 -> 1763334983 00002000:00010000:0.0:1763334983.105060:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.105062:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334983.105085:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694633856:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 163us (1145us total) trans 17179871267 rc 0/0 00000100:00100000:0.0:1763334983.105092:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5129 00000100:00100000:0.0:1763334983.105105:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5130 00000100:00100000:0.0:1763334983.105112:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694633600:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334983.105192:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 85452 -> 85452 00002000:00010000:0.0:1763334983.105196:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.105198:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334980 -> 1763334983 00002000:00010000:0.0:1763334983.105200:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.105202:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 161 -> 3 00000100:00100000:0.0:1763334983.105225:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694633600:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 112us (1217us total) trans 17179871268 rc 0/0 00000100:00100000:0.0:1763334983.105231:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5130 00000100:00100000:2.0:1763334983.108686:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334983.108783:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694634112 00000100:00100000:3.0:1763334983.108797:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694634112 00000100:00100000:3.0:1763334983.108953:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1825 00000100:00100000:3.0:1763334983.108967:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53663:x1848989694634112:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:3.0:1763334983.109053:0:29631:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x1ab:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ccd7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ed expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.109126:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334983.109143:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cd01 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05f4 expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.109154:0:29631:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334983.109201:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cd01 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05f4 expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.109221:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cd01 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05f4 expref: 194 pid: 29628 timeout: 1147 lvb_type: 0 00000100:00100000:3.0:1763334983.109238:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701892096:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334983.109368:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aec7a30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334983.117145:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d6d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701892096:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334983.117195:0:29631:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:2.0:1763334983.118492:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.118700:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694634240 00000100:00100000:0.0:1763334983.118712:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694634240 00010000:00010000:0.0:1763334983.118762:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cd01 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05f4 expref: 195 pid: 29628 timeout: 1147 lvb_type: 0 00000100:00100000:0.0:1763334983.118818:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2679 00000100:00100000:0.0:1763334983.118828:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2360:x1848989694634240:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334983.118846:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334983.118853:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cd01 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05f4 expref: 195 pid: 29628 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334983.118868:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cd01 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05f4 expref: 195 pid: 29628 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334983.118896:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849cd01 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05f4 expref: 195 pid: 29628 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334983.118915:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:0.0:1763334983.118921:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334983.118947:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334983.118955:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334983.118988:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334983.119062:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2360:x1848989694634240:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 235us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334983.119070:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2679 00010000:00010000:2.0:1763334983.119158:0:29631:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334983.119165:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000040:00080000:2.0:1763334983.119809:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1186, 88 off101536 00000004:00080000:2.0:1763334983.119822:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047753249573ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334983.119885:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1176, 88 off100480 00000004:00080000:2.0:1763334983.119892:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047753319922ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334983.119929:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1177, 88 off100568 00000004:00080000:2.0:1763334983.119934:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047753362145ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334983.119968:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1187, 88 off101624 00000004:00080000:2.0:1763334983.119973:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047753400962ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334983.119987:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1178, 88 off100656 00000004:00080000:2.0:1763334983.119991:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047753419209ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334983.120003:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1188, 88 off101712 00000004:00080000:2.0:1763334983.120007:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047753434899ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334983.120019:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1189, 88 off101800 00000004:00080000:2.0:1763334983.120023:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047753450952ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334983.120035:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1179, 88 off100744 00000004:00080000:2.0:1763334983.120039:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047753467369ns, next at 1047075229764ns, rc = 0 00000001:00080000:1.0:1763334983.157829:0:32484:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939229 is committed 00000001:00080000:1.0:1763334983.157858:0:32484:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939230 is committed 00000004:00080000:1.0:1763334983.157862:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 789 committed 00000004:00080000:1.0:1763334983.157873:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 801 committed 00000004:00080000:1.0:1763334983.157882:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 800 committed 00000004:00080000:1.0:1763334983.157884:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 788 committed 00000004:00080000:1.0:1763334983.157886:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 799 committed 00000004:00080000:1.0:1763334983.157887:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 787 committed 00000004:00080000:1.0:1763334983.157890:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 786 committed 00000004:00080000:1.0:1763334983.157892:0:32484:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 798 committed 00000100:00100000:1.0:1763334983.158097:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701892224:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334983.158196:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1763334983.158239:0:29631:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000d1aa04c3 reply state 0000000093583141 transno 8589939230 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:1.0:1763334983.158246:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701892736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334983.158255:0:29631:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763334983.158268:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00000100:00100000:1.0:1763334983.158269:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763334983.158272:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763334983.158282:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ccd7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b05ed expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334983.158303:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1763334983.158310:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701892608:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334983.158330:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334983.158347:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701893120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334983.158364:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334983.158387:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701892480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334983.158409:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1763334983.158417:0:29631:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1763334983.158423:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701892992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334983.158434:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53663:x1848989694634112:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 49470us (49763us total) trans 8589939230 rc 0/0 00000100:00100000:1.0:1763334983.158440:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334983.158446:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1825 00000100:00100000:1.0:1763334983.158455:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1763334983.158460:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701892352:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334983.158479:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334983.158494:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701892864:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763334983.158504:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00000100:00100000:1.0:1763334983.158511:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1763334983.158514:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334983.158527:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334983.158533:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334983.158538:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00000100:00100000:1.0:1763334983.158538:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701892224 00000100:00100000:1.0:1763334983.158547:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701892224 00000100:00100000:1.0:1763334983.158629:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701892736 00000100:00100000:1.0:1763334983.158633:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701892736 00000100:00100000:1.0:1763334983.158657:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701892608 00000100:00100000:1.0:1763334983.158660:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701892608 00000100:00100000:1.0:1763334983.158670:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701893120 00000100:00100000:1.0:1763334983.158673:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701893120 00000100:00100000:1.0:1763334983.158682:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701892480 00000100:00100000:1.0:1763334983.158684:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701892480 00000100:00100000:1.0:1763334983.158693:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701892992 00010000:00010000:3.0:1763334983.158695:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00000100:00100000:1.0:1763334983.158695:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701892992 00000100:00100000:1.0:1763334983.158705:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701892352 00000100:00100000:1.0:1763334983.158707:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701892352 00010000:00010000:3.0:1763334983.158712:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334983.158715:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1763334983.158715:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701892864 00000100:00100000:1.0:1763334983.158716:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701892864 00010000:00010000:3.0:1763334983.158720:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334983.158727:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849cd71 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00000100:00100000:1.0:1763334983.158729:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5131 00000100:00100000:1.0:1763334983.158736:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3290:x1848989701892224:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334983.158757:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5132 00000100:00100000:3.0:1763334983.158764:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3290:x1848989701892736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334983.159005:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 85452 -> 85452 00002000:00010000:1.0:1763334983.159005:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334983.159010:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334983.159010:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334983.159013:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334983.159013:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334983.159016:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334983.159016:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334983.159019:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1763334983.159019:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334983.159071:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3290:x1848989701892736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 292us (785us total) trans 17179871269 rc 0/0 00000100:00100000:3.0:1763334983.159078:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5132 00000100:00100000:2.0:1763334983.159091:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5133 00000100:00100000:2.0:1763334983.159105:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3290:x1848989701892608:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334983.159146:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5134 00000100:00100000:3.0:1763334983.159155:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3290:x1848989701893120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763334983.159203:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334983.159206:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:2.0:1763334983.159208:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334983.159210:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:2.0:1763334983.159213:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1763334983.159232:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 85452 -> 85452 00002000:00010000:3.0:1763334983.159235:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334983.159237:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334983.159240:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334983.159242:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1763334983.159294:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5135 00000100:00100000:0.0:1763334983.159304:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701892480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334983.159389:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 85452 -> 85452 00002000:00010000:0.0:1763334983.159392:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.159394:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334983.159396:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.159399:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1763334983.159434:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701892480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 133us (1025us total) trans 21474838514 rc 0/0 00000100:00100000:0.0:1763334983.159439:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5135 00000100:00100000:0.0:1763334983.159452:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5136 00000100:00100000:0.0:1763334983.159457:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701892992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334983.159545:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334983.159548:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.159551:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334983.159553:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.159556:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334983.159598:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701892992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 140us (1156us total) trans 17179871271 rc 0/0 00000100:00100000:0.0:1763334983.159605:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5136 00000100:00100000:0.0:1763334983.159618:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5137 00000100:00100000:0.0:1763334983.159624:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701892352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334983.159715:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334983.159721:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.159724:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.159726:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.159728:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334983.159750:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701892352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (1270us total) trans 21474838515 rc 0/0 00000100:00100000:0.0:1763334983.159755:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5137 00000100:00100000:0.0:1763334983.159766:0:32241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5138 00000100:00100000:0.0:1763334983.159772:0:32241:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3292:x1848989701892864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334983.159847:0:32241:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334983.159850:0:32241:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.159852:0:32241:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.159854:0:32241:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:0.0:1763334983.159857:0:32241:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334983.159877:0:32241:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701892864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (1365us total) trans 17179871272 rc 0/0 00000100:00100000:0.0:1763334983.159882:0:32241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5138 00000100:00100000:0.0:1763334983.159945:0:3292:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838507 gen 2 00000004:00080000:0.0:1763334983.159953:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9e86680, transno 21474838494 00000004:00080000:0.0:1763334983.159966:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9e84700, transno 21474838495 00000004:00080000:0.0:1763334983.159969:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9e85500, transno 21474838496 00000004:00080000:0.0:1763334983.159972:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9e84a80, transno 21474838497 00000004:00080000:0.0:1763334983.159975:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c9e87800, transno 21474838498 00000100:00100000:1.0:1763334983.159976:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3290:x1848989701892224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1239us (1780us total) trans 21474838512 rc 0/0 00000004:00080000:0.0:1763334983.159978:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca870700, transno 21474838499 00000004:00080000:0.0:1763334983.159981:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca871f80, transno 21474838500 00000100:00100000:1.0:1763334983.159982:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5131 00000004:00080000:0.0:1763334983.159985:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca870000, transno 21474838501 00000004:00080000:0.0:1763334983.159988:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b5880, transno 21474838504 00000004:00080000:0.0:1763334983.159991:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b4a80, transno 21474838505 00000004:00080000:0.0:1763334983.159994:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b6d80, transno 21474838506 00000004:00080000:0.0:1763334983.159997:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b5f80, transno 21474838507 00000100:00100000:0.0:1763334983.160004:0:3292:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5ac95b7b80 x1848989701892352/t21474838515(21474838515) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334999 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763334983.160016:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b7b80/2, rc 0, transno 21474838515 00000100:00100000:0.0:1763334983.160021:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701892352:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334983.160034:0:3292:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871263 gen 2 00000004:00080000:0.0:1763334983.160037:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeece9f80, transno 17179871260 00000004:00080000:0.0:1763334983.160046:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeece9c00, transno 17179871261 00000004:00080000:0.0:1763334983.160049:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeece8700, transno 17179871262 00000004:00080000:0.0:1763334983.160051:0:3292:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aeeceaa00, transno 17179871263 00000100:00100000:0.0:1763334983.160055:0:3292:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5afa44d180 x1848989701892864/t17179871272(17179871272) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763334999 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1763334983.160062:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44d180/2, rc 0, transno 17179871272 00000100:00100000:0.0:1763334983.160066:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701892864:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1763334983.160077:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b6680/2, rc 0, transno 21474838514 00000100:00100000:0.0:1763334983.160080:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701892480:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334983.160087:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44c380/2, rc 0, transno 17179871271 00000100:00100000:0.0:1763334983.160092:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701892992:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1763334983.160185:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1763334983.160192:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1763334983.160408:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 4 in progress, 2 in flight, 4 done 00000100:00100000:3.0:1763334983.160875:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3290:x1848989701893120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1716us (2504us total) trans 17179871270 rc 0/0 00000100:00100000:3.0:1763334983.160888:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5134 00000004:00080000:1.0:1763334983.160971:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 4 in progress, 2 in flight, 12 done 00000004:00080000:3.0:1763334983.160999:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b7100/2, rc 0, transno 21474838513 00000100:00100000:3.0:1763334983.161006:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701892608:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334983.161020:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5afa44d880/2, rc 0, transno 17179871270 00000100:00100000:3.0:1763334983.161024:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701893120:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334983.161034:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b4700/2, rc 0, transno 21474838512 00000100:00100000:3.0:1763334983.161038:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701892224:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334983.161045:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b4e00/2, rc 0, transno 17179871269 00000100:00100000:3.0:1763334983.161049:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701892736:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334983.161195:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3290:x1848989701892608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1772us (2538us total) trans 21474838513 rc 0/0 00000100:00100000:2.0:1763334983.161204:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5133 00000100:00100000:1.0:1763334983.162467:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.162915:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694634368 00000100:00100000:2.0:1763334983.162932:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694634368 00000100:00100000:2.0:1763334983.163030:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5022 00000100:00100000:2.0:1763334983.163043:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53663:x1848989694634368:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334983.163078:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334983.163114:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd78 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b062c expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.163212:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd78 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b062c expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.163232:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd78 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b062c expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.163258:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:2.0:1763334983.163262:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334983.163267:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430800, rc 0) 00000100:00100000:2.0:1763334983.163360:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53663:x1848989694634368:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 319us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.163368:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5022 00000100:00100000:2.0:1763334983.166754:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334983.167009:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694634624 00000100:00100000:3.0:1763334983.167024:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694634624 00000100:00100000:3.0:1763334983.167364:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1826 00000100:00100000:3.0:1763334983.167379:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac37a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53663:x1848989694634624:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334983.167911:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac37a9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53663:x1848989694634624:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 533us (1335us total) trans 8589939231 rc 0/0 00000100:00100000:3.0:1763334983.167921:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1826 00000100:00100000:2.0:1763334983.184774:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.184858:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694634752 00000100:00100000:0.0:1763334983.184873:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694634752 00000100:00100000:0.0:1763334983.184956:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5023 00000100:00100000:0.0:1763334983.184968:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53664:x1848989694634752:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334983.184998:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334983.185027:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cd7f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0633 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.185109:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cd86 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185126:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cd86 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185139:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cd86 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185159:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cd8d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185165:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cd8d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185171:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cd8d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185312:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd94 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185322:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185332:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334983.185375:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 85452 00000004:00200000:0.0:1763334983.185379:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334983.185400:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185413:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd94 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185421:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cd86 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185427:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cd86 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185434:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cd86 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185439:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334983.185444:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cd86 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185451:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cd86 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185464:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:0.0:1763334983.185468:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334983.185474:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cd86 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185481:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cd86 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185496:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cd8d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185502:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cd8d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185506:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cd8d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185511:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334983.185514:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cd8d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185519:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cd8d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185527:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334983.185529:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334983.185532:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cd8d lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185536:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cd8d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.185887:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cd7f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0633 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.185904:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0633 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.185911:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334983.185915:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334983.185918:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334983.186856:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53664:x1848989694634752:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1883us (2090us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334983.186867:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5023 00000100:00100000:1.0:1763334983.192491:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.192606:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694635008 00000100:00100000:0.0:1763334983.192621:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694635008 00000100:00100000:0.0:1763334983.192705:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5024 00000100:00100000:0.0:1763334983.192718:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53664:x1848989694635008:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334983.192745:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334983.192772:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cd9b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b063a expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.192912:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cda2 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.192930:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cda2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.192956:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cda2 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334983.192972:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 85452 00010000:00010000:0.0:1763334983.193140:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cd9b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b063a expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.193163:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cda2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b063a expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.193175:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334983.193179:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763334983.193184:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334983.193276:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53664:x1848989694635008:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 560us (802us total) trans 8589939232 rc 0/0 00000100:00100000:0.0:1763334983.193284:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5024 00000100:00100000:2.0:1763334983.197822:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.197915:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694635264 00000100:00100000:0.0:1763334983.197929:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694635264 00000100:00100000:0.0:1763334983.198012:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5025 00000100:00100000:0.0:1763334983.198024:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53664:x1848989694635264:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334983.198056:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334983.198083:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cdb0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0641 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.198245:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdb7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334983.198265:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdb7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334983.198278:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdb7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:0.0:1763334983.198294:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 85452 00010000:00010000:0.0:1763334983.198465:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cdb0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0641 expref: 195 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.198487:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdb7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0641 expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.198498:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334983.198502:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334983.198507:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334983.198632:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53664:x1848989694635264:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 609us (827us total) trans 8589939233 rc 0/0 00000100:00100000:0.0:1763334983.198641:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5025 00000100:00100000:3.0:1763334983.231124:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.231230:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694635392 00000100:00100000:0.0:1763334983.231244:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694635392 00000100:00100000:0.0:1763334983.231335:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1944 00000100:00100000:0.0:1763334983.231348:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694635392:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334983.231397:0:25999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cdc5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.231417:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.231419:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.231427:0:25999:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cdc5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.231441:0:25999:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cdc5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.239555:0:25999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cdc5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.239631:0:25999:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cdc5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.239641:0:25999:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cdc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.239648:0:25999:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334983.239655:0:25999:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cdc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.239665:0:25999:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cdc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.239689:0:25999:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cdc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.239698:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cdc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334983.239814:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694635392:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 8460us (8697us total) trans 0 rc 85452/85452 00000100:00100000:0.0:1763334983.239826:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1944 00000100:00100000:3.0:1763334983.244648:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.244822:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694635520 00000100:00100000:0.0:1763334983.244839:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694635520 00000100:00100000:0.0:1763334983.244955:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1945 00000100:00100000:0.0:1763334983.244968:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694635520:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334983.245021:0:25999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.245047:0:25999:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cd47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0617 expref: 17 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.245055:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334983.245057:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334983.245061:0:25999:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 4/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.245114:0:25999:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cd47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0617 expref: 17 pid: 32241 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.245132:0:25999:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cd47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0617 expref: 17 pid: 32241 timeout: 1147 lvb_type: 0 00000100:00100000:0.0:1763334983.245154:0:25999:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0000_UUID:25999:1848989701893248:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334983.245288:0:25999:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98f00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334983.247647:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334983.247818:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694635648 00000100:00100000:3.0:1763334983.247830:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694635648 00010000:00010000:3.0:1763334983.247879:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cd47 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0617 expref: 18 pid: 32241 timeout: 1147 lvb_type: 0 00000100:00100000:3.0:1763334983.247929:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2680 00000100:00100000:3.0:1763334983.247950:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2361:x1848989694635648:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334983.247971:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334983.247998:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cd47 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0617 expref: 18 pid: 32241 timeout: 1147 lvb_type: 0 00010000:00010000:3.0:1763334983.248013:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cd47 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0617 expref: 18 pid: 32241 timeout: 1147 lvb_type: 0 00010000:00010000:3.0:1763334983.248045:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334983.248047:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334983.248052:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.248064:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.248088:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334983.249024:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2361:x1848989694635648:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1075us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334983.249036:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2680 00010000:00010000:0.0:1763334983.250543:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cd47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0617 expref: 17 pid: 32241 timeout: 1147 lvb_type: 0 00000100:00100000:0.0:1763334983.250925:0:25999:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0000_UUID:25999:1848989701893248:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334983.250965:0:25999:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.250978:0:25999:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.250985:0:25999:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.257418:0:25999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.257446:0:25999:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.257457:0:25999:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.257465:0:25999:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334983.257470:0:25999:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.257480:0:25999:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.257504:0:25999:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.257511:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cdcc lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334983.257927:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694635520:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 12954us (13290us total) trans 0 rc 85452/85452 00000100:00100000:2.0:1763334983.257948:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1945 00000100:00100000:1.0:1763334983.260779:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.261627:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694635776 00000100:00100000:2.0:1763334983.261641:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694635776 00000100:00100000:2.0:1763334983.261739:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1946 00000100:00100000:2.0:1763334983.261751:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2362:x1848989694635776:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334983.261806:0:25999:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.261831:0:25999:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cd63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0625 expref: 25 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.261842:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334983.261844:0:25999:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334983.261849:0:25999:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.261900:0:25999:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cd63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0625 expref: 25 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.261916:0:25999:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cd63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0625 expref: 25 pid: 26564 timeout: 1147 lvb_type: 0 00000100:00100000:2.0:1763334983.261945:0:25999:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab33480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0001_UUID:25999:1848989701893376:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334983.262050:0:25999:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68c00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334983.266422:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.267253:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694635904 00000100:00100000:0.0:1763334983.267272:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694635904 00000100:00100000:2.0:1763334983.267478:0:25999:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab33480 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_016:lustre-OST0001_UUID:25999:1848989701893376:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334983.267516:0:25999:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.267678:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cd63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0625 expref: 26 pid: 26564 timeout: 1147 lvb_type: 0 00000100:00100000:0.0:1763334983.267730:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2681 00000100:00100000:0.0:1763334983.267742:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694635904:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334983.267769:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334983.267800:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cd63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0625 expref: 26 pid: 26564 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334983.267816:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cd63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0625 expref: 26 pid: 26564 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334983.267846:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849cd63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0625 expref: 26 pid: 26564 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334983.267869:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.267872:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.267877:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.267888:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.267924:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334983.267955:0:25999:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.267967:0:25999:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334983.268011:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694635904:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 270us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334983.268021:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2681 00010000:00010000:2.0:1763334983.274871:0:25999:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.274896:0:25999:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.274905:0:25999:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.274911:0:25999:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334983.274916:0:25999:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.274925:0:25999:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.274957:0:25999:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.274963:0:25999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849cdd3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->86015] (req 0->86015) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25999 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334983.275074:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694635776:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 13319us (14302us total) trans 0 rc 85452/85452 00000100:00100000:2.0:1763334983.275084:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1946 00000100:00100000:1.0:1763334983.286111:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.287727:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694636032 00000100:00100000:0.0:1763334983.287744:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694636032 00000100:00100000:2.0:1763334983.288424:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 414 00000100:00100000:2.0:1763334983.288442:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53664:x1848989694636032:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:2.0:1763334983.288464:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334983.288499:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdb7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0641 expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.288523:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:2.0:1763334983.288531:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334983.288662:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53664:x1848989694636032:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 227us (2565us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.288670:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 414 00000100:00100000:3.0:1763334983.291114:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.291208:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694636288 00000100:00100000:2.0:1763334983.291221:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694636288 00000100:00100000:2.0:1763334983.291298:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1827 00000100:00100000:2.0:1763334983.291311:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53664:x1848989694636288:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334983.291660:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53664:x1848989694636288:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 350us (558us total) trans 8589939234 rc 0/0 00000100:00100000:2.0:1763334983.291668:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1827 00000100:00100000:1.0:1763334983.300858:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.301243:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694636544 00000100:00100000:0.0:1763334983.301342:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694636544 00000100:00100000:0.0:1763334983.301466:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5026 00000100:00100000:0.0:1763334983.301479:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53644:x1848989694636544:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334983.301511:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334983.301541:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cdda lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0648 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.301697:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334983.301716:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd94 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0633 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.301727:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334983.301768:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0633 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.301784:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0633 expref: 195 pid: 30972 timeout: 1147 lvb_type: 0 00000100:00100000:0.0:1763334983.301801:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701893504:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334983.302364:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98840 going to sleep for 11 seconds 00000100:00100000:0.0:1763334983.304463:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701893504:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334983.304477:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.304556:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694636672 00000100:00100000:2.0:1763334983.304566:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694636672 00010000:00010000:2.0:1763334983.304650:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0633 expref: 196 pid: 30972 timeout: 1147 lvb_type: 0 00000100:00100000:2.0:1763334983.304697:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2682 00000100:00100000:2.0:1763334983.304708:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2360:x1848989694636672:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334983.304728:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334983.304736:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd94 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0633 expref: 196 pid: 30972 timeout: 1147 lvb_type: 0 00010000:00010000:0.0:1763334983.304748:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.304761:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd94 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0633 expref: 196 pid: 30972 timeout: 1147 lvb_type: 0 00010000:00010000:2.0:1763334983.304839:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cd94 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0633 expref: 196 pid: 30972 timeout: 1147 lvb_type: 0 00010000:00010000:2.0:1763334983.304859:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:2.0:1763334983.304864:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.304873:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.304880:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.304904:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334983.304929:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334983.304948:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:0.0:1763334983.304973:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 85452 00000100:00100000:2.0:1763334983.305155:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2360:x1848989694636672:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 448us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.305162:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2682 00010000:00010000:0.0:1763334983.305171:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cdda lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0648 expref: 197 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.305187:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0648 expref: 195 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.305194:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334983.305197:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763334983.305200:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334983.305269:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694636544:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 3793us (4429us total) trans 8589939235 rc 0/0 00000100:00100000:0.0:1763334983.305277:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5026 00000100:00100000:1.0:1763334983.307793:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.307849:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694636800 00000100:00100000:0.0:1763334983.307864:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694636800 00000100:00100000:0.0:1763334983.307952:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5027 00000100:00100000:0.0:1763334983.307965:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694636800:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334983.307998:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334983.308030:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cdef lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b064f expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.308205:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdf6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334983.308223:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0648 expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.308235:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdf6 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334983.308282:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0648 expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.308297:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0648 expref: 196 pid: 29628 timeout: 1147 lvb_type: 0 00000100:00100000:0.0:1763334983.308314:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701893632:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334983.308429:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98840 going to sleep for 11 seconds 00000100:00100000:1.0:1763334983.312062:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.312352:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694636928 00000100:00100000:2.0:1763334983.312365:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694636928 00010000:00010000:2.0:1763334983.312418:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0648 expref: 197 pid: 29628 timeout: 1147 lvb_type: 0 00000100:00100000:2.0:1763334983.312465:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2683 00000100:00100000:2.0:1763334983.312475:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694636928:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334983.312495:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334983.312504:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0648 expref: 197 pid: 29628 timeout: 1147 lvb_type: 0 00010000:00010000:2.0:1763334983.312520:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0648 expref: 197 pid: 29628 timeout: 1147 lvb_type: 0 00010000:00010000:2.0:1763334983.312551:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:2.0:1763334983.312558:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdf6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.312569:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.312932:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdf6 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.312973:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334983.313194:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cde1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0648 expref: 197 pid: 29628 timeout: 1147 lvb_type: 0 00000100:00100000:0.0:1763334983.313214:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701893632:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334983.313240:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334983.313251:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334983.313257:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:0.0:1763334983.313314:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 85452 00000004:00200000:0.0:1763334983.313320:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334983.313346:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdf6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334983.313391:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cdef lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b064f expref: 197 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.313407:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdf6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b064f expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.313415:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334983.313419:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334983.313422:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:2.0:1763334983.315174:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694636928:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 2685us (3113us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334983.315174:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53644:x1848989694636800:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 7201us (7382us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.315191:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2683 00000100:00100000:0.0:1763334983.315385:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5027 00000100:00100000:1.0:1763334983.324977:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.325045:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694637184 00000100:00100000:0.0:1763334983.325059:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694637184 00000100:00100000:0.0:1763334983.325131:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1828 00000100:00100000:0.0:1763334983.325143:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694637184:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:0.0:1763334983.325485:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53644:x1848989694637184:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 342us (521us total) trans 8589939236 rc 0/0 00000100:00100000:0.0:1763334983.325505:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1828 00000100:00100000:3.0:1763334983.330432:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.331489:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694637440 00000100:00100000:0.0:1763334983.331506:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694637440 00000100:00100000:0.0:1763334983.331624:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5028 00000100:00100000:0.0:1763334983.331635:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53644:x1848989694637440:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334983.331666:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334983.331669:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1763334983.331705:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cdf6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b064f expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.331920:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cda2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b063a expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.331947:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cd78 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b062c expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.331960:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:0.0:1763334983.331973:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334983.331992:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cdfd lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0656 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.332452:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce04 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334983.332469:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce04 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334983.332479:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce04 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000040:00080000:0.0:1763334983.333123:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1190, 88 off101888 00000004:00080000:0.0:1763334983.333134:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047966561514ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334983.333190:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1180, 88 off100832 00000004:00080000:0.0:1763334983.333195:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047966623551ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334983.333253:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1181, 88 off100920 00000004:00080000:0.0:1763334983.333258:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047966686738ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334983.333275:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1191, 88 off101976 00000004:00080000:0.0:1763334983.333279:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047966707007ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334983.333299:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1182, 88 off101008 00000004:00080000:0.0:1763334983.333303:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047966731512ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334983.333320:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1192, 88 off102064 00000004:00080000:0.0:1763334983.333325:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047966752946ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334983.333354:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1193, 88 off102152 00000004:00080000:0.0:1763334983.333359:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1047966787488ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334983.333380:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1183, 88 off101096 00000004:00080000:0.0:1763334983.333384:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1047966812086ns, next at 1047075229764ns, rc = 0 00000001:00080000:1.0:1763334983.372500:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939237 is committed 00000004:00080000:1.0:1763334983.372520:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 793 committed 00000004:00080000:1.0:1763334983.372534:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 805 committed 00000004:00080000:1.0:1763334983.372543:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 804 committed 00000004:00080000:1.0:1763334983.372547:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 792 committed 00000004:00080000:1.0:1763334983.372549:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 803 committed 00000004:00080000:1.0:1763334983.372551:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 791 committed 00000004:00080000:1.0:1763334983.372554:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 790 committed 00000004:00080000:1.0:1763334983.372556:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 802 committed 00000100:00100000:1.0:1763334983.372885:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701894016:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334983.372999:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334983.373050:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701894528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334983.373081:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334983.373116:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1763334983.373122:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701893888:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334983.373144:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334983.373176:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701894400:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334983.373229:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334983.373268:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701894016 00000100:00100000:1.0:1763334983.373278:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701894016 00000100:00100000:1.0:1763334983.373330:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701894528 00000100:00100000:1.0:1763334983.373333:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701894528 00000100:00100000:1.0:1763334983.373354:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701893888 00000100:00100000:1.0:1763334983.373357:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701893888 00000100:00100000:1.0:1763334983.373373:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701894400 00000100:00100000:1.0:1763334983.373376:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701894400 00000100:00100000:1.0:1763334983.373399:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5139 00000100:00100000:1.0:1763334983.373410:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701894016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334983.373735:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701894016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 325us (735us total) trans 21474838516 rc 0/0 00000100:00100000:1.0:1763334983.373743:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5139 00000100:00100000:1.0:1763334983.373763:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5140 00000100:00100000:1.0:1763334983.373770:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701894528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334983.373881:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334983.373885:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334983.373888:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334983.373891:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334983.373894:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334983.373918:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701894528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 148us (838us total) trans 17179871273 rc 0/0 00000100:00100000:1.0:1763334983.373923:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5140 00000100:00100000:1.0:1763334983.373948:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5141 00000100:00100000:1.0:1763334983.373955:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701893888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334983.374036:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334983.374040:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334983.374042:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334983.374044:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334983.374046:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334983.374074:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701893888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 119us (928us total) trans 21474838517 rc 0/0 00000100:00100000:1.0:1763334983.374080:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5141 00000100:00100000:1.0:1763334983.374091:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5142 00000100:00100000:1.0:1763334983.374097:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701894400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334983.374178:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334983.374181:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334983.374183:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334983.374186:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334983.374188:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334983.374213:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee545c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701894400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (985us total) trans 17179871274 rc 0/0 00000100:00100000:1.0:1763334983.374219:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5142 00000004:00080000:1.0:1763334983.374285:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac8419c00/2, rc 0, transno 21474838517 00000100:00100000:1.0:1763334983.374292:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8419c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701893888:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334983.374302:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841a300/2, rc 0, transno 17179871274 00000100:00100000:1.0:1763334983.374306:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701894400:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334983.374315:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841b800/2, rc 0, transno 21474838516 00000100:00100000:1.0:1763334983.374319:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701894016:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334983.374326:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac8418e00/2, rc 0, transno 17179871273 00000100:00100000:1.0:1763334983.374329:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701894528:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1763334983.374566:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce04 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0656 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.374611:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:3.0:1763334983.374614:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334983.374638:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cdfd lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0656 expref: 189 pid: 29628 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763334983.374662:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce04 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0656 expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.374699:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:3.0:1763334983.374703:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334983.374706:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:3.0:1763334983.374774:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee9d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694637440:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 43141us (44359us total) trans 8589939237 rc 0/0 00000100:00100000:3.0:1763334983.374783:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5028 00000100:00100000:3.0:1763334983.374821:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701894144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334983.374864:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334983.374891:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701894656:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334983.374914:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334983.374948:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763334983.374967:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701893760:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334983.374989:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334983.375006:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701894272:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334983.375026:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334983.375054:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701894144 00000100:00100000:3.0:1763334983.375060:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701894144 00000100:00100000:3.0:1763334983.375095:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701894656 00000100:00100000:3.0:1763334983.375099:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701894656 00000100:00100000:3.0:1763334983.375121:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701893760 00000100:00100000:3.0:1763334983.375124:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701893760 00000100:00100000:2.0:1763334983.375129:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701894272 00000100:00100000:3.0:1763334983.375140:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5143 00000100:00100000:2.0:1763334983.375146:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701894272 00000100:00100000:3.0:1763334983.375151:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701894144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334983.375178:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5144 00000100:00100000:2.0:1763334983.375188:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701894656:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334983.375320:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334983.375324:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334983.375327:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334983.375329:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334983.375331:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334983.375369:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701894656:12345-0@lo:2:osp-syn-1-0.0 Request processed in 182us (452us total) trans 17179871275 rc 0/0 00000100:00100000:3.0:1763334983.375370:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701894144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 220us (505us total) trans 21474838518 rc 0/0 00000100:00100000:3.0:1763334983.375383:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5143 00000100:00100000:2.0:1763334983.375806:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5144 00000100:00100000:3.0:1763334983.375816:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5145 00000100:00100000:2.0:1763334983.375827:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5146 00000100:00100000:3.0:1763334983.375829:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701893760:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334983.375844:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701894272:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334983.375930:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334983.375943:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334983.375945:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334983.375947:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334983.375949:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334983.375973:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701893760:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (984us total) trans 21474838519 rc 0/0 00000100:00100000:3.0:1763334983.375979:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5145 00000004:00080000:3.0:1763334983.376051:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841b480/2, rc 0, transno 21474838519 00000100:00100000:3.0:1763334983.376056:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701893760:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334983.376064:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac8418000/2, rc 0, transno 21474838518 00000100:00100000:3.0:1763334983.376066:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701894144:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334983.376074:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac95b5880/2, rc 0, transno 17179871275 00000100:00100000:3.0:1763334983.376077:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701894656:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1763334983.376161:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 85452 -> 85452 00002000:00010000:2.0:1763334983.376165:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:2.0:1763334983.376168:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334983 -> 1763334983 00002000:00010000:2.0:1763334983.376171:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:2.0:1763334983.376173:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334983.376217:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3289:x1848989701894272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 376us (1188us total) trans 17179871276 rc 0/0 00000100:00100000:2.0:1763334983.376225:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5146 00000004:00080000:3.0:1763334983.376360:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841ad80/2, rc 0, transno 17179871276 00000100:00100000:3.0:1763334983.376365:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701894272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334983.381974:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.382517:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694637568 00000100:00100000:2.0:1763334983.382530:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694637568 00000100:00100000:2.0:1763334983.383324:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5147 00000100:00100000:2.0:1763334983.383343:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:53644:x1848989694637568:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334983.383369:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334983.383394:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ce0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b065d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.383433:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849cd16 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0602 expref: 25 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334983.383443:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334983.383446:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334983.383451:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ce0b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [208896->229375] (req 208896->229375) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b065d expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.383495:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849cd16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0602 expref: 25 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334983.383517:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849cd16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0602 expref: 25 pid: 32239 timeout: 1148 lvb_type: 1 00000100:00100000:2.0:1763334983.383534:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701894784:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334983.383682:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334983.394688:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701894784:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334983.394743:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ce0b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [208896->229375] (req 208896->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b065d expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.394774:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:2.0:1763334983.394869:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee546680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:53644:x1848989694637568:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 11532us (12909us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.394880:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5147 00000100:00100000:1.0:1763334983.394988:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.396038:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694637696 00000100:00100000:2.0:1763334983.396052:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694637696 00010000:00010000:2.0:1763334983.396099:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849cd16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0602 expref: 25 pid: 32239 timeout: 1148 lvb_type: 1 00000100:00100000:2.0:1763334983.396140:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2684 00000100:00100000:2.0:1763334983.396151:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee546300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694637696:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334983.396168:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334983.396197:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849cd16 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0602 expref: 25 pid: 32239 timeout: 1148 lvb_type: 1 00010000:00010000:2.0:1763334983.396217:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849cd16 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0602 expref: 25 pid: 32239 timeout: 1148 lvb_type: 1 00010000:00010000:2.0:1763334983.396338:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849cd16 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0602 expref: 25 pid: 32239 timeout: 1148 lvb_type: 1 00010000:00010000:2.0:1763334983.396360:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334983.396362:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334983.396373:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ce0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->229375) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b065d expref: 24 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.396386:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ce0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->229375) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b065d expref: 24 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.396432:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ce0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b065d expref: 24 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334983.396449:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab32300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701894912:192.168.201.60@tcp:105: 00000100:00100000:2.0:1763334983.396543:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334983.402050:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab32300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701894912:192.168.201.60@tcp:105: 00010000:00010000:2.0:1763334983.402090:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334983.402175:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee546300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694637696:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 6024us (7185us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.402189:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2684 00000100:00100000:2.0:1763334983.407434:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334983.407830:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694637824 00000100:00100000:3.0:1763334983.407845:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694637824 00000100:00100000:2.0:1763334983.408809:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5029 00000100:00100000:2.0:1763334983.408833:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694637824:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334983.408868:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334983.408899:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ce12 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0664 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.409026:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce19 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.409045:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.409059:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334983.409095:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 228416 00000004:00200000:2.0:1763334983.409100:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334983.409125:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.409158:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ce12 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0664 expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.409180:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce19 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0664 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.409190:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:2.0:1763334983.409194:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334983.409198:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334983.410808:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694637824:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 1973us (3375us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.410831:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5029 00000100:00100000:1.0:1763334983.435530:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.436555:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694637952 00000100:00100000:2.0:1763334983.436952:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694637952 00002000:00100000:2.0:1763334983.437029:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (0->208895) req@ffff9a5aee546d80 x1848989694637952/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:29/0 lens 488/0 e 0 to 0 dl 1763334994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334983.437042:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee546d80 with x1848989694637952 ext(0->208895) 00002000:00010000:2.0:1763334983.437049:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee546d80 00000100:00100000:2.0:1763334983.437090:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1947 00000100:00100000:2.0:1763334983.437101:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694637952:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:3.0:1763334983.445247:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee546d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694637952:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 8128us (9715us total) trans 0 rc 86016/86016 00000100:00100000:3.0:1763334983.445268:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1947 00002000:00100000:3.0:1763334983.445288:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (0->208895) req@ffff9a5aee546d80 x1848989694637952/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:29/0 lens 488/440 e 0 to 0 dl 1763334994 ref 1 fl Complete:/600/0 rc 86016/86016 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334983.445302:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee546d80 with x1848989694637952 ext(0->208895) 00002000:00010000:3.0:1763334983.445311:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee546d80 00000100:00100000:1.0:1763334983.454485:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.456831:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694638080 00000100:00100000:2.0:1763334983.456853:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694638080 00002000:00100000:2.0:1763334983.456947:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (110592->228414) req@ffff9a5aee547100 x1848989694638080/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:29/0 lens 504/0 e 0 to 0 dl 1763334994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334983.456961:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee547100 with x1848989694638080 ext(110592->228414) 00002000:00010000:2.0:1763334983.456969:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee547100 00000100:00100000:2.0:1763334983.457017:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1948 00000100:00100000:2.0:1763334983.457027:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694638080:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:2.0:1763334983.469564:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee547100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2361:x1848989694638080:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 12522us (15079us total) trans 17179871277 rc 0/0 00000100:00100000:2.0:1763334983.469618:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1948 00002000:00100000:2.0:1763334983.469635:0:25999:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_016: refresh rw locks for [0x280000400:0x24a:0x0] (110592->228414) req@ffff9a5aee547100 x1848989694638080/t17179871277(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:29/0 lens 504/448 e 0 to 0 dl 1763334994 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334983.469647:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee547100 with x1848989694638080 ext(110592->228414) 00002000:00010000:2.0:1763334983.469656:0:25999:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee547100 00000100:00100000:1.0:1763334983.473544:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.473732:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694638208 00000100:00100000:2.0:1763334983.473747:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694638208 00000100:00100000:0.0:1763334983.474494:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5148 00000100:00100000:0.0:1763334983.474511:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694638208:12345-192.168.201.60@tcp:16:fsx.0 00010000:00010000:1.0:1763334983.525978:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1763334983.528671:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871272 is committed 00000001:00080000:1.0:1763334983.528697:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871268 is committed 00000001:00080000:1.0:1763334983.528720:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871274 is committed 00000001:00080000:1.0:1763334983.528738:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871277 is committed 00000001:00080000:1.0:1763334983.528752:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871276 is committed 00000100:00100000:2.0:1763334983.529141:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694638208:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 54625us (55599us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.529156:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5148 00000100:00100000:1.0:1763334983.541630:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.542945:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694638464 00000100:00100000:2.0:1763334983.542963:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694638464 00000100:00100000:2.0:1763334983.543046:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5030 00000100:00100000:2.0:1763334983.543056:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694638464:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334983.543131:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1763334983.543169:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce19 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0664 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.543200:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce04 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0656 expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.543215:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:2.0:1763334983.543243:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334983.543789:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ce20 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.543808:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ce20 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.543819:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ce20 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000001:00080000:2.0:1763334983.543887:0:29628:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939238 00000004:00010000:2.0:1763334983.543917:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000023744ec4 reply state 000000001ddb900e transno 8589939239 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ce20 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334983.543928:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334983.549118:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee547800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694638464:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 6040us (7482us total) trans 8589939239 rc 0/0 00000100:00100000:2.0:1763334983.549135:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5030 00000020:00080000:2.0:1763334983.549148:0:29628:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763334983.549509:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334983.550291:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ce20 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334983.550308:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ce20 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334983.550316:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ce20 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334983.550323:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334983.550330:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ce20 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334983.550339:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ce20 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334983.550360:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabe00) 00010000:00010000:3.0:1763334983.550364:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334983.550371:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ce20 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334983.550377:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ce20 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334983.550727:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694638592 00000100:00100000:2.0:1763334983.550741:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694638592 00000100:00100000:2.0:1763334983.550808:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5031 00000100:00100000:2.0:1763334983.550820:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694638592:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334983.550849:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334983.550873:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ce27 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b066b expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.550960:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ce27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b066b expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.550977:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ce27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b066b expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.550997:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334983.551000:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334983.551003:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431a00, rc 0) 00000100:00100000:2.0:1763334983.551081:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694638592:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 263us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.551088:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5031 00000100:00100000:1.0:1763334983.554054:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.554185:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694638720 00000100:00100000:2.0:1763334983.554199:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694638720 00000100:00100000:2.0:1763334983.554272:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5149 00000100:00100000:2.0:1763334983.554283:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+16:53644:x1848989694638720:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334983.554309:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334983.554336:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0672 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.554378:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cd1d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0609 expref: 17 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334983.554387:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334983.554390:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334983.554394:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce2e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0672 expref: 17 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.554452:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cd1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0609 expref: 17 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334983.554468:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cd1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0609 expref: 17 pid: 25383 timeout: 1148 lvb_type: 1 00000100:00100000:2.0:1763334983.554483:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701895040:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334983.554626:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334983.557701:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701895040:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334983.557758:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce2e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0672 expref: 17 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.557796:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334983.557887:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+17:53644:x1848989694638720:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 3605us (3849us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.557898:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5149 00000100:00100000:0.0:1763334983.558946:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.559205:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694638848 00000100:00100000:2.0:1763334983.559218:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694638848 00010000:00010000:2.0:1763334983.559273:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cd1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0609 expref: 17 pid: 25383 timeout: 1148 lvb_type: 1 00000100:00100000:2.0:1763334983.559317:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2685 00000100:00100000:2.0:1763334983.559329:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694638848:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334983.559348:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334983.559377:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cd1d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0609 expref: 17 pid: 25383 timeout: 1148 lvb_type: 1 00010000:00010000:2.0:1763334983.559392:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cd1d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0609 expref: 17 pid: 25383 timeout: 1148 lvb_type: 1 00010000:00010000:2.0:1763334983.559423:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849cd1d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0609 expref: 17 pid: 25383 timeout: 1148 lvb_type: 1 00010000:00010000:2.0:1763334983.559441:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334983.559443:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334983.559452:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0672 expref: 16 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.559469:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0672 expref: 16 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.559519:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0672 expref: 16 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334983.559535:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701895168:192.168.201.60@tcp:105: 00000100:00100000:2.0:1763334983.559670:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334983.563422:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701895168:192.168.201.60@tcp:105: 00010000:00010000:2.0:1763334983.563460:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334983.564075:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694638848:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4744us (5143us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.564089:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2685 00000100:00100000:1.0:1763334983.565607:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.566264:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694638976 00000100:00100000:2.0:1763334983.566282:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694638976 00000100:00100000:2.0:1763334983.566360:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5150 00000100:00100000:2.0:1763334983.566373:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:53644:x1848989694638976:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334983.566402:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334983.566430:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849ce35 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0679 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.566474:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cd24 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0610 expref: 21 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334983.566491:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334983.566494:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334983.566500:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849ce35 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0679 expref: 21 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.566552:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cd24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0610 expref: 21 pid: 6517 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334983.566590:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cd24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0610 expref: 21 pid: 6517 timeout: 1148 lvb_type: 1 00000100:00100000:2.0:1763334983.566611:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701895296:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334983.566732:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334983.570493:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701895296:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334983.570544:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849ce35 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0679 expref: 21 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334983.570772:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334983.570987:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430400, rc 0) 00000100:00100000:2.0:1763334983.571063:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:53644:x1848989694638976:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 4690us (5503us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.571074:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5150 00000100:00100000:0.0:1763334983.572201:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694639104 00000100:00100000:0.0:1763334983.572218:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694639104 00010000:00010000:0.0:1763334983.572280:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cd24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0610 expref: 21 pid: 6517 timeout: 1148 lvb_type: 1 00000100:00100000:0.0:1763334983.572332:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2686 00000100:00100000:0.0:1763334983.572343:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee545500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694639104:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334983.572365:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334983.572399:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cd24 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0610 expref: 21 pid: 6517 timeout: 1148 lvb_type: 1 00010000:00010000:0.0:1763334983.572415:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cd24 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0610 expref: 21 pid: 6517 timeout: 1148 lvb_type: 1 00010000:00010000:0.0:1763334983.572455:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cd24 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0610 expref: 21 pid: 6517 timeout: 1148 lvb_type: 1 00010000:00010000:0.0:1763334983.572477:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.572480:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.572487:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849ce35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0679 expref: 20 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.572500:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849ce35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0679 expref: 20 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.572551:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849ce35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0679 expref: 20 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334983.572615:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab36680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701895424:192.168.201.60@tcp:105: 00000100:00100000:0.0:1763334983.572727:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98300 going to sleep for 11 seconds 00000100:00100000:3.0:1763334983.577635:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334983.577673:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334983.577704:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334983.577750:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694639360 00000100:00100000:3.0:1763334983.577763:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694639360 00002000:00010000:3.0:1763334983.577823:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:3.0:1763334983.577829:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5b01f2df80 with x1848989694639360 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334983.577846:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5b01f2df80. 00000100:00100000:3.0:1763334983.577872:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694639232 00000100:00100000:3.0:1763334983.577875:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694639232 00002000:00010000:3.0:1763334983.577886:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (262144->18446744073709551615) 00002000:00100000:3.0:1763334983.577890:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5b01f2f100 with x1848989694639232 ext(262144->18446744073709551615) 00002000:00010000:3.0:1763334983.577896:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5b01f2f100. 00000100:00100000:3.0:1763334983.577912:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694639488 00000100:00100000:3.0:1763334983.577915:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694639488 00002000:00010000:3.0:1763334983.577927:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:3.0:1763334983.577943:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5b01f2d880 with x1848989694639488 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334983.577950:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5b01f2d880. 00000100:00100000:3.0:1763334983.577983:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1949 00000100:00100000:3.0:1763334983.577994:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694639360:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334983.578325:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334983.578331:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334983 -> 1763334984 00002000:00010000:3.0:1763334983.578334:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334983.578337:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334983 -> 1763334984 00002000:00010000:3.0:1763334983.578339:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334983.578418:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694639360:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 426us (849us total) trans 21474838520 rc 0/0 00000100:00100000:3.0:1763334983.578426:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1949 00002000:00010000:3.0:1763334983.578429:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:3.0:1763334983.578432:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5b01f2df80 with x1848989694639360 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334983.578436:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5b01f2df80. 00000100:00100000:3.0:1763334983.578455:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1950 00000100:00100000:3.0:1763334983.578462:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694639232:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334983.578682:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 85452 -> 262144 00002000:00010000:3.0:1763334983.578686:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334983 -> 1763334984 00002000:00010000:3.0:1763334983.578689:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334983 -> 1763334984 00002000:00010000:3.0:1763334983.578691:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334983 -> 1763334984 00000100:00100000:0.0:1763334983.578799:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab36680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701895424:192.168.201.60@tcp:105: 00010000:00010000:0.0:1763334983.578827:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334983.578890:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee545500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694639104:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 6547us (8117us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334983.578907:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2686 00000100:00100000:1.0:1763334983.578915:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1951 00000100:00100000:1.0:1763334983.578940:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694639488:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334983.579072:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334983.579076:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334983 -> 1763334984 00002000:00010000:1.0:1763334983.579078:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334983.579081:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334983 -> 1763334984 00002000:00010000:1.0:1763334983.579083:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334983.579116:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694639488:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 191us (1411us total) trans 17179871279 rc 0/0 00000100:00100000:1.0:1763334983.579124:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1951 00002000:00010000:1.0:1763334983.579128:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763334983.579130:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5b01f2d880 with x1848989694639488 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334983.579135:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5b01f2d880. 00002000:00010000:3.0:1763334983.581751:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 3 -> 161 00000100:00100000:2.0:1763334983.582673:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694639232:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 4098us (4886us total) trans 17179871278 rc 0/0 00000100:00100000:2.0:1763334983.582695:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1950 00002000:00010000:2.0:1763334983.582708:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (262144->18446744073709551615) 00002000:00100000:2.0:1763334983.582713:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5b01f2f100 with x1848989694639232 ext(262144->18446744073709551615) 00002000:00010000:2.0:1763334983.582730:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5b01f2f100. 00000100:00100000:3.0:1763334983.593195:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.593402:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694639616 00000100:00100000:2.0:1763334983.593418:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694639616 00002000:00100000:2.0:1763334983.593490:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (229376->262143) req@ffff9a5b01f2ce00 x1848989694639616/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:29/0 lens 488/0 e 0 to 0 dl 1763334994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334983.593502:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5b01f2ce00 with x1848989694639616 ext(229376->262143) 00002000:00010000:2.0:1763334983.593511:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5b01f2ce00 00000100:00100000:2.0:1763334983.593556:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1952 00000100:00100000:2.0:1763334983.593568:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694639616:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:2.0:1763334983.599259:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694639616:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 5683us (6073us total) trans 0 rc 32768/32768 00000100:00100000:2.0:1763334983.599275:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1952 00002000:00100000:2.0:1763334983.599292:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (229376->262143) req@ffff9a5b01f2ce00 x1848989694639616/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:29/0 lens 488/440 e 0 to 0 dl 1763334994 ref 1 fl Complete:/600/0 rc 32768/32768 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334983.599303:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5b01f2ce00 with x1848989694639616 ext(229376->262143) 00002000:00010000:2.0:1763334983.599309:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5b01f2ce00 00000100:00100000:1.0:1763334983.610985:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.611101:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694639744 00000100:00100000:2.0:1763334983.611117:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694639744 00002000:00100000:2.0:1763334983.611177:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (245760->262143) req@ffff9a5aee547b80 x1848989694639744/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:29/0 lens 16872/0 e 0 to 0 dl 1763334994 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334983.611189:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee547b80 with x1848989694639744 ext(245760->262143) 00002000:00010000:2.0:1763334983.611195:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee547b80 00000100:00100000:2.0:1763334983.611737:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1953 00000100:00100000:2.0:1763334983.611751:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694639744:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:2.0:1763334983.612218:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee547b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694639744:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 469us (1248us total) trans 17179871280 rc 0/0 00000100:00100000:2.0:1763334983.612226:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1953 00002000:00100000:2.0:1763334983.612235:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (245760->262143) req@ffff9a5aee547b80 x1848989694639744/t17179871280(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:29/0 lens 16872/448 e 0 to 0 dl 1763334994 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334983.612244:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee547b80 with x1848989694639744 ext(245760->262143) 00002000:00010000:2.0:1763334983.612248:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee547b80 00000100:00100000:3.0:1763334983.621877:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.621986:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694639872 00000100:00100000:2.0:1763334983.621998:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694639872 00000100:00100000:2.0:1763334983.622064:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5151 00000100:00100000:2.0:1763334983.622075:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694639872:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:3.0:1763334983.678217:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871279 is committed 00000001:00080000:3.0:1763334983.678255:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871280 is committed 00000100:00100000:1.0:1763334983.678640:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2361:x1848989694639872:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 56556us (56764us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334983.678655:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5151 00000100:00100000:1.0:1763334983.681563:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.681820:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694640000 00000100:00100000:0.0:1763334983.681835:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694640000 00000100:00100000:0.0:1763334983.681912:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5032 00000100:00100000:0.0:1763334983.681924:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694640000:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334983.681960:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334983.681990:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849ce3c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0680 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.682111:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849ce43 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.682129:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849ce43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.682145:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849ce43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334983.682180:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 262144 00000004:00200000:0.0:1763334983.682185:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334983.682209:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849ce43 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.682241:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849ce3c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0680 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.682262:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849ce43 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0680 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.682271:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:0.0:1763334983.682275:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334983.682279:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334983.682354:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee546a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694640000:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 432us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334983.682363:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5032 00000100:00100000:0.0:1763334983.700016:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.700159:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694640256 00000100:00100000:2.0:1763334983.700174:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694640256 00000100:00100000:2.0:1763334983.700252:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1829 00000100:00100000:2.0:1763334983.700264:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694640256:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:2.0:1763334983.700852:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53644:x1848989694640256:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 587us (850us total) trans 8589939240 rc 0/0 00000100:00100000:2.0:1763334983.700862:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1829 00000100:00100000:3.0:1763334983.729206:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.733054:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694640512 00000100:00100000:0.0:1763334983.733078:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694640512 00000100:00100000:0.0:1763334983.733201:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5033 00000100:00100000:0.0:1763334983.733215:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53665:x1848989694640512:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334983.733251:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334983.733280:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849ce4a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0687 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.733385:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce51 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733403:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce51 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733418:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce51 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733434:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ce58 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733442:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ce58 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733450:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ce58 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733688:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ce5f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733698:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ce5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733705:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ce5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334983.733717:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 262144 00010000:00010000:0.0:1763334983.733843:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce51 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733851:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce51 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733857:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce51 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733864:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334983.733869:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce51 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733877:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce51 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733890:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:0.0:1763334983.733894:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334983.733900:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce51 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733907:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849ce51 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733924:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ce58 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733942:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ce58 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733947:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ce58 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733958:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334983.733961:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ce58 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733968:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ce58 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733975:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac7d60000) 00010000:00010000:0.0:1763334983.733977:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334983.733980:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ce58 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.733985:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849ce58 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334983.734039:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849ce4a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0687 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.734053:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ce5f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0687 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.734061:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:0.0:1763334983.734063:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334983.734066:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334983.734152:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53665:x1848989694640512:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 940us (4963us total) trans 8589939241 rc 0/0 00000100:00100000:0.0:1763334983.734163:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5033 00000100:00100000:1.0:1763334983.742874:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334983.742961:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.742962:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694640768 00000100:00100000:2.0:1763334983.742978:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694640768 00000100:00100000:2.0:1763334983.743071:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5034 00000100:00100000:2.0:1763334983.743084:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53665:x1848989694640768:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334983.743127:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334983.743157:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ce6d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b068e expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.743998:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849ce74 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.744020:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849ce74 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.744035:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849ce74 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334983.744048:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b3:0x0]: returning size 0 00010000:00010000:2.0:1763334983.744128:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849ce6d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b068e expref: 197 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.744153:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849ce74 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b068e expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.744163:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b3:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334983.744167:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334983.744171:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430200, rc 0) 00000100:00100000:2.0:1763334983.744266:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee545880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53665:x1848989694640768:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1184us (1407us total) trans 8589939242 rc 0/0 00000100:00100000:2.0:1763334983.744276:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5034 00000100:00100000:0.0:1763334983.744392:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694640896 00000100:00100000:0.0:1763334983.744401:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694640896 00000100:00100000:0.0:1763334983.744463:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 415 00000100:00100000:0.0:1763334983.744474:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee544700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2361:x1848989694640896:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334983.744488:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334983.744509:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849ce5f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0687 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.744523:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:0.0:1763334983.744528:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334983.744616:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee544700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2361:x1848989694640896:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 99us (1609us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334983.744625:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 415 00000100:00100000:1.0:1763334983.753017:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.753718:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694641152 00000100:00100000:2.0:1763334983.753734:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694641152 00000100:00100000:2.0:1763334983.753818:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5035 00000100:00100000:2.0:1763334983.753831:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53665:x1848989694641152:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334983.753865:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334983.753897:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849ce82 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0695 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.754090:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.754110:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849ce74 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b068e expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.754124:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.754173:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849ce74 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b068e expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.754189:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849ce74 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b068e expref: 196 pid: 29628 timeout: 1148 lvb_type: 0 00000100:00100000:2.0:1763334983.754206:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701895552:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334983.754348:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68840 going to sleep for 11 seconds 00000100:00100000:2.0:1763334983.763559:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334983.763787:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab32a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701895552:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334983.763824:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334983.765653:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694641280 00000100:00100000:1.0:1763334983.765672:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694641280 00010000:00010000:1.0:1763334983.765733:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849ce74 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b068e expref: 197 pid: 29628 timeout: 1148 lvb_type: 0 00000100:00100000:1.0:1763334983.765795:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2687 00000100:00100000:1.0:1763334983.765805:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694641280:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334983.765825:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334983.765831:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849ce74 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b068e expref: 197 pid: 29628 timeout: 1148 lvb_type: 0 00010000:00010000:1.0:1763334983.765844:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849ce74 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b068e expref: 197 pid: 29628 timeout: 1148 lvb_type: 0 00010000:00010000:1.0:1763334983.765869:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849ce74 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b068e expref: 197 pid: 29628 timeout: 1148 lvb_type: 0 00010000:00010000:1.0:1763334983.765888:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b3:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:1.0:1763334983.765893:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334983.765903:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334983.765910:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334983.765952:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334983.766032:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab33480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2359:x1848989694641280:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 226us (2487us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334983.766039:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2687 00010000:00010000:3.0:1763334983.766344:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334983.766354:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:3.0:1763334983.766376:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b3:0x0]: returning size 0 00000004:00080000:2.0:1763334983.767495:0:29628:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24c:0x0], index 0: 0 00000004:00080000:2.0:1763334983.767515:0:29628:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x250:0x0], index 1: 0 00010000:00010000:2.0:1763334983.767784:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.767797:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.767806:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.767818:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431c00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334983.767823:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.767833:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.767852:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b3:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334983.767855:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334983.767860:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.767866:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce89 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.767966:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849ce82 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0695 expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.767978:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334983.767981:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1763334983.767985:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849ce82 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0695 expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.767995:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430e00, rc 0) 00000100:00100000:2.0:1763334983.768075:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee547480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53665:x1848989694641152:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 14245us (15070us total) trans 8589939243 rc 301/301 00000100:00100000:2.0:1763334983.768084:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5035 00000100:00100000:2.0:1763334983.772735:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334983.772882:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694641536 00000100:00100000:3.0:1763334983.772898:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694641536 00000100:00100000:2.0:1763334983.773819:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1830 00000100:00100000:2.0:1763334983.773839:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53665:x1848989694641536:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334983.774393:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53665:x1848989694641536:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 559us (1673us total) trans 8589939244 rc 0/0 00000100:00100000:2.0:1763334983.774403:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1830 00000100:00100000:1.0:1763334983.780737:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.781033:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694641664 00000100:00100000:2.0:1763334983.781048:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694641664 00000100:00100000:2.0:1763334983.781515:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5036 00000100:00100000:2.0:1763334983.781529:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53665:x1848989694641664:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334983.781627:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334983.781658:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849ce97 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b069c expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.781753:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce9e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.781770:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce9e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.781783:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce9e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334983.781831:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b3:0x0]: returning size 0 00000004:00200000:2.0:1763334983.781837:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334983.781858:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce9e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.781891:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849ce97 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b069c expref: 198 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.781914:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce9e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b069c expref: 197 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.781925:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b3:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334983.781941:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763334983.781945:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431c00, rc 0) 00000100:00100000:2.0:1763334983.782037:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee544a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53665:x1848989694641664:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 511us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.782046:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5036 00000100:00100000:1.0:1763334983.788656:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334983.788708:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.788814:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694641792 00000100:00100000:2.0:1763334983.788828:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694641792 00000100:00100000:2.0:1763334983.788895:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694641920 00000100:00100000:2.0:1763334983.788899:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694641920 00000100:00100000:3.0:1763334983.789028:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5152 00000100:00100000:3.0:1763334983.789044:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694641792:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334983.789066:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334983.789095:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cea5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06a3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334983.789128:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00000100:00100000:0.0:1763334983.789128:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5153 00000100:00100000:0.0:1763334983.789144:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694641920:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334983.789155:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.789155:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334983.789159:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334983.789170:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06a3 expref: 18 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334983.789172:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ceac lrc: 2/0,0 mode: --/PR res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06aa expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.789198:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06a3 expref: 18 pid: 6519 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1763334983.789201:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x250:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334983.789219:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00010000:00010000:0.0:1763334983.789220:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.789224:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.789231:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ceac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06aa expref: 21 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334983.789245:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ceac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06aa expref: 21 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334983.789255:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:3.0:1763334983.789297:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694641792:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 251us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334983.789304:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5152 00000100:00100000:0.0:1763334983.790118:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694641920:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 969us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334983.790131:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5153 00000100:00100000:3.0:1763334983.793942:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.794608:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694642176 00000100:00100000:2.0:1763334983.794625:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694642176 00000100:00100000:2.0:1763334983.794720:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5037 00000100:00100000:2.0:1763334983.794733:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53665:x1848989694642176:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334983.794760:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334983.794786:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849ceb3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06b1 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.794907:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ceba lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.794924:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ceba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334983.794948:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ceba lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334983.794964:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 262144 00010000:00010000:2.0:1763334983.795135:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849ceb3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06b1 expref: 200 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.795154:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ceba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06b1 expref: 199 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.795163:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334983.795166:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334983.795171:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431000, rc 0) 00000100:00100000:2.0:1763334983.795265:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53665:x1848989694642176:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 533us (1348us total) trans 8589939245 rc 0/0 00000100:00100000:2.0:1763334983.795273:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5037 00000100:00100000:0.0:1763334983.803401:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.803458:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.803848:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334983.810796:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694642432 00000100:00100000:1.0:1763334983.810819:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694642432 00000100:00100000:1.0:1763334983.810848:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694642560 00000100:00100000:1.0:1763334983.810851:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694642560 00000100:00100000:1.0:1763334983.810944:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5154 00000100:00100000:1.0:1763334983.810958:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694642560:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334983.811024:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.811050:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849ce35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0679 expref: 21 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.811062:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334983.811065:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334983.811069:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.811147:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849ce35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0679 expref: 21 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.811164:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849ce35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0679 expref: 21 pid: 25383 timeout: 1148 lvb_type: 0 00000100:00100000:1.0:1763334983.811181:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae0bbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701895680:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334983.811292:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad82cc780 going to sleep for 11 seconds 00000100:00100000:1.0:1763334983.811498:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5155 00000100:00100000:1.0:1763334983.811507:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694642432:12345-192.168.201.60@tcp:1:lfs.0 00000100:00100000:2.0:1763334983.811631:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694642304 00000100:00100000:2.0:1763334983.811638:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694642304 00000100:00100000:2.0:1763334983.811667:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5156 00000100:00100000:2.0:1763334983.811674:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694642304:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334983.811697:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.811709:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ce0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->229375) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b065d expref: 22 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.811716:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334983.811718:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334983.811720:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.811742:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ce0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->229375) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b065d expref: 22 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.811756:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ce0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->229375) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b065d expref: 22 pid: 6519 timeout: 1148 lvb_type: 0 00000100:00100000:2.0:1763334983.811766:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701895808:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334983.811819:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68000 going to sleep for 11 seconds 00010000:00010000:1.0:1763334983.812040:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.812054:0:32239:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0672 expref: 18 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.812061:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334983.812063:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334983.812065:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.812088:0:32239:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0672 expref: 18 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.812097:0:32239:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0672 expref: 18 pid: 25383 timeout: 1148 lvb_type: 0 00000100:00100000:1.0:1763334983.812109:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae0bbfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701895936:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334983.812706:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad82cc840 going to sleep for 11 seconds 00000100:00100000:2.0:1763334983.820461:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae0bbd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701895680:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334983.820511:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334983.820524:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.821713:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694642688 00000100:00100000:0.0:1763334983.821731:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694642688 00010000:00010000:0.0:1763334983.821790:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849ce35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0679 expref: 23 pid: 25383 timeout: 1148 lvb_type: 0 00000100:00100000:0.0:1763334983.821845:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2688 00000100:00100000:0.0:1763334983.821854:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694642688:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334983.821875:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334983.821904:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849ce35 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0679 expref: 23 pid: 25383 timeout: 1148 lvb_type: 0 00010000:00010000:0.0:1763334983.821918:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849ce35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0679 expref: 23 pid: 25383 timeout: 1148 lvb_type: 0 00010000:00010000:0.0:1763334983.821961:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849ce35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0679 expref: 23 pid: 25383 timeout: 1148 lvb_type: 0 00010000:00010000:0.0:1763334983.821981:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.821984:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.821989:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.822007:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.822046:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334983.822124:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694642688:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 270us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334983.822132:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2688 00010000:00010000:2.0:1763334983.822620:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.822634:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.822674:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.822684:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.822693:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.822702:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334983.822708:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.822717:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.822734:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334983.822742:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479c00/0xcedf0054f849cec8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334983.822816:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694642560:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 11860us (18967us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334983.822827:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5154 00000100:00100000:3.0:1763334983.823377:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701895808:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334983.823410:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334983.826026:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334983.826073:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334983.826116:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694642816 00000100:00100000:3.0:1763334983.826128:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694642816 00000100:00100000:0.0:1763334983.826234:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae0bbfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701895936:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334983.826257:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0672 expref: 19 pid: 25383 timeout: 1148 lvb_type: 0 00010000:00010000:0.0:1763334983.826267:0:32239:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334983.826306:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694642944 00000100:00100000:3.0:1763334983.826312:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694642944 00010000:00010000:3.0:1763334983.826332:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ce0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b065d expref: 21 pid: 6519 timeout: 1148 lvb_type: 0 00000100:00100000:3.0:1763334983.826359:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2689 00000100:00100000:3.0:1763334983.826371:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694642816:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334983.826391:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334983.826421:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0672 expref: 19 pid: 25383 timeout: 1148 lvb_type: 0 00010000:00010000:3.0:1763334983.826434:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0672 expref: 19 pid: 25383 timeout: 1148 lvb_type: 0 00010000:00010000:3.0:1763334983.826465:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849ce2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0672 expref: 19 pid: 25383 timeout: 1148 lvb_type: 0 00010000:00010000:3.0:1763334983.826484:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334983.826486:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334983.826492:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.826504:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.826540:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334983.826638:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694642816:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 268us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334983.826647:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2689 00000100:00100000:3.0:1763334983.826669:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2690 00000100:00100000:3.0:1763334983.826676:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694642944:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334983.826685:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1763334983.826698:0:5735:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 161 -> 193 00010000:00010000:3.0:1763334983.826703:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ce0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->229375) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b065d expref: 21 pid: 6519 timeout: 1148 lvb_type: 0 00010000:00010000:3.0:1763334983.826716:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ce0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->229375) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b065d expref: 21 pid: 6519 timeout: 1148 lvb_type: 0 00010000:00010000:3.0:1763334983.826734:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849ce0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->229375) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b065d expref: 21 pid: 6519 timeout: 1148 lvb_type: 0 00010000:00010000:0.0:1763334983.826746:0:32239:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.826748:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334983.826752:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334983.826758:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.826767:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.826775:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.826807:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334983.826818:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.826830:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334983.826832:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694642944:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 155us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334983.826858:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2690 00010000:00010000:0.0:1763334983.826860:0:32239:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.826877:0:32239:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334983.826882:0:32239:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.826891:0:32239:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.826910:0:32239:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.826918:0:32239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478000/0xcedf0054f849ced6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334983.827016:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694642432:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 15508us (23556us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334983.827026:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5155 00010000:00010000:3.0:1763334983.827082:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.827095:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.827120:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.827129:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.827151:0:25383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.827164:0:25383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334983.827169:0:25383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.827178:0:25383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.827192:0:25383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334983.827199:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849cecf lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334983.827261:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694642304:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 15585us (23874us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334983.827269:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5156 00000100:00100000:0.0:1763334983.836558:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.836643:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334983.836922:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334983.837300:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694643072 00000100:00100000:1.0:1763334983.837317:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694643072 00000100:00100000:1.0:1763334983.837809:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694643328 00000100:00100000:1.0:1763334983.837816:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694643328 00000100:00100000:1.0:1763334983.837842:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694643200 00000100:00100000:1.0:1763334983.837845:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694643200 00000100:00100000:1.0:1763334983.837868:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5157 00000100:00100000:1.0:1763334983.837879:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694643072:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334983.837903:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1763334983.837918:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5158 00010000:00010000:1.0:1763334983.837939:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cedd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06b8 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334983.837955:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694643328:12345-192.168.201.60@tcp:101:lfs.0 00002000:00010000:1.0:1763334983.837969:0:32239:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 262144, mtime: 0x691a5b48, atime: 0x691a5b48, ctime: 0x691a5b48, blocks: 0xc1 00010000:00010000:3.0:1763334983.837979:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334983.837996:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334983.838000:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334983.838005:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cee4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06c6 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.838016:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cedd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06b8 expref: 21 pid: 32239 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1763334983.838039:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x691a5b48, atime: 0x691a5b47, ctime: 0x691a5b48, blocks: 0x3 00010000:00010000:3.0:1763334983.838074:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334983.838074:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cedd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06b8 expref: 22 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334983.838083:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334983.838103:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cee4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06c6 expref: 22 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334983.838103:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00010000:00010000:3.0:1763334983.838130:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cee4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06c6 expref: 22 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334983.838143:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:1.0:1763334983.838184:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694643072:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 302us (1634us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334983.838197:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5157 00000100:00100000:3.0:1763334983.838203:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2362:x1848989694643328:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 256us (1554us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334983.838218:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5158 00000100:00100000:3.0:1763334983.838249:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5159 00000100:00100000:3.0:1763334983.838376:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2362:x1848989694643200:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334983.838388:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334983.838403:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ceeb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06bf expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334983.838422:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x248:0x0] initial LVB size: 0, mtime: 0x691a5b48, atime: 0x691a5b47, ctime: 0x691a5b48, blocks: 0x3 00010000:00010000:3.0:1763334983.838434:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334983.838437:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334983.838445:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ceeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06bf expref: 18 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334983.838459:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ceeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06bf expref: 18 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334983.838468:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:3.0:1763334983.838493:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2362:x1848989694643200:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 123us (1571us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334983.838501:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5159 00000100:00100000:0.0:1763334983.874418:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334983.875135:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694643456 00000100:00100000:2.0:1763334983.875158:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694643456 00000100:00100000:1.0:1763334983.875349:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1954 00000100:00100000:1.0:1763334983.875367:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694643456:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:1.0:1763334983.875431:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cef2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.875449:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334983.875452:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334983.875458:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cef2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.875475:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cef2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.885391:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cef2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.885419:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cef2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.885429:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cef2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.885437:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334983.885444:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cef2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.885455:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cef2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.885486:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cef2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.885497:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849cef2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334983.886387:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694643456:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 11014us (11973us total) trans 0 rc 262144/262144 00000100:00100000:1.0:1763334983.886401:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1954 00000100:00100000:3.0:1763334983.894237:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334983.895365:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694643584 00000100:00100000:1.0:1763334983.895383:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694643584 00000100:00100000:0.0:1763334983.896173:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1955 00000100:00100000:0.0:1763334983.896185:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2362:x1848989694643584:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:0.0:1763334983.896235:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.896264:0:14384:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cea5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06a3 expref: 18 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334983.896274:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.896276:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334983.896281:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.896329:0:14384:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cea5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06a3 expref: 18 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334983.896344:0:14384:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06a3 expref: 18 pid: 6519 timeout: 1148 lvb_type: 1 00000100:00100000:0.0:1763334983.896362:0:14384:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee546300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14384:1848989701896064:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334983.896844:0:14384:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98000 going to sleep for 11 seconds 00000100:00100000:2.0:1763334983.899705:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334983.899811:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694643712 00000100:00100000:1.0:1763334983.899825:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694643712 00010000:00010000:1.0:1763334983.899882:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cea5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06a3 expref: 19 pid: 6519 timeout: 1148 lvb_type: 1 00000100:00100000:1.0:1763334983.899942:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2691 00000100:00100000:1.0:1763334983.899954:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694643712:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334983.899976:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334983.900012:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cea5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06a3 expref: 19 pid: 6519 timeout: 1148 lvb_type: 1 00010000:00010000:1.0:1763334983.900029:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cea5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06a3 expref: 19 pid: 6519 timeout: 1148 lvb_type: 1 00010000:00010000:1.0:1763334983.900067:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334983.900070:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334983.900076:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.900088:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334983.900116:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334983.900198:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694643712:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 241us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334983.900206:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2691 00010000:00010000:0.0:1763334983.900268:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849cea5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06a3 expref: 18 pid: 6519 timeout: 1148 lvb_type: 1 00000100:00100000:0.0:1763334983.900287:0:14384:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee546300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:14384:1848989701896064:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334983.900313:0:14384:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.900324:0:14384:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.900337:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763334983.966281:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838521 is committed 00000001:00080000:1.0:1763334983.966304:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838515 is committed 00000001:00080000:1.0:1763334983.966327:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838517 is committed 00000001:00080000:1.0:1763334983.966359:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838519 is committed 00002000:00010000:0.0:1763334983.966503:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb size from disk: 0 -> 262144 00002000:00010000:0.0:1763334983.966508:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb mtime from disk: 0 -> 1763334984 00002000:00010000:0.0:1763334983.966511:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb ctime from disk: 0 -> 1763334984 00002000:00010000:0.0:1763334983.966514:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb blocks from disk: 1 -> 515 00010000:00010000:0.0:1763334983.966531:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.966545:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.966555:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.966562:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334983.966567:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.966595:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.966619:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334983.966626:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cef9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334983.967118:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2362:x1848989694643584:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 70927us (72889us total) trans 21474838521 rc 0/0 00000100:00100000:0.0:1763334983.967129:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1955 00000100:00100000:2.0:1763334983.971453:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334983.971757:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694643840 00000100:00100000:1.0:1763334983.971771:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694643840 00000100:00100000:0.0:1763334983.972152:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5038 00000100:00100000:0.0:1763334983.972167:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad809c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53665:x1848989694643840:12345-192.168.201.60@tcp:44:lfs.0 00000001:00080000:1.0:1763334984.020849:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939241 is committed 00000001:00080000:1.0:1763334984.020892:0:32484:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939245 is committed 00000100:00100000:3.0:1763334984.021159:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad809c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53665:x1848989694643840:12345-192.168.201.60@tcp:44:lfs.0 Request processed in 48988us (49709us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334984.021172:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5038 00000100:00100000:3.0:1763334984.027184:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.027319:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694643968 00000100:00100000:0.0:1763334984.027333:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694643968 00000100:00100000:0.0:1763334984.027409:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5160 00000100:00100000:0.0:1763334984.027421:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694643968:12345-192.168.201.60@tcp:16:lfs.0 00000100:00100000:0.0:1763334984.027621:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694643968:12345-192.168.201.60@tcp:16:lfs.0 Request processed in 201us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334984.027630:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5160 00000100:00100000:1.0:1763334984.031460:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.032456:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694644096 00000100:00100000:2.0:1763334984.032476:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694644096 00000100:00100000:3.0:1763334984.033086:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5161 00000100:00100000:3.0:1763334984.033099:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694644096:12345-192.168.201.60@tcp:16:lfs.0 00000100:00100000:3.0:1763334984.034078:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb346050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694644096:12345-192.168.201.60@tcp:16:lfs.0 Request processed in 973us (2623us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334984.034091:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5161 00000100:00100000:3.0:1763334984.055898:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.056000:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.056043:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.056172:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694644352 00000100:00100000:0.0:1763334984.056187:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694644352 00000100:00100000:0.0:1763334984.056260:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694644224 00000100:00100000:0.0:1763334984.056263:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694644224 00000100:00100000:0.0:1763334984.056282:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694644480 00000100:00100000:0.0:1763334984.056285:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694644480 00000100:00100000:0.0:1763334984.056309:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5162 00000100:00100000:0.0:1763334984.056320:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2361:x1848989694644352:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:0.0:1763334984.056381:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf00 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056400:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334984.056402:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334984.056410:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf00 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056426:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf00 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056467:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf00 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056476:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf00 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056486:0:25383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056494:0:25383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334984.056499:0:25383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf00 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056508:0:25383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf00 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056525:0:25383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf00 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056533:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf00 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334984.056662:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2361:x1848989694644352:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 342us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334984.056671:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5162 00000100:00100000:0.0:1763334984.056692:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5163 00000100:00100000:0.0:1763334984.056699:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694644224:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:0.0:1763334984.056718:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cf07 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056727:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334984.056729:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334984.056732:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cf07 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056742:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cf07 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056821:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cf07 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056845:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cf07 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334984.056848:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5164 00010000:00010000:0.0:1763334984.056862:0:25383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cf07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334984.056866:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694644480:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:0.0:1763334984.056886:0:25383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334984.056891:0:25383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cf07 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.056906:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf0e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056907:0:25383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cf07 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.056943:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334984.056947:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334984.056951:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf0e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056952:0:25383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cf07 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.056984:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf0e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.056985:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849cf07 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.057031:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf0e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.057043:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf0e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.057051:0:32239:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.057058:0:32239:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5aec6d4a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334984.057061:0:32239:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf0e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.057069:0:32239:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf0e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.057080:0:32239:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf0e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.057088:0:32239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf0e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334984.057114:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694644224:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 409us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334984.057127:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5163 00000100:00100000:3.0:1763334984.057139:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2361:x1848989694644480:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 276us (1092us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334984.057148:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5164 00000100:00100000:2.0:1763334984.064016:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.064888:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694644736 00000100:00100000:3.0:1763334984.064903:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694644736 00000100:00100000:3.0:1763334984.064994:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5039 00000100:00100000:3.0:1763334984.065006:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53665:x1848989694644736:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:3.0:1763334984.065081:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334984.065116:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849ce9e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1b3:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b069c expref: 191 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.065145:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b3:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:3.0:1763334984.065167:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334984.065218:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849cf15 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334984.065234:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849cf15 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334984.065244:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849cf15 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:3.0:1763334984.065486:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fb41b392 reply state 000000007019adc4 transno 8589939246 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849cf15 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334984.065497:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334984.065648:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53665:x1848989694644736:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 643us (1644us total) trans 8589939246 rc 0/0 00000100:00100000:3.0:1763334984.065655:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5039 00010000:00010000:0.0:1763334984.069297:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849cf15 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.069328:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849cf15 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.069338:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849cf15 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.069345:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5aec6d5200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334984.069352:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849cf15 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.069362:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849cf15 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.069385:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b3:0x0].0x0 (ffff9a5af66de700) 00010000:00010000:0.0:1763334984.069390:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334984.069397:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849cf15 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.069403:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849cf15 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334984.071062:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.071278:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694644864 00000100:00100000:3.0:1763334984.071294:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694644864 00000100:00100000:3.0:1763334984.071396:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5040 00000100:00100000:3.0:1763334984.071407:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53665:x1848989694644864:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334984.071438:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334984.071466:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf1c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06cd expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.071539:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf1c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06cd expref: 192 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.071554:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf1c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06cd expref: 192 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.071586:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b3:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:3.0:1763334984.071590:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334984.071593:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5aec6d4a00, rc 0) 00000100:00100000:3.0:1763334984.071661:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53665:x1848989694644864:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 256us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334984.071668:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5040 00000100:00100000:0.0:1763334984.074613:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334984.074699:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694644992 00000100:00100000:1.0:1763334984.074713:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694644992 00000100:00100000:1.0:1763334984.075304:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5165 00000100:00100000:1.0:1763334984.075320:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+13:2360:x1848989694644992:12345-192.168.201.60@tcp:2:lfs.0 00000100:00100000:1.0:1763334984.075794:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee546300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694644992:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 478us (1231us total) trans 21474838522 rc 0/0 00000100:00100000:1.0:1763334984.075803:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5165 00000100:00100000:3.0:1763334984.076285:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.076422:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694645120 00000100:00100000:0.0:1763334984.076432:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694645120 00000100:00100000:0.0:1763334984.076482:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5166 00000100:00100000:0.0:1763334984.076492:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694645120:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334984.076757:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334984.076761:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb mtime from disk: 0 -> 1763334984 00002000:00010000:0.0:1763334984.076764:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb atime from disk: 0 -> 1763334984 00002000:00010000:0.0:1763334984.076766:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb ctime from disk: 0 -> 1763334984 00002000:00010000:0.0:1763334984.076768:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334984.076808:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694645120:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 318us (525us total) trans 17179871281 rc 0/0 00000100:00100000:0.0:1763334984.076814:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5166 00000100:00100000:3.0:1763334984.079304:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.079400:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694645376 00000100:00100000:2.0:1763334984.079411:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694645376 00000100:00100000:2.0:1763334984.079504:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5041 00000100:00100000:2.0:1763334984.079516:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53665:x1848989694645376:12345-192.168.201.60@tcp:55:lfs.0 00010000:00010000:2.0:1763334984.079814:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cf23 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.079836:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cf23 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.079850:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cf23 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.079882:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cf23 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.079889:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cf23 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.079897:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cf23 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.079903:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334984.079908:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cf23 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.079916:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cf23 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.079939:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b3:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:2.0:1763334984.079943:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1763334984.079948:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cf23 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.079955:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849cf23 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334984.080047:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53665:x1848989694645376:12345-192.168.201.60@tcp:55:lfs.0 Request processed in 533us (754us total) trans 0 rc -22/-22 00000100:00100000:2.0:1763334984.080055:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5041 00000100:00100000:3.0:1763334984.082495:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.082623:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694645632 00000100:00100000:2.0:1763334984.082635:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694645632 00000100:00100000:2.0:1763334984.082689:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5042 00000100:00100000:2.0:1763334984.082699:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53665:x1848989694645632:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334984.082764:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334984.082797:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849ce43 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0680 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.082819:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334984.082824:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334984.082876:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cf2a lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.082893:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cf2a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.082904:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cf2a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00010000:2.0:1763334984.083112:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cbdad64a reply state 00000000e0f1e735 transno 8589939247 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cf2a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334984.083121:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334984.083223:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53665:x1848989694645632:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 525us (742us total) trans 8589939247 rc 0/0 00000100:00100000:2.0:1763334984.083231:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5042 00000100:00100000:3.0:1763334984.088241:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.088280:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.088307:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334984.088632:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cf2a lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.088648:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cf2a lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.088656:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cf2a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.088673:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334984.088679:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cf2a lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.088689:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cf2a lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.088710:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:0.0:1763334984.088714:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334984.088719:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cf2a lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.088726:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849cf2a lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334984.088854:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694645760 00000100:00100000:1.0:1763334984.088867:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694645760 00000100:00100000:1.0:1763334984.088935:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694645888 00000100:00100000:1.0:1763334984.088939:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694645888 00000100:00100000:1.0:1763334984.088969:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694646016 00000100:00100000:1.0:1763334984.088972:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694646016 00000100:00100000:1.0:1763334984.088998:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5167 00000100:00100000:1.0:1763334984.089009:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694645760:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:1.0:1763334984.089256:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1763334984.089261:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.089263:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.089265:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.089267:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 193 -> 193 00000100:00100000:1.0:1763334984.089344:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694645760:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 335us (1118us total) trans 17179871282 rc 0/0 00000100:00100000:1.0:1763334984.089354:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5167 00000100:00100000:1.0:1763334984.089374:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5168 00000100:00100000:1.0:1763334984.089381:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694645888:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:1.0:1763334984.089504:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334984.089507:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.089510:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334983 -> 1763334984 00002000:00010000:1.0:1763334984.089512:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.089514:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334984.089538:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694645888:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 157us (1257us total) trans 21474838523 rc 0/0 00000100:00100000:1.0:1763334984.089545:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5168 00000100:00100000:1.0:1763334984.089558:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5169 00000100:00100000:1.0:1763334984.089565:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694646016:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:1.0:1763334984.095436:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334984.095450:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.095454:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334983 -> 1763334984 00002000:00010000:1.0:1763334984.095458:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.095461:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334984.095586:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694646016:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 5997us (7254us total) trans 17179871283 rc 0/0 00000100:00100000:1.0:1763334984.095603:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5169 00000100:00100000:3.0:1763334984.098055:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.098319:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694646272 00000100:00100000:2.0:1763334984.098332:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694646272 00000100:00100000:0.0:1763334984.098996:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1831 00000100:00100000:0.0:1763334984.099014:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8218050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53665:x1848989694646272:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:0.0:1763334984.099116:0:29630:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1ab:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ceba lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06b1 expref: 192 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.099166:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334984.099180:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ce27 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b066b expref: 192 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.099188:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334984.099246:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ce27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b066b expref: 192 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.099264:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ce27 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b066b expref: 192 pid: 29628 timeout: 1148 lvb_type: 0 00000100:00100000:0.0:1763334984.099287:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee545500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701896192:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334984.099405:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b600 going to sleep for 11 seconds 00000100:00100000:2.0:1763334984.116965:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.117083:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee545500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701896192:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334984.117120:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:3.0:1763334984.118509:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694646400 00000100:00100000:3.0:1763334984.118527:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694646400 00010000:00010000:3.0:1763334984.118626:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ce27 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b066b expref: 193 pid: 29628 timeout: 1148 lvb_type: 0 00000100:00100000:3.0:1763334984.118671:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2692 00000100:00100000:3.0:1763334984.118682:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2359:x1848989694646400:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334984.118704:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334984.118712:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ce27 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b066b expref: 193 pid: 29628 timeout: 1148 lvb_type: 0 00010000:00010000:3.0:1763334984.118726:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ce27 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b066b expref: 193 pid: 29628 timeout: 1148 lvb_type: 0 00010000:00010000:3.0:1763334984.118755:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849ce27 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b066b expref: 193 pid: 29628 timeout: 1148 lvb_type: 0 00010000:00010000:3.0:1763334984.118774:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:3.0:1763334984.118781:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334984.118793:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334984.118801:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334984.118848:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334984.118934:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2359:x1848989694646400:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 254us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334984.118943:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2692 00010000:00010000:0.0:1763334984.119776:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334984.119789:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334984.119819:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334984.119834:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf1c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06cd expref: 191 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.119843:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334984.119887:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf1c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06cd expref: 191 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.119903:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf1c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06cd expref: 191 pid: 29628 timeout: 1148 lvb_type: 0 00000100:00100000:0.0:1763334984.119931:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee545500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701896320:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334984.120031:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b600 going to sleep for 11 seconds 00000100:00100000:2.0:1763334984.126430:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.126430:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee545500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701896320:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334984.126468:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:3.0:1763334984.126536:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694646528 00000100:00100000:3.0:1763334984.126545:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694646528 00010000:00010000:3.0:1763334984.126627:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf1c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06cd expref: 192 pid: 29628 timeout: 1148 lvb_type: 0 00000100:00100000:3.0:1763334984.126671:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2693 00000100:00100000:3.0:1763334984.126684:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca870000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2359:x1848989694646528:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334984.126702:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334984.126710:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf1c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06cd expref: 192 pid: 29628 timeout: 1148 lvb_type: 0 00010000:00010000:3.0:1763334984.126722:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf1c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06cd expref: 192 pid: 29628 timeout: 1148 lvb_type: 0 00010000:00010000:3.0:1763334984.126748:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849cf1c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1b3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06cd expref: 192 pid: 29628 timeout: 1148 lvb_type: 0 00010000:00010000:3.0:1763334984.126767:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b3:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:3.0:1763334984.126773:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334984.126783:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334984.126790:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334984.126810:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334984.126880:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca870000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:2359:x1848989694646528:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 198us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334984.126889:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2693 00010000:00010000:0.0:1763334984.126956:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334984.126964:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:2.0:1763334984.130248:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca870380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701896448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.130485:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334984.130550:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68300 going to sleep for 11 seconds 00000100:00100000:0.0:1763334984.130755:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701896448 00000100:00100000:0.0:1763334984.130765:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701896448 00000100:00100000:1.0:1763334984.131535:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1763334984.131552:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701896448:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334984.132385:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701896448:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 832us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334984.132398:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1763334984.132510:0:29630:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871276 gen 2 00000004:00080000:3.0:1763334984.132518:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b4e00, transno 17179871269 00000004:00080000:3.0:1763334984.132536:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa44d880, transno 17179871270 00000004:00080000:3.0:1763334984.132539:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa44c380, transno 17179871271 00000004:00080000:3.0:1763334984.132542:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5afa44d180, transno 17179871272 00000004:00080000:3.0:1763334984.132546:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac8418e00, transno 17179871273 00000004:00080000:3.0:1763334984.132548:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841a300, transno 17179871274 00000004:00080000:3.0:1763334984.132551:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b5880, transno 17179871275 00000004:00080000:3.0:1763334984.132554:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841ad80, transno 17179871276 00000100:00100000:3.0:1763334984.132562:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca870380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701896448:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1763334984.132683:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701896576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1763334984.132742:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334984.132768:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3791c00 going to sleep for 11 seconds 00000004:00080000:1.0:1763334984.133108:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:1.0:1763334984.133128:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701896576 00000100:00100000:1.0:1763334984.133135:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701896576 00000100:00100000:3.0:1763334984.133961:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1763334984.134032:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701896576:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.134157:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701896576:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 185us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.134164:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1763334984.134246:0:29630:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838519 gen 2 00000004:00080000:3.0:1763334984.134261:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b4700, transno 21474838512 00000004:00080000:3.0:1763334984.134278:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b7100, transno 21474838513 00000004:00080000:3.0:1763334984.134280:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b6680, transno 21474838514 00000004:00080000:3.0:1763334984.134283:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac95b7b80, transno 21474838515 00000004:00080000:3.0:1763334984.134286:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841b800, transno 21474838516 00000004:00080000:3.0:1763334984.134289:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac8419c00, transno 21474838517 00000004:00080000:3.0:1763334984.134292:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac8418000, transno 21474838518 00000004:00080000:3.0:1763334984.134295:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841b480, transno 21474838519 00000100:00100000:3.0:1763334984.134301:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701896576:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1763334984.134392:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701896704:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1763334984.134431:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334984.134452:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3791780 going to sleep for 11 seconds 00000004:00080000:2.0:1763334984.134813:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 8 done 00000100:00100000:2.0:1763334984.134830:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701896704 00000100:00100000:2.0:1763334984.134840:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701896704 00000100:00100000:2.0:1763334984.134872:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1763334984.134880:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701896704:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.134952:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701896704:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 72us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.134958:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1763334984.134990:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701896704:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135023:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701896832:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135052:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334984.135074:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701896832 00000100:00100000:2.0:1763334984.135077:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701896832 00000100:00100000:2.0:1763334984.135095:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1763334984.135100:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701896832:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135143:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701896832:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 42us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.135149:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1763334984.135164:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68540 going to sleep for 11 seconds 00000100:00100000:2.0:1763334984.135177:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701896832:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135218:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701896960:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135239:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334984.135256:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701896960 00000100:00100000:2.0:1763334984.135259:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701896960 00000100:00100000:2.0:1763334984.135273:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1763334984.135278:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701896960:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135341:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701896960:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 62us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.135347:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1763334984.135360:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec686c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334984.135369:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701896960:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135393:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897088:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135412:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334984.135426:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701897088 00000100:00100000:2.0:1763334984.135428:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701897088 00000100:00100000:2.0:1763334984.135441:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1763334984.135445:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701897088:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135476:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701897088:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 30us (63us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.135481:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1763334984.135492:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec686c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334984.135500:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897088:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135524:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135543:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334984.135556:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701897216 00000100:00100000:2.0:1763334984.135559:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701897216 00000100:00100000:2.0:1763334984.135594:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1763334984.135599:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701897216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135631:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701897216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.135636:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1763334984.135648:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec686c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334984.135657:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135677:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135693:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334984.135706:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701897344 00000100:00100000:2.0:1763334984.135709:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701897344 00000100:00100000:2.0:1763334984.135721:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1763334984.135725:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701897344:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135759:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca871880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701897344:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 33us (65us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.135765:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1763334984.135779:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec686c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334984.135789:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897344:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135819:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135840:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334984.135858:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701897472 00000100:00100000:2.0:1763334984.135861:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701897472 00000100:00100000:2.0:1763334984.135877:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1763334984.135882:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701897472:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.135948:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca873480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701897472:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 65us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.135955:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1763334984.135971:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec686c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334984.135983:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897472:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.136013:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.136035:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334984.136052:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701897600 00000100:00100000:2.0:1763334984.136056:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701897600 00000100:00100000:2.0:1763334984.136073:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1763334984.136079:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701897600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.136117:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca870a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701897600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 38us (81us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.136123:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1763334984.136137:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec686c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334984.136148:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897600:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:2.0:1763334984.136464:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].13, 640 off38288 00000001:00080000:2.0:1763334984.136479:0:29630:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939248 00000100:00100000:2.0:1763334984.136552:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.136604:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334984.136628:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701897728 00000100:00100000:2.0:1763334984.136632:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701897728 00000100:00100000:2.0:1763334984.136651:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1763334984.136658:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59ca870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701897728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.136861:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59ca870380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701897728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 203us (256us total) trans 17179871284 rc 0/0 00000100:00100000:2.0:1763334984.136868:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1763334984.136886:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec686c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334984.136905:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.136942:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e16680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.136966:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334984.136985:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701897856 00000100:00100000:2.0:1763334984.136988:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701897856 00000100:00100000:2.0:1763334984.137005:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1763334984.137010:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701897856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334984.137189:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701897856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 178us (222us total) trans 21474838524 rc 0/0 00000100:00100000:2.0:1763334984.137196:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1763334984.137221:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec686c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334984.137234:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e16680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701897856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1763334984.137317:0:29630:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939249 00010000:00010000:2.0:1763334984.137345:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137356:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137365:0:29630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137371:0:29630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334984.137376:0:29630:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137385:0:29630:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137404:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b3:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:2.0:1763334984.137407:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763334984.137412:0:29630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137417:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf38 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1b3:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137440:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137445:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137450:0:29630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137456:0:29630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334984.137458:0:29630:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137464:0:29630:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137470:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334984.137472:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763334984.137474:0:29630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137484:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf31 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334984.137495:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cabf00) 00010000:00010000:2.0:1763334984.137497:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334984.137504:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849ceba lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06b1 expref: 193 pid: 29628 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334984.137634:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8218050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53665:x1848989694646272:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 38626us (39591us total) trans 8589939250 rc 0/0 00000100:00100000:2.0:1763334984.137643:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1831 00000020:00080000:2.0:1763334984.137646:0:29630:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1763334984.144541:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.144764:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694646656 00000100:00100000:0.0:1763334984.144778:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694646656 00000100:00100000:0.0:1763334984.144951:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5043 00000100:00100000:0.0:1763334984.144964:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53665:x1848989694646656:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334984.144995:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.145029:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cf3f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06d4 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.145111:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cf3f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06d4 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.145127:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cf3f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06d4 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.145146:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:0.0:1763334984.145150:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334984.145155:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334984.145408:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53665:x1848989694646656:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 446us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334984.145416:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5043 00000100:00100000:3.0:1763334984.154599:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.154724:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694646912 00000100:00100000:0.0:1763334984.154739:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694646912 00000100:00100000:0.0:1763334984.154819:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1832 00000100:00100000:0.0:1763334984.154831:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53665:x1848989694646912:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334984.155185:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53665:x1848989694646912:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 355us (627us total) trans 8589939251 rc 0/0 00000100:00100000:0.0:1763334984.155194:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1832 00000100:00100000:3.0:1763334984.157691:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.157798:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694647168 00000100:00100000:0.0:1763334984.157812:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694647168 00000100:00100000:0.0:1763334984.157878:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1833 00000100:00100000:0.0:1763334984.157889:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53665:x1848989694647168:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:0.0:1763334984.158440:0:29631:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x1b3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:1.0:1763334984.159446:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cf46 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334984.159474:0:29631:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cf46 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334984.159488:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cf46 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334984.159498:0:29631:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cf46 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334984.159504:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cf46 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334984.159511:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cf46 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334984.159536:0:29631:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1763334984.159916:0:5736:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1763334984.159934:0:5736:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cf46 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334984.159942:0:5736:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334984.159947:0:5736:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cf46 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334984.159955:0:5736:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cf46 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334984.159969:0:5736:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b3:0x0].0x0 (ffff9a5ad28fac00) 00010000:00010000:2.0:1763334984.159973:0:5736:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1763334984.159977:0:5736:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cf46 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334984.159983:0:5736:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849cf46 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b3:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334984.160002:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334984.160003:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1763334984.160005:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334984.160564:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53665:x1848989694647168:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 2663us (2875us total) trans 8589939252 rc 0/0 00000100:00100000:1.0:1763334984.160747:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1833 00000100:00100000:1.0:1763334984.180264:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.180375:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694647296 00000100:00100000:0.0:1763334984.180390:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694647296 00000100:00100000:0.0:1763334984.180521:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5044 00000100:00100000:0.0:1763334984.180534:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53666:x1848989694647296:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334984.180565:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.180619:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cf4d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06db expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.180707:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf54 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.180730:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf54 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.180743:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf54 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.180758:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cf5b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.180764:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cf5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.180771:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cf5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.180913:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cf62 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.180937:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cf62 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.180945:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cf62 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334984.180987:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 262144 00000004:00200000:0.0:1763334984.180992:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334984.181013:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cf62 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181024:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cf62 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181032:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf54 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181045:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf54 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181051:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf54 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181057:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334984.181062:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf54 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181070:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf54 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181084:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:0.0:1763334984.181087:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334984.181092:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf54 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181097:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849cf54 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181112:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cf5b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181117:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cf5b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181122:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cf5b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181127:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334984.181129:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cf5b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181139:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cf5b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181145:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac7d60b00) 00010000:00010000:0.0:1763334984.181147:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334984.181150:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cf5b lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181156:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849cf5b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.181190:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849cf4d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06db expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.181205:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cf62 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06db expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.181213:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:0.0:1763334984.181216:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334984.181219:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334984.181301:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53666:x1848989694647296:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 768us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334984.181310:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5044 00000100:00100000:2.0:1763334984.184167:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.184459:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694647552 00000100:00100000:0.0:1763334984.184473:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694647552 00000100:00100000:0.0:1763334984.184547:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5045 00000100:00100000:0.0:1763334984.184559:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53666:x1848989694647552:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334984.184613:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.184644:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf69 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06e2 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.184796:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf70 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.184814:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf70 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.184827:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf70 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334984.184841:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 262144 00010000:00010000:0.0:1763334984.185023:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849cf69 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06e2 expref: 199 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.185047:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf70 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06e2 expref: 198 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.185058:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:0.0:1763334984.185061:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763334984.185065:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334984.185188:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53666:x1848989694647552:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 629us (1034us total) trans 8589939253 rc 0/0 00000100:00100000:0.0:1763334984.185196:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5045 00000100:00100000:3.0:1763334984.188530:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.188694:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694647808 00000100:00100000:0.0:1763334984.188709:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694647808 00000100:00100000:0.0:1763334984.188778:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5046 00000100:00100000:0.0:1763334984.188793:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53666:x1848989694647808:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334984.188839:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.188881:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849cf7e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06e9 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.189063:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849cf85 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.189086:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849cf85 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.189100:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849cf85 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334984.189120:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 262144 00010000:00010000:0.0:1763334984.189327:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168fe00/0xcedf0054f849cf7e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06e9 expref: 201 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.189354:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849cf85 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06e9 expref: 200 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.189365:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:0.0:1763334984.189369:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334984.189373:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f600, rc 0) 00000100:00100000:0.0:1763334984.189480:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53666:x1848989694647808:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 690us (968us total) trans 8589939254 rc 0/0 00000100:00100000:0.0:1763334984.189489:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5046 00000100:00100000:1.0:1763334984.200315:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.200472:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694647936 00000100:00100000:2.0:1763334984.200488:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694647936 00000100:00100000:2.0:1763334984.200593:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5170 00000100:00100000:2.0:1763334984.200611:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694647936:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334984.200642:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334984.200675:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cf93 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06f0 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334984.200714:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 85452, mtime: 0x691a5b47, atime: 0x691a5b40, ctime: 0x691a5b47, blocks: 0x203 00010000:00010000:2.0:1763334984.200739:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.200742:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.200753:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cf93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f0 expref: 16 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334984.200774:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cf93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f0 expref: 16 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334984.200791:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431000, rc 0) 00000100:00100000:2.0:1763334984.200869:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694647936:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 265us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.200878:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5170 00000100:00100000:1.0:1763334984.217480:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.217606:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694648064 00000100:00100000:0.0:1763334984.217620:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694648064 00000100:00100000:0.0:1763334984.217726:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5171 00000100:00100000:0.0:1763334984.217739:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694648064:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334984.217766:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.217807:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f849cf9a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06f7 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334984.217847:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 85452, mtime: 0x691a5b47, atime: 0x691a5b44, ctime: 0x691a5b47, blocks: 0x203 00010000:00010000:0.0:1763334984.217875:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334984.217878:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334984.217890:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f849cf9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f7 expref: 25 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334984.217911:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f849cf9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f7 expref: 25 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334984.217936:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168fe00, rc 0) 00000100:00100000:0.0:1763334984.218018:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2361:x1848989694648064:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 281us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334984.218026:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5171 00000100:00100000:1.0:1763334984.273028:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.273150:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694648192 00000100:00100000:0.0:1763334984.273166:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694648192 00000100:00100000:0.0:1763334984.273272:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1956 00000100:00100000:0.0:1763334984.273285:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2362:x1848989694648192:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334984.273345:0:14384:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849cfa1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.273364:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334984.273367:0:14384:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334984.273375:0:14384:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849cfa1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.273392:0:14384:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849cfa1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.282416:0:14384:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849cfa1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.282446:0:14384:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849cfa1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.282458:0:14384:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849cfa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.282467:0:14384:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac168e200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334984.282473:0:14384:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849cfa1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.282483:0:14384:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849cfa1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.282512:0:14384:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849cfa1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.282521:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849cfa1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14384 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334984.282701:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2362:x1848989694648192:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 9408us (9679us total) trans 0 rc 262144/262144 00000100:00100000:0.0:1763334984.282714:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1956 00000100:00100000:1.0:1763334984.288535:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.289322:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694648320 00000100:00100000:0.0:1763334984.289338:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694648320 00000100:00100000:2.0:1763334984.290029:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1957 00000100:00100000:2.0:1763334984.290050:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694648320:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:2.0:1763334984.290123:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24c:0x0] initial LVB size: 262144, mtime: 0x691a5b48, atime: 0x691a5b48, ctime: 0x691a5b48, blocks: 0x203 00010000:00010000:2.0:1763334984.290146:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfa8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.290164:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.290167:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.290174:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfa8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.290191:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfa8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.296546:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfa8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.296734:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfa8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.296747:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.296757:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334984.296763:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfa8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.296775:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfa8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.296812:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfa8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.296821:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfa8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334984.298009:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694648320:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 6935us (8457us total) trans 0 rc 262144/262144 00000100:00100000:2.0:1763334984.298026:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1957 00000100:00100000:1.0:1763334984.313371:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.313703:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694648448 00000100:00100000:3.0:1763334984.313719:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694648448 00000100:00100000:2.0:1763334984.316669:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 416 00000100:00100000:2.0:1763334984.316689:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53666:x1848989694648448:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:2.0:1763334984.316716:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334984.316755:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849cf85 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06e9 expref: 200 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.316787:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:2.0:1763334984.316794:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334984.316893:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53666:x1848989694648448:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 210us (3542us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.316902:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 416 00000100:00100000:1.0:1763334984.320406:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.320538:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694648704 00000100:00100000:3.0:1763334984.320554:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694648704 00000100:00100000:3.0:1763334984.320878:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1834 00000100:00100000:3.0:1763334984.320891:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53666:x1848989694648704:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334984.321492:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53666:x1848989694648704:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 600us (1096us total) trans 8589939255 rc 0/0 00000100:00100000:3.0:1763334984.321501:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1834 00000100:00100000:3.0:1763334984.342031:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.342153:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694648960 00000100:00100000:2.0:1763334984.342169:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694648960 00000100:00100000:2.0:1763334984.342245:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5047 00000100:00100000:2.0:1763334984.342322:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53667:x1848989694648960:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334984.342364:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334984.342397:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfaf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b06fe expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.342548:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849cfb6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.342621:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849cfb6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.342639:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849cfb6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334984.342655:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 262144 00010000:00010000:2.0:1763334984.343969:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfaf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06fe expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.344000:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849cfb6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06fe expref: 202 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.344011:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:2.0:1763334984.344014:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334984.344019:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334984.344121:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53667:x1848989694648960:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1802us (2103us total) trans 8589939256 rc 0/0 00000100:00100000:2.0:1763334984.344132:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5047 00000100:00100000:1.0:1763334984.351218:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.351373:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694649088 00000100:00100000:2.0:1763334984.351388:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694649088 00000100:00100000:2.0:1763334984.351855:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1958 00000100:00100000:2.0:1763334984.351868:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694649088:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334984.352092:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfc4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.352113:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.352115:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.352123:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.352139:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.357810:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfc4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.357837:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfc4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.357847:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.357855:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334984.357860:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfc4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.357870:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfc4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.357893:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfc4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.357902:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfc4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334984.358034:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694649088:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 6161us (6822us total) trans 0 rc 86016/86016 00000100:00100000:2.0:1763334984.358047:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1958 00000100:00100000:3.0:1763334984.365196:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.365475:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694649216 00000100:00100000:2.0:1763334984.365490:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694649216 00000100:00100000:2.0:1763334984.365650:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1959 00000100:00100000:2.0:1763334984.365663:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694649216:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334984.365713:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfcb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.365734:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.365736:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.365743:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfcb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.365760:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfcb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.369420:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfcb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.369446:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfcb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.369455:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.369463:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334984.369469:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfcb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.369478:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfcb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.369506:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfcb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.369514:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfcb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334984.369686:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694649216:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 4018us (4499us total) trans 0 rc 86016/86016 00000100:00100000:2.0:1763334984.369698:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1959 00000100:00100000:1.0:1763334984.405870:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.406045:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694649344 00000100:00100000:2.0:1763334984.406059:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694649344 00000100:00100000:2.0:1763334984.406169:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1960 00000100:00100000:2.0:1763334984.406183:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694649344:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334984.406253:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.406275:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.406278:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.406288:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.406308:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.411689:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.411717:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.411728:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.411737:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334984.411743:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.411753:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.411779:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.411787:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334984.411986:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694649344:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 5799us (6127us total) trans 0 rc 262144/262144 00000100:00100000:2.0:1763334984.412000:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1960 00000100:00100000:1.0:1763334984.415770:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.415894:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694649472 00000100:00100000:2.0:1763334984.415910:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694649472 00000100:00100000:2.0:1763334984.416362:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1961 00000100:00100000:2.0:1763334984.416559:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694649472:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:2.0:1763334984.416951:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24c:0x0] initial LVB size: 262144, mtime: 0x691a5b48, atime: 0x691a5b48, ctime: 0x691a5b48, blocks: 0x203 00010000:00010000:2.0:1763334984.416965:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.416984:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.416987:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.416994:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.417018:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.423151:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.423183:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.423194:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.423203:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334984.423208:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.423219:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.423255:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.423264:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfd9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->262143] (req 0->262143) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334984.423415:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2361:x1848989694649472:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 7031us (7651us total) trans 0 rc 262144/262144 00000100:00100000:2.0:1763334984.423430:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1961 00000100:00100000:1.0:1763334984.436568:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.436949:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694649600 00000100:00100000:2.0:1763334984.436965:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694649600 00000100:00100000:2.0:1763334984.437229:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 417 00000100:00100000:2.0:1763334984.437248:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53667:x1848989694649600:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:2.0:1763334984.437278:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334984.437314:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849cfb6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06fe expref: 202 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.437338:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:2.0:1763334984.437455:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334984.437537:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53667:x1848989694649600:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 297us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.437545:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 417 00000100:00100000:1.0:1763334984.440364:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.440567:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694649856 00000100:00100000:3.0:1763334984.440694:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694649856 00000100:00100000:0.0:1763334984.441150:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1835 00000100:00100000:0.0:1763334984.441164:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53667:x1848989694649856:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334984.441499:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53667:x1848989694649856:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 336us (1153us total) trans 8589939257 rc 0/0 00000100:00100000:0.0:1763334984.441506:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1835 00000100:00100000:1.0:1763334984.447088:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.447481:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694650112 00000100:00100000:2.0:1763334984.447496:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694650112 00000100:00100000:2.0:1763334984.447630:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5048 00000100:00100000:2.0:1763334984.447643:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53644:x1848989694650112:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334984.447681:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334984.447712:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849cfe0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0705 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.447858:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.447878:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cf62 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06db expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.447891:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.447950:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cf62 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06db expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.447967:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cf62 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06db expref: 203 pid: 30972 timeout: 1149 lvb_type: 0 00000100:00100000:2.0:1763334984.447984:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701897984:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334984.448114:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334984.450951:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701897984:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334984.450989:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334984.452118:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.452314:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694650240 00000100:00100000:0.0:1763334984.452324:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694650240 00010000:00010000:0.0:1763334984.452375:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cf62 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06db expref: 204 pid: 30972 timeout: 1149 lvb_type: 0 00000100:00100000:0.0:1763334984.452425:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2694 00000100:00100000:0.0:1763334984.452437:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2359:x1848989694650240:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334984.452457:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334984.452465:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cf62 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06db expref: 204 pid: 30972 timeout: 1149 lvb_type: 0 00010000:00010000:0.0:1763334984.452479:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cf62 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06db expref: 204 pid: 30972 timeout: 1149 lvb_type: 0 00010000:00010000:0.0:1763334984.452510:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849cf62 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06db expref: 204 pid: 30972 timeout: 1149 lvb_type: 0 00010000:00010000:0.0:1763334984.452529:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:0.0:1763334984.452535:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.452545:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.452558:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.452664:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334984.452738:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:2359:x1848989694650240:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 302us (638us total) trans 0 rc 0/0 00010000:00010000:1.0:1763334984.452746:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:0.0:1763334984.452747:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2694 00010000:00010000:1.0:1763334984.452754:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:1.0:1763334984.452781:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 262144 00010000:00010000:0.0:1763334984.454418:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849cfe0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0705 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.454449:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0705 expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.454458:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:0.0:1763334984.454461:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1763334984.454464:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431c00, rc 0) 00000100:00100000:0.0:1763334984.454600:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694650112:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 6959us (7527us total) trans 8589939258 rc 0/0 00000100:00100000:0.0:1763334984.454609:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5048 00000100:00100000:1.0:1763334984.457771:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.458219:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694650368 00000100:00100000:0.0:1763334984.458232:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694650368 00000100:00100000:0.0:1763334984.458393:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5049 00000100:00100000:0.0:1763334984.458406:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694650368:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334984.458437:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.458466:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849cff5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b070c expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.458685:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849cffc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.458702:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0705 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.458711:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849cffc lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.458753:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0705 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.458768:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0705 expref: 204 pid: 29628 timeout: 1149 lvb_type: 0 00000100:00100000:0.0:1763334984.458782:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee545500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701898112:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334984.458932:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b540 going to sleep for 11 seconds 00000100:00100000:0.0:1763334984.462614:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee545500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701898112:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334984.462657:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849cffc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334984.463628:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.464885:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694650496 00000100:00100000:2.0:1763334984.464902:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694650496 00010000:00010000:2.0:1763334984.464970:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0705 expref: 205 pid: 29628 timeout: 1149 lvb_type: 0 00000100:00100000:2.0:1763334984.465133:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2695 00000100:00100000:2.0:1763334984.465145:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+205:2360:x1848989694650496:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334984.465170:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334984.465180:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0705 expref: 205 pid: 29628 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334984.465199:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0705 expref: 205 pid: 29628 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334984.465236:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849cfe7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0705 expref: 205 pid: 29628 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334984.465394:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:2.0:1763334984.465402:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849cffc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.465415:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849cffc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.465423:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849cffc lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334984.465634:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334984.465908:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849cffc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.465929:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849cffc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:0.0:1763334984.465991:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 262144 00000004:00200000:0.0:1763334984.465996:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334984.466029:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849cffc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.466076:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849cff5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b070c expref: 205 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.466097:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849cffc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b070c expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.466105:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:0.0:1763334984.466109:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334984.466111:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168e200, rc 0) 00000100:00100000:2.0:1763334984.466223:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2360:x1848989694650496:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1077us (2598us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.466234:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2695 00000100:00100000:0.0:1763334984.466736:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694650368:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 8331us (8979us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334984.466754:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5049 00000100:00100000:1.0:1763334984.471404:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334984.471456:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.471534:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694650752 00000100:00100000:2.0:1763334984.471548:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694650752 00000100:00100000:2.0:1763334984.471661:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694650624 00000100:00100000:2.0:1763334984.471665:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694650624 00000100:00100000:2.0:1763334984.471694:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5172 00000100:00100000:2.0:1763334984.471705:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694650752:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334984.471728:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334984.471753:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d003 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b071a expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.471783:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.471786:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.471796:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d003 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b071a expref: 26 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334984.471816:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d003 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b071a expref: 26 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334984.471832:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:2.0:1763334984.471899:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694650752:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 195us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.471907:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5172 00000100:00100000:2.0:1763334984.471945:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5173 00000100:00100000:2.0:1763334984.471952:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694650624:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334984.471960:0:21625:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334984.471976:0:21625:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d00a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0713 expref: -99 pid: 21625 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334984.472006:0:21625:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24c:0x0] initial LVB size: 262144, mtime: 0x691a5b48, atime: 0x691a5b48, ctime: 0x691a5b48, blocks: 0x203 00010000:00010000:2.0:1763334984.472022:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.472023:0:21625:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.472029:0:21625:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d00a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0713 expref: 17 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334984.472040:0:21625:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d00a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0713 expref: 17 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334984.472048:0:21625:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431600, rc 0) 00000100:00100000:2.0:1763334984.472069:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694650624:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 116us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.472075:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5173 00000100:00100000:3.0:1763334984.476040:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334984.476173:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694650880 00000100:00100000:1.0:1763334984.476191:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694650880 00000100:00100000:1.0:1763334984.476263:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5174 00000100:00100000:1.0:1763334984.476276:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694650880:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334984.476300:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334984.476327:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849d011 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x250:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0721 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334984.476362:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334984.476365:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334984.476375:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849d011 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0721 expref: 27 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334984.476394:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849d011 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0721 expref: 27 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334984.476408:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334984.476742:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694650880:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 468us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334984.476750:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5174 00000100:00100000:1.0:1763334984.479379:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.479494:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694651008 00000100:00100000:2.0:1763334984.479509:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694651008 00002000:00100000:2.0:1763334984.479619:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x24c:0x0] (188416->192511) req@ffff9a5ae0bbfb80 x1848989694651008/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 488/0 e 0 to 0 dl 1763334995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334984.479633:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ae0bbfb80 with x1848989694651008 ext(188416->192511) 00002000:00010000:2.0:1763334984.479640:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ae0bbfb80 00000100:00100000:2.0:1763334984.479673:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1962 00000100:00100000:2.0:1763334984.479683:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694651008:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:2.0:1763334984.479985:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694651008:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 302us (618us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763334984.479993:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1962 00002000:00100000:2.0:1763334984.480002:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x24c:0x0] (188416->192511) req@ffff9a5ae0bbfb80 x1848989694651008/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 488/4536 e 0 to 0 dl 1763334995 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334984.480018:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ae0bbfb80 with x1848989694651008 ext(188416->192511) 00002000:00010000:2.0:1763334984.480022:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ae0bbfb80 00000100:00100000:2.0:1763334984.483119:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.483239:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694651136 00000100:00100000:0.0:1763334984.483253:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694651136 00002000:00100000:0.0:1763334984.483319:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x24c:0x0] (192512->196607) req@ffff9a5ac7e16a00 x1848989694651136/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 488/0 e 0 to 0 dl 1763334995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334984.483332:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e16a00 with x1848989694651136 ext(192512->196607) 00002000:00010000:0.0:1763334984.483339:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac7e16a00 00000100:00100000:0.0:1763334984.483376:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1963 00000100:00100000:0.0:1763334984.483387:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694651136:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:0.0:1763334984.483743:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694651136:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 357us (639us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334984.483752:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1963 00002000:00100000:0.0:1763334984.483760:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x24c:0x0] (192512->196607) req@ffff9a5ac7e16a00 x1848989694651136/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 488/4536 e 0 to 0 dl 1763334995 ref 1 fl Complete:/600/0 rc 4096/4096 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334984.483770:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e16a00 with x1848989694651136 ext(192512->196607) 00002000:00010000:0.0:1763334984.483774:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac7e16a00 00000100:00100000:3.0:1763334984.487639:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.487813:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694651264 00000100:00100000:2.0:1763334984.487828:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694651264 00002000:00100000:2.0:1763334984.487897:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x24c:0x0] (167936->233471) req@ffff9a5ac95b7b80 x1848989694651264/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 504/0 e 0 to 0 dl 1763334995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334984.487910:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b7b80 with x1848989694651264 ext(167936->233471) 00002000:00010000:2.0:1763334984.487928:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac95b7b80 00000100:00100000:2.0:1763334984.487969:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1964 00000100:00100000:2.0:1763334984.487980:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694651264:12345-192.168.201.60@tcp:3:lfs.0 00000100:00100000:2.0:1763334984.491097:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694651264:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 3100us (3455us total) trans 0 rc 57344/57344 00000100:00100000:2.0:1763334984.491114:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1964 00002000:00100000:2.0:1763334984.491130:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x24c:0x0] (167936->233471) req@ffff9a5ac95b7b80 x1848989694651264/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 504/440 e 0 to 0 dl 1763334995 ref 1 fl Complete:/600/0 rc 57344/57344 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334984.491142:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b7b80 with x1848989694651264 ext(167936->233471) 00002000:00010000:2.0:1763334984.491150:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac95b7b80 00000100:00100000:1.0:1763334984.493807:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.497209:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694651392 00000100:00100000:3.0:1763334984.497232:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694651392 00000100:00100000:3.0:1763334984.497332:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5175 00000100:00100000:3.0:1763334984.497347:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694651392:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334984.497369:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334984.497394:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d018 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x250:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0728 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.497424:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334984.497427:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334984.497436:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d018 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0728 expref: 28 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334984.497454:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d018 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0728 expref: 28 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334984.497477:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066600, rc 0) 00000100:00100000:3.0:1763334984.497549:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694651392:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 205us (3761us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334984.497556:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5175 00000100:00100000:3.0:1763334984.500418:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.500536:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694651520 00000100:00100000:2.0:1763334984.500550:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694651520 00000100:00100000:2.0:1763334984.500651:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5176 00000100:00100000:2.0:1763334984.500662:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694651520:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334984.500685:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334984.500710:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d01f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x250:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b072f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.500737:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.500739:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.500749:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d01f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b072f expref: 29 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334984.500766:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d01f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b072f expref: 29 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334984.500780:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430e00, rc 0) 00000100:00100000:2.0:1763334984.500846:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694651520:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 186us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.500852:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5176 00000100:00100000:1.0:1763334984.504344:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.504437:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694651776 00000100:00100000:3.0:1763334984.504451:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694651776 00000100:00100000:0.0:1763334984.504857:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1836 00000100:00100000:0.0:1763334984.504873:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694651776:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:0.0:1763334984.505241:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53644:x1848989694651776:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 371us (910us total) trans 8589939259 rc 0/0 00000100:00100000:0.0:1763334984.505249:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1836 00000100:00100000:1.0:1763334984.509101:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.509232:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694652032 00000100:00100000:0.0:1763334984.509248:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694652032 00000100:00100000:0.0:1763334984.509416:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5050 00000100:00100000:0.0:1763334984.509428:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53644:x1848989694652032:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334984.509464:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.509468:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 1 00010000:00010000:0.0:1763334984.509504:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168e200/0xcedf0054f849cffc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b070c expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.509531:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849cf70 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06e2 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.509542:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849cf3f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06d4 expref: 202 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.509551:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:0.0:1763334984.509562:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334984.509946:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849d026 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0736 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.510023:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849d02d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.510039:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849d02d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.510051:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849d02d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000040:00080000:0.0:1763334984.510732:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1194, 88 off102240 00000004:00080000:0.0:1763334984.510746:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1049144173774ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334984.510809:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1184, 88 off101184 00000004:00080000:0.0:1763334984.510816:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1049144244624ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334984.511441:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1185, 88 off101272 00000004:00080000:0.0:1763334984.511450:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1049144878086ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334984.511725:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1195, 88 off102328 00000004:00080000:0.0:1763334984.511730:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1049145158667ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334984.511794:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1186, 88 off101360 00000004:00080000:0.0:1763334984.511799:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1049145226832ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334984.511891:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1196, 88 off102416 00000004:00080000:0.0:1763334984.511896:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1049145324624ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334984.511999:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1197, 88 off102504 00000004:00080000:0.0:1763334984.512004:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1049145432744ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334984.512109:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1187, 88 off101448 00000004:00080000:0.0:1763334984.512114:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1049145542169ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334984.512193:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1188, 88 off101536 00000004:00080000:0.0:1763334984.512198:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1049145626315ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334984.512521:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1198, 88 off102592 00000004:00080000:0.0:1763334984.512527:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1049145955405ns, next at 1047075157699ns, rc = 0 00010000:00010000:3.0:1763334984.554452:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1763334984.565878:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939260 is committed 00000004:00080000:1.0:1763334984.565896:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 810 committed 00000004:00080000:1.0:1763334984.565923:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 798 committed 00000004:00080000:1.0:1763334984.565935:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 797 committed 00000004:00080000:1.0:1763334984.565938:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 809 committed 00000004:00080000:1.0:1763334984.565940:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 808 committed 00000004:00080000:1.0:1763334984.565942:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 796 committed 00000004:00080000:1.0:1763334984.565945:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 807 committed 00000004:00080000:1.0:1763334984.565946:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 795 committed 00000004:00080000:1.0:1763334984.565949:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 794 committed 00000004:00080000:1.0:1763334984.565951:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 806 committed 00000020:00080000:1.0:1763334984.566001:0:29660:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a5ac3791c00 refcount 2 committed 0 result 0 batchid 4294969319 00000020:00080000:1.0:1763334984.566008:0:29660:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5afc8b2700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a5aeec68180 00000020:00080000:1.0:1763334984.566012:0:29660:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5ac8d70100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a5ac3791f00 00000020:00080000:1.0:1763334984.566015:0:29660:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5ac8d70400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a5afa4ca800 00000020:00080000:1.0:1763334984.566019:0:29660:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].13 00000020:00080000:1.0:1763334984.566166:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969319 committed batchid 4294969318 00000020:00080000:1.0:1763334984.566387:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969318 00010000:00010000:3.0:1763334984.566725:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849d02d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0736 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.566741:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60900) 00010000:00010000:3.0:1763334984.566744:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334984.566764:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849d026 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0736 expref: 189 pid: 29628 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763334984.566783:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849d02d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0736 expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.566826:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60900) 00010000:00010000:3.0:1763334984.566830:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334984.566832:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168f600, rc 0) 00000100:00100000:3.0:1763334984.566936:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694652032:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 57509us (57850us total) trans 8589939260 rc 0/0 00000100:00100000:3.0:1763334984.566947:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5050 00000100:00100000:3.0:1763334984.567003:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701898624:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334984.567078:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334984.567125:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763334984.567131:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701898240:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334984.567156:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334984.567175:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701898752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334984.567195:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334984.567226:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701898368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334984.567249:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334984.567269:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1763334984.567275:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701898496:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334984.567294:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334984.567325:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701898624 00000100:00100000:3.0:1763334984.567335:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701898624 00000100:00100000:3.0:1763334984.567381:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701898240 00000100:00100000:3.0:1763334984.567384:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701898240 00000100:00100000:3.0:1763334984.567400:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701898752 00000100:00100000:3.0:1763334984.567402:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701898752 00000100:00100000:3.0:1763334984.567416:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701898368 00000100:00100000:3.0:1763334984.567418:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701898368 00000100:00100000:3.0:1763334984.567432:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701898496 00000100:00100000:3.0:1763334984.567435:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701898496 00000100:00100000:3.0:1763334984.567453:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5177 00000100:00100000:3.0:1763334984.567462:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701898624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334984.567765:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334984.567769:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334984.567772:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334984.567775:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334984.567777:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334984.567816:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701898624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 355us (737us total) trans 21474838525 rc 0/0 00000100:00100000:3.0:1763334984.567822:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5177 00000100:00100000:3.0:1763334984.567840:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5178 00000100:00100000:3.0:1763334984.567846:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701898240:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334984.567948:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334984.567951:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334984.567953:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334984.567955:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334984.567957:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334984.567983:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701898240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (826us total) trans 21474838526 rc 0/0 00000100:00100000:3.0:1763334984.567990:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5178 00000100:00100000:3.0:1763334984.568002:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5179 00000100:00100000:3.0:1763334984.568008:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701898752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334984.568088:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:3.0:1763334984.568091:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb mtime from disk: 1763334984 -> 1763334984 00002000:00010000:3.0:1763334984.568094:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:3.0:1763334984.568096:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb ctime from disk: 1763334984 -> 1763334984 00002000:00010000:3.0:1763334984.568098:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334984.568123:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701898752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (927us total) trans 21474838527 rc 0/0 00000100:00100000:3.0:1763334984.568130:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5179 00000100:00100000:3.0:1763334984.568145:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5180 00000100:00100000:3.0:1763334984.568151:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701898368:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334984.568254:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334984.568257:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334984 -> 1763334984 00002000:00010000:3.0:1763334984.568259:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:3.0:1763334984.568261:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334984 -> 1763334984 00002000:00010000:3.0:1763334984.568263:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334984.568295:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701898368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 144us (1045us total) trans 21474838528 rc 0/0 00000100:00100000:3.0:1763334984.568302:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5180 00000100:00100000:3.0:1763334984.568314:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5181 00000100:00100000:3.0:1763334984.568320:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701898496:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334984.568409:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 85452 -> 85452 00002000:00010000:3.0:1763334984.568412:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334984.568414:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334984.568416:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334984.568419:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334984.568445:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701898496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (1150us total) trans 21474838529 rc 0/0 00000100:00100000:3.0:1763334984.568451:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5181 00000004:00080000:3.0:1763334984.568543:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e16d80/2, rc 0, transno 21474838529 00000100:00100000:3.0:1763334984.568551:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701898496:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334984.568562:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e14380/2, rc 0, transno 21474838528 00000100:00100000:3.0:1763334984.568565:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701898368:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334984.568615:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e17100/2, rc 0, transno 21474838526 00000100:00100000:3.0:1763334984.568620:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701898240:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334984.568631:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e14e00/2, rc 0, transno 21474838527 00000100:00100000:3.0:1763334984.568634:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701898752:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334984.568641:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e15f80/2, rc 0, transno 21474838525 00000100:00100000:3.0:1763334984.568643:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701898624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334984.569211:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701899264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334984.569256:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334984.569306:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763334984.569312:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701899136:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334984.569333:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334984.569357:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701899008:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334984.569377:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334984.569393:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1763334984.569398:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701898880:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334984.569416:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334984.569431:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701899392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334984.569448:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334984.569473:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701899264 00000100:00100000:1.0:1763334984.569479:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701899264 00000100:00100000:1.0:1763334984.569514:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701899136 00000100:00100000:1.0:1763334984.569517:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701899136 00000100:00100000:1.0:1763334984.569531:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701899008 00000100:00100000:1.0:1763334984.569534:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701899008 00000100:00100000:1.0:1763334984.569548:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701898880 00000100:00100000:1.0:1763334984.569551:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701898880 00000100:00100000:1.0:1763334984.569564:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701899392 00000100:00100000:1.0:1763334984.569566:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701899392 00000100:00100000:1.0:1763334984.569614:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5182 00000100:00100000:1.0:1763334984.569622:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3290:x1848989701899264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334984.569810:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 85452 -> 85452 00002000:00010000:1.0:1763334984.569814:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334984.569816:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334984.569818:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334984.569820:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1763334984.569851:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3290:x1848989701899264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 230us (594us total) trans 17179871285 rc 0/0 00000100:00100000:1.0:1763334984.569857:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5182 00000100:00100000:1.0:1763334984.569871:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5183 00000100:00100000:1.0:1763334984.569876:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3290:x1848989701899136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334984.569958:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334984.569961:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334984.569963:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334984.569965:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334984.569968:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334984.569988:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3290:x1848989701899136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 112us (655us total) trans 17179871286 rc 0/0 00000100:00100000:1.0:1763334984.569993:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5183 00000100:00100000:1.0:1763334984.570003:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5184 00000100:00100000:1.0:1763334984.570008:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701899008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334984.570083:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334984.570086:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.570089:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.570092:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.570094:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334984.570124:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701899008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (745us total) trans 17179871287 rc 0/0 00000100:00100000:1.0:1763334984.570130:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5184 00000100:00100000:1.0:1763334984.570140:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5185 00000100:00100000:1.0:1763334984.570145:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701898880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334984.570220:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1763334984.570223:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.570225:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.570227:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.570229:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 193 -> 193 00000100:00100000:1.0:1763334984.570249:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701898880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 104us (831us total) trans 17179871288 rc 0/0 00000100:00100000:1.0:1763334984.570253:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5185 00000100:00100000:1.0:1763334984.570263:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5186 00000100:00100000:1.0:1763334984.570268:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3292:x1848989701899392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334984.570341:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334984.570344:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb mtime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.570347:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.570349:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb ctime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334984.570351:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334984.570376:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701899392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 108us (927us total) trans 17179871289 rc 0/0 00000100:00100000:1.0:1763334984.570385:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5186 00000004:00080000:1.0:1763334984.570456:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee545500/2, rc 0, transno 17179871288 00000100:00100000:1.0:1763334984.570463:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee545500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701898880:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334984.570472:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee544e00/2, rc 0, transno 17179871289 00000100:00100000:1.0:1763334984.570475:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee544e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701899392:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334984.570482:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee544700/2, rc 0, transno 17179871287 00000100:00100000:1.0:1763334984.570485:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee544700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701899008:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334984.570504:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee545c00/2, rc 0, transno 17179871286 00000100:00100000:1.0:1763334984.570508:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee545c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701899136:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334984.570516:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee546680/2, rc 0, transno 17179871285 00000100:00100000:1.0:1763334984.570519:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee546680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701899264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334984.577293:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.578361:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694652160 00000100:00100000:0.0:1763334984.578382:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694652160 00000100:00100000:0.0:1763334984.578468:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5187 00000100:00100000:0.0:1763334984.578480:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+29:53644:x1848989694652160:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334984.578505:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.578531:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b073d expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.579355:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cedd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06b8 expref: 30 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334984.579370:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334984.579373:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334984.579380:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [98304->151551] (req 98304->151551) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 30 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.579430:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cedd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06b8 expref: 30 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334984.579447:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cedd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06b8 expref: 30 pid: 32239 timeout: 1149 lvb_type: 1 00000100:00100000:0.0:1763334984.579465:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701899520:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334984.580406:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b000 going to sleep for 11 seconds 00000100:00100000:0.0:1763334984.583503:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee545f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701899520:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334984.583549:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [98304->151551] (req 98304->151551) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 30 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.583613:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac168e200, rc 0) 00000100:00100000:0.0:1763334984.583685:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+30:53644:x1848989694652160:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 5206us (6407us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334984.583697:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5187 00000100:00100000:1.0:1763334984.586480:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.586624:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694652288 00000100:00100000:2.0:1763334984.586637:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694652288 00010000:00010000:2.0:1763334984.586688:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cedd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06b8 expref: 30 pid: 32239 timeout: 1149 lvb_type: 1 00000100:00100000:2.0:1763334984.586734:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2696 00000100:00100000:2.0:1763334984.586744:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694652288:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334984.586764:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334984.586789:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cedd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06b8 expref: 30 pid: 32239 timeout: 1149 lvb_type: 1 00010000:00010000:2.0:1763334984.586802:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cedd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06b8 expref: 30 pid: 32239 timeout: 1149 lvb_type: 1 00010000:00010000:2.0:1763334984.586835:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478200/0xcedf0054f849cedd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06b8 expref: 30 pid: 32239 timeout: 1149 lvb_type: 1 00010000:00010000:2.0:1763334984.586852:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.586854:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.586863:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 29 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.586874:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 29 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.586930:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 29 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334984.586947:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e17480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701899648:192.168.201.60@tcp:105: 00000100:00100000:2.0:1763334984.587056:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334984.591014:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.591129:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694652416 00000100:00100000:0.0:1763334984.591143:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694652416 00002000:00100000:0.0:1763334984.591215:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (69632->135167) req@ffff9a5ad81ff480 x1848989694652416/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 488/0 e 0 to 0 dl 1763334995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334984.591228:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad81ff480 with x1848989694652416 ext(69632->135167) 00002000:00010000:0.0:1763334984.591236:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad81ff480 00000100:00100000:2.0:1763334984.591412:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e17480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701899648:192.168.201.60@tcp:105: 00010000:00010000:2.0:1763334984.591444:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334984.591594:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1965 00000100:00100000:0.0:1763334984.591607:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694652416:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:2.0:1763334984.592518:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2359:x1848989694652288:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5767us (6045us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.592532:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2696 00000100:00100000:0.0:1763334984.597351:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694652416:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 5730us (6336us total) trans 0 rc 65536/65536 00000100:00100000:0.0:1763334984.597368:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1965 00002000:00100000:0.0:1763334984.597384:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (69632->135167) req@ffff9a5ad81ff480 x1848989694652416/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 488/440 e 0 to 0 dl 1763334995 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334984.597396:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ad81ff480 with x1848989694652416 ext(69632->135167) 00002000:00010000:0.0:1763334984.597404:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ad81ff480 00000100:00100000:1.0:1763334984.600750:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.601045:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694652544 00000100:00100000:2.0:1763334984.601061:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694652544 00002000:00100000:2.0:1763334984.601135:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (147456->151551) req@ffff9a5aeece9f80 x1848989694652544/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 488/0 e 0 to 0 dl 1763334995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334984.601155:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece9f80 with x1848989694652544 ext(147456->151551) 00002000:00010000:2.0:1763334984.601162:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece9f80 00000100:00100000:2.0:1763334984.601364:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1966 00000100:00100000:2.0:1763334984.601377:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694652544:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:2.0:1763334984.601754:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694652544:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 378us (1017us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763334984.601764:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1966 00002000:00100000:2.0:1763334984.601772:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (147456->151551) req@ffff9a5aeece9f80 x1848989694652544/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 488/4536 e 0 to 0 dl 1763334995 ref 1 fl Complete:/600/0 rc 4096/4096 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334984.601781:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece9f80 with x1848989694652544 ext(147456->151551) 00002000:00010000:2.0:1763334984.601785:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece9f80 00000100:00100000:3.0:1763334984.605978:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.606073:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694652672 00000100:00100000:0.0:1763334984.606088:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694652672 00000100:00100000:0.0:1763334984.606164:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5051 00000100:00100000:0.0:1763334984.606176:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694652672:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334984.606209:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.606240:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849d03b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0744 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.606356:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d042 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.606374:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d042 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.606389:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d042 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:0.0:1763334984.606424:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 0 00000004:00200000:0.0:1763334984.606429:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334984.606451:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d042 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334984.606485:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168ee00/0xcedf0054f849d03b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0744 expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.606508:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d042 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0744 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.606518:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60900) 00010000:00010000:0.0:1763334984.606521:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334984.606526:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334984.606655:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694652672:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 480us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334984.606663:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5051 00000100:00100000:3.0:1763334984.611552:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334984.611762:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694652800 00000100:00100000:1.0:1763334984.611777:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694652800 00002000:00100000:1.0:1763334984.611839:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (151552->217087) req@ffff9a5afa44ed80 x1848989694652800/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 488/0 e 0 to 0 dl 1763334995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334984.611851:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44ed80 with x1848989694652800 ext(151552->217087) 00002000:00010000:1.0:1763334984.611859:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44ed80 00000100:00100000:2.0:1763334984.612463:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1967 00000100:00100000:2.0:1763334984.612479:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2361:x1848989694652800:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:2.0:1763334984.616150:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2361:x1848989694652800:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 3659us (4596us total) trans 0 rc 65536/65536 00000100:00100000:2.0:1763334984.616169:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1967 00002000:00100000:2.0:1763334984.616186:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (151552->217087) req@ffff9a5afa44ed80 x1848989694652800/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 488/440 e 0 to 0 dl 1763334995 ref 1 fl Complete:/600/0 rc 65536/65536 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334984.616198:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44ed80 with x1848989694652800 ext(151552->217087) 00002000:00010000:2.0:1763334984.616206:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44ed80 00000100:00100000:3.0:1763334984.621396:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.621537:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694652928 00000100:00100000:2.0:1763334984.621551:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694652928 00002000:00100000:2.0:1763334984.622012:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (98304->196607) req@ffff9a5afa44f100 x1848989694652928/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 504/0 e 0 to 0 dl 1763334995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334984.622025:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44f100 with x1848989694652928 ext(98304->196607) 00002000:00010000:2.0:1763334984.622034:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44f100 00000100:00100000:2.0:1763334984.622078:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1968 00000100:00100000:2.0:1763334984.622090:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694652928:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:2.0:1763334984.626624:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694652928:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 4470us (5179us total) trans 17179871290 rc 0/0 00000100:00100000:2.0:1763334984.626643:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1968 00002000:00100000:2.0:1763334984.626661:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (98304->196607) req@ffff9a5afa44f100 x1848989694652928/t17179871290(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 504/448 e 0 to 0 dl 1763334995 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334984.626673:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44f100 with x1848989694652928 ext(98304->196607) 00002000:00010000:2.0:1763334984.626680:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44f100 00000100:00100000:3.0:1763334984.632125:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.632308:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694653056 00000100:00100000:0.0:1763334984.632325:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694653056 00000100:00100000:0.0:1763334984.632405:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5188 00000100:00100000:0.0:1763334984.632418:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2362:x1848989694653056:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:3.0:1763334984.705305:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871281 is committed 00000001:00080000:3.0:1763334984.705323:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871289 is committed 00000001:00080000:3.0:1763334984.705335:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871283 is committed 00000001:00080000:3.0:1763334984.705342:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871290 is committed 00000100:00100000:1.0:1763334984.705511:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694653056:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 73088us (73395us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334984.705523:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5188 00000100:00100000:3.0:1763334984.718723:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.718831:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694653184 00000100:00100000:2.0:1763334984.718841:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694653184 00002000:00100000:2.0:1763334984.718890:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (69632->81919) req@ffff9a5afa44e300 x1848989694653184/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 12776/0 e 0 to 0 dl 1763334995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334984.718901:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44e300 with x1848989694653184 ext(69632->81919) 00002000:00010000:2.0:1763334984.718907:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44e300 00000100:00100000:2.0:1763334984.718953:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1969 00000100:00100000:2.0:1763334984.718963:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694653184:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:2.0:1763334984.719419:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694653184:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 457us (703us total) trans 17179871291 rc 0/0 00000100:00100000:2.0:1763334984.719428:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1969 00002000:00100000:2.0:1763334984.719436:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (69632->81919) req@ffff9a5afa44e300 x1848989694653184/t17179871291(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 12776/448 e 0 to 0 dl 1763334995 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334984.719445:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44e300 with x1848989694653184 ext(69632->81919) 00002000:00010000:2.0:1763334984.719449:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44e300 00000100:00100000:3.0:1763334984.723204:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334984.723941:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694653312 00000100:00100000:1.0:1763334984.723951:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694653312 00000100:00100000:1.0:1763334984.724128:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5189 00000100:00100000:1.0:1763334984.724139:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2362:x1848989694653312:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:3.0:1763334984.783047:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871291 is committed 00000100:00100000:1.0:1763334984.783114:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694653312:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 58962us (59906us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334984.783132:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5189 00000100:00100000:3.0:1763334984.801329:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334984.801445:0:14384:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694653440 00000100:00100000:1.0:1763334984.801463:0:14384:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694653440 00002000:00100000:1.0:1763334984.801539:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (0->262143) req@ffff9a5afab36680 x1848989694653440/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 504/0 e 0 to 0 dl 1763334995 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334984.801553:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab36680 with x1848989694653440 ext(0->262143) 00002000:00010000:1.0:1763334984.801561:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab36680 00000100:00100000:1.0:1763334984.801653:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1970 00000100:00100000:1.0:1763334984.801664:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694653440:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:1.0:1763334984.808728:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2362:x1848989694653440:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 7055us (7399us total) trans 0 rc 114688/114688 00000100:00100000:1.0:1763334984.808744:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1970 00002000:00100000:1.0:1763334984.808758:0:14384:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x280000400:0x24a:0x0] (0->262143) req@ffff9a5afab36680 x1848989694653440/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:30/0 lens 504/440 e 0 to 0 dl 1763334995 ref 1 fl Complete:/600/0 rc 114688/114688 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334984.808769:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afab36680 with x1848989694653440 ext(0->262143) 00002000:00010000:1.0:1763334984.808775:0:14384:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afab36680 00000100:00100000:3.0:1763334984.817405:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.822328:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694653696 00000100:00100000:0.0:1763334984.822342:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694653696 00000100:00100000:0.0:1763334984.822418:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5052 00000100:00100000:0.0:1763334984.822429:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694653696:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:0.0:1763334984.822480:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1763334984.822506:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d042 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0744 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.822527:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac168f600/0xcedf0054f849d02d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0736 expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.822538:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60900) 00010000:00010000:0.0:1763334984.822547:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334984.822881:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d049 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.822894:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d049 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.822902:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d049 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:0.0:1763334984.822959:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939261 00000004:00010000:0.0:1763334984.822981:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e62e2861 reply state 00000000f45682c3 transno 8589939262 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d049 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334984.822988:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334984.823078:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694653696:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 651us (5687us total) trans 8589939262 rc 0/0 00000100:00100000:0.0:1763334984.823085:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5052 00000020:00080000:0.0:1763334984.823090:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763334984.826034:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d049 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334984.826061:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d049 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334984.826070:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d049 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334984.826075:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334984.826081:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d049 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334984.826093:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d049 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334984.826109:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:3.0:1763334984.826112:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334984.826117:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d049 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334984.826123:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d049 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334984.828949:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.829503:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694653824 00000100:00100000:3.0:1763334984.829514:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694653824 00000100:00100000:3.0:1763334984.829641:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5053 00000100:00100000:3.0:1763334984.829653:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694653824:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334984.829676:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334984.829701:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d050 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b074b expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.829760:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d050 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b074b expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.829778:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d050 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b074b expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.829798:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:3.0:1763334984.829801:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334984.829804:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:3.0:1763334984.829873:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694653824:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 223us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334984.829881:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5053 00000100:00100000:0.0:1763334984.841370:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334984.841561:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694653952 00000100:00100000:1.0:1763334984.841723:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694653952 00000100:00100000:1.0:1763334984.841780:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5190 00000100:00100000:1.0:1763334984.841791:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+17:53644:x1848989694653952:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334984.841808:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334984.841827:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d057 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0752 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334984.841858:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ceeb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06bf expref: 18 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334984.841867:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334984.841869:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334984.841874:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d057 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0752 expref: 18 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334984.841920:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ceeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06bf expref: 18 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334984.841935:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ceeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06bf expref: 18 pid: 25383 timeout: 1149 lvb_type: 1 00000100:00100000:1.0:1763334984.841950:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeece9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701899776:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334984.842053:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3791000 going to sleep for 11 seconds 00000100:00100000:1.0:1763334984.845937:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.846211:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeece9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701899776:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334984.846243:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d057 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0752 expref: 18 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.846264:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:0.0:1763334984.846324:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee545f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+18:53644:x1848989694653952:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 4534us (4965us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334984.846333:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5190 00000100:00100000:2.0:1763334984.846748:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694654080 00000100:00100000:2.0:1763334984.846756:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694654080 00010000:00010000:2.0:1763334984.846788:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ceeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06bf expref: 18 pid: 25383 timeout: 1149 lvb_type: 1 00000100:00100000:2.0:1763334984.846814:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2697 00000100:00100000:2.0:1763334984.846823:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694654080:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334984.846836:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334984.847543:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ceeb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06bf expref: 18 pid: 25383 timeout: 1149 lvb_type: 1 00010000:00010000:2.0:1763334984.847561:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ceeb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06bf expref: 18 pid: 25383 timeout: 1149 lvb_type: 1 00010000:00010000:2.0:1763334984.847623:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849ceeb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06bf expref: 18 pid: 25383 timeout: 1149 lvb_type: 1 00010000:00010000:2.0:1763334984.847640:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.847642:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334984.847649:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d057 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0752 expref: 17 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.847665:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d057 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0752 expref: 17 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334984.847703:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d057 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0752 expref: 17 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334984.847717:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701899904:192.168.201.60@tcp:105: 00000100:00100000:2.0:1763334984.847798:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68600 going to sleep for 11 seconds 00000100:00100000:2.0:1763334984.853416:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e15500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701899904:192.168.201.60@tcp:105: 00010000:00010000:2.0:1763334984.853443:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334984.853658:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2359:x1848989694654080:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 6834us (7729us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.853670:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2697 00000100:00100000:1.0:1763334984.855826:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.856211:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694654208 00000100:00100000:0.0:1763334984.856222:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694654208 00000100:00100000:0.0:1763334984.856284:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5191 00000100:00100000:0.0:1763334984.856294:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+26:53644:x1848989694654208:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334984.856313:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.856333:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849d05e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0759 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.856365:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cee4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06c6 expref: 27 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334984.856373:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334984.856376:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334984.856380:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849d05e lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0759 expref: 27 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.856415:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cee4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06c6 expref: 27 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334984.856428:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cee4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06c6 expref: 27 pid: 25383 timeout: 1149 lvb_type: 1 00000100:00100000:0.0:1763334984.856443:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee544380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701900032:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334984.856533:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aec7a3300 going to sleep for 11 seconds 00000100:00100000:1.0:1763334984.861832:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee544380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701900032:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334984.861874:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849d05e lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0759 expref: 27 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334984.861902:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:1.0:1763334984.863233:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+27:53644:x1848989694654208:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 6928us (7404us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334984.863246:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5191 00000100:00100000:1.0:1763334984.865451:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.865853:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694654336 00000100:00100000:3.0:1763334984.865865:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694654336 00010000:00010000:3.0:1763334984.865920:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cee4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06c6 expref: 27 pid: 25383 timeout: 1149 lvb_type: 1 00000100:00100000:3.0:1763334984.865969:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2698 00000100:00100000:3.0:1763334984.865980:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694654336:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334984.865994:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334984.866019:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cee4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06c6 expref: 27 pid: 25383 timeout: 1149 lvb_type: 1 00010000:00010000:3.0:1763334984.866035:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cee4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06c6 expref: 27 pid: 25383 timeout: 1149 lvb_type: 1 00010000:00010000:3.0:1763334984.866061:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066000/0xcedf0054f849cee4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06c6 expref: 27 pid: 25383 timeout: 1149 lvb_type: 1 00010000:00010000:3.0:1763334984.866079:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334984.866081:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334984.866088:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849d05e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0759 expref: 26 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.866099:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849d05e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0759 expref: 26 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.866145:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849d05e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0759 expref: 26 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334984.866159:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab36d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701900160:192.168.201.60@tcp:105: 00000100:00100000:3.0:1763334984.866260:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af64256c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334984.875125:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334984.875162:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334984.875210:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.875274:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694654464 00000100:00100000:2.0:1763334984.875284:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694654464 00002000:00010000:2.0:1763334984.875326:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (122687->18446744073709551615) 00000100:00100000:3.0:1763334984.875327:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab36d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701900160:192.168.201.60@tcp:105: 00002000:00100000:2.0:1763334984.875331:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece9880 with x1848989694654464 ext(122687->18446744073709551615) 00002000:00010000:2.0:1763334984.875343:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece9880. 00010000:00010000:3.0:1763334984.875350:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334984.875372:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694654720 00000100:00100000:2.0:1763334984.875376:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694654720 00002000:00010000:2.0:1763334984.875385:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:2.0:1763334984.875388:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece9c00 with x1848989694654720 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334984.875392:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece9c00. 00000100:00100000:2.0:1763334984.875404:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694654592 00000100:00100000:2.0:1763334984.875408:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694654592 00000100:00100000:3.0:1763334984.875411:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694654336:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 9433us (9971us total) trans 0 rc 0/0 00002000:00010000:2.0:1763334984.875418:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:2.0:1763334984.875420:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fea00 with x1848989694654592 ext(0->18446744073709551615) 00000100:00100000:3.0:1763334984.875421:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2698 00002000:00010000:2.0:1763334984.875427:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afb1fea00. 00000100:00100000:2.0:1763334984.875443:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1971 00000100:00100000:2.0:1763334984.875451:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694654464:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:3.0:1763334984.875465:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1972 00000100:00100000:3.0:1763334984.875471:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694654720:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:0.0:1763334984.875699:0:14384:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1973 00000100:00100000:0.0:1763334984.875709:0:14384:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694654592:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334984.875906:0:14384:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334984.875919:0:14384:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334984 -> 1763334985 00002000:00010000:0.0:1763334984.875922:0:14384:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:0.0:1763334984.875925:0:14384:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334984 -> 1763334985 00002000:00010000:0.0:1763334984.875928:0:14384:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334984.875955:0:14384:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb1fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694654592:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 249us (745us total) trans 21474838530 rc 0/0 00000100:00100000:0.0:1763334984.875962:0:14384:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1973 00002000:00010000:0.0:1763334984.875965:0:14384:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334984.875968:0:14384:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afb1fea00 with x1848989694654592 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334984.875972:0:14384:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5afb1fea00. 00002000:00010000:3.0:1763334984.876064:0:25999:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334984.876067:0:25999:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334984 -> 1763334985 00002000:00010000:3.0:1763334984.876070:0:25999:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:3.0:1763334984.876072:0:25999:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334984 -> 1763334985 00002000:00010000:3.0:1763334984.876075:0:25999:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334984.876098:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694654720:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 627us (934us total) trans 17179871292 rc 0/0 00000100:00100000:3.0:1763334984.876104:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1972 00002000:00010000:3.0:1763334984.876107:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:3.0:1763334984.876110:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece9c00 with x1848989694654720 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334984.876114:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece9c00. 00002000:00010000:2.0:1763334984.876335:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 262144 -> 122687 00002000:00010000:2.0:1763334984.876338:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334984 -> 1763334985 00002000:00010000:2.0:1763334984.876340:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:2.0:1763334984.876343:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334984 -> 1763334985 00002000:00010000:2.0:1763334984.876344:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 193 -> 275 00000100:00100000:2.0:1763334984.876367:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694654464:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 917us (1252us total) trans 17179871293 rc 0/0 00000100:00100000:2.0:1763334984.876374:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1971 00002000:00010000:2.0:1763334984.876377:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (122687->18446744073709551615) 00002000:00100000:2.0:1763334984.876380:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeece9880 with x1848989694654464 ext(122687->18446744073709551615) 00002000:00010000:2.0:1763334984.876385:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeece9880. 00000100:00100000:2.0:1763334984.883795:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.883873:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694654848 00000100:00100000:0.0:1763334984.883883:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694654848 00000100:00100000:0.0:1763334984.884533:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5054 00000100:00100000:0.0:1763334984.884547:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694654848:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334984.884567:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.884626:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d065 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0760 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.884714:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d06c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.884729:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d06c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.884740:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d06c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334984.884767:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 122687 00000004:00200000:0.0:1763334984.884771:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334984.884788:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d06c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.884813:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d065 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0760 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.884832:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d06c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0760 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.884841:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:0.0:1763334984.884844:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334984.884848:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334984.884900:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694654848:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 356us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334984.884924:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5054 00000100:00100000:1.0:1763334984.900161:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.900363:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694655104 00000100:00100000:2.0:1763334984.900376:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694655104 00000100:00100000:2.0:1763334984.900439:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1837 00000100:00100000:2.0:1763334984.900450:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8218450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694655104:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:2.0:1763334984.900881:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8218450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53644:x1848989694655104:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 431us (728us total) trans 8589939263 rc 0/0 00000100:00100000:2.0:1763334984.900889:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1837 00000100:00100000:1.0:1763334984.922451:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.922791:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694655360 00000100:00100000:0.0:1763334984.922802:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694655360 00000100:00100000:0.0:1763334984.922865:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5055 00000100:00100000:0.0:1763334984.922874:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa77f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53668:x1848989694655360:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334984.922898:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.922930:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d073 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0767 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.923012:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d07a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923026:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d07a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923038:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d07a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923055:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d081 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923062:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d081 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923069:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d081 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923228:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d088 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923238:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d088 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923246:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d088 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334984.923257:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 233688 00010000:00010000:0.0:1763334984.923363:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d07a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923371:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d07a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923378:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d07a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923384:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334984.923388:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d07a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923396:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d07a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923408:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:0.0:1763334984.923412:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334984.923416:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d07a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923422:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d07a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923435:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d081 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923440:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d081 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923451:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d081 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923456:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334984.923459:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d081 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923464:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d081 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923471:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac7d60900) 00010000:00010000:0.0:1763334984.923474:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334984.923476:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d081 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923482:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d081 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.923523:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d073 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0767 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.923537:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d088 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0767 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.923545:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:0.0:1763334984.923548:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334984.923551:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334984.923648:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa77f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53668:x1848989694655360:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 774us (1206us total) trans 8589939264 rc 0/0 00000100:00100000:0.0:1763334984.923657:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5055 00000100:00100000:1.0:1763334984.928622:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.928729:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694655488 00000100:00100000:3.0:1763334984.928740:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694655488 00000100:00100000:3.0:1763334984.928803:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 418 00000100:00100000:3.0:1763334984.928813:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2359:x1848989694655488:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334984.928829:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334984.928851:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d088 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0767 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.928871:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:3.0:1763334984.928876:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334984.928948:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2359:x1848989694655488:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 135us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334984.928955:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 418 00000100:00100000:1.0:1763334984.935719:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.935797:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694655744 00000100:00100000:3.0:1763334984.935808:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694655744 00000100:00100000:3.0:1763334984.935867:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5056 00000100:00100000:3.0:1763334984.935877:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53668:x1848989694655744:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334984.935900:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334984.935937:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d096 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b076e expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.936483:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d09d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334984.936498:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d09d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334984.936510:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d09d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:3.0:1763334984.936524:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b4:0x0]: returning size 0 00010000:00010000:3.0:1763334984.936568:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d096 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b076e expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.936633:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d09d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b076e expref: 195 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334984.936642:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b4:0x0].0x0 (ffff9a5af66de700) 00010000:00010000:3.0:1763334984.936645:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334984.936649:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:3.0:1763334984.936699:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53668:x1848989694655744:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 824us (990us total) trans 8589939265 rc 0/0 00000100:00100000:3.0:1763334984.936707:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5056 00000100:00100000:1.0:1763334984.947532:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.947612:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694656000 00000100:00100000:0.0:1763334984.947624:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694656000 00000100:00100000:0.0:1763334984.947689:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5057 00000100:00100000:0.0:1763334984.947700:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53668:x1848989694656000:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334984.947724:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.947746:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d0ab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0775 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.947845:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.947860:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d09d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b076e expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.947870:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.947903:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d09d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b076e expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.947935:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d09d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b076e expref: 196 pid: 29628 timeout: 1149 lvb_type: 0 00000100:00100000:0.0:1763334984.947949:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee545180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701900288:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334984.948035:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aec7a30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334984.952541:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.952652:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694656128 00000100:00100000:2.0:1763334984.952668:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694656128 00010000:00010000:2.0:1763334984.952722:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d09d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b076e expref: 197 pid: 29628 timeout: 1149 lvb_type: 0 00000100:00100000:2.0:1763334984.952770:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2699 00000100:00100000:2.0:1763334984.952780:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac4ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2360:x1848989694656128:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334984.952797:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334984.952804:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d09d lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b076e expref: 197 pid: 29628 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334984.952819:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d09d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b076e expref: 197 pid: 29628 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334984.952845:0:6532:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b4:0x0].0x0 (ffff9a5af66de700) 00010000:00010000:2.0:1763334984.952850:0:6532:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334984.952861:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334984.952869:0:6532:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334984.952892:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334984.953435:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d09d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b076e expref: 197 pid: 29628 timeout: 1149 lvb_type: 0 00000100:00100000:0.0:1763334984.953452:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee545180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701900288:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334984.953474:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.953483:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.953488:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334984.953506:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b4:0x0]: returning size 0 00000100:00100000:2.0:1763334984.953973:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac4ff7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2360:x1848989694656128:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1192us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334984.953983:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2699 00000004:00080000:0.0:1763334984.955725:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x251:0x0], index 1: 0 00000004:00080000:0.0:1763334984.955744:0:30972:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24d:0x0], index 0: 0 00010000:00010000:0.0:1763334984.955923:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.955935:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.955942:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.955948:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334984.955953:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.955960:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.955975:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b4:0x0].0x0 (ffff9a5af66de700) 00010000:00010000:0.0:1763334984.955978:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334984.955982:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.955988:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0b2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.956056:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d0ab lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0775 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.956066:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:0.0:1763334984.956069:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334984.956073:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d0ab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0775 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.956081:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334984.956158:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53668:x1848989694656000:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 8458us (8635us total) trans 8589939266 rc 301/301 00000100:00100000:0.0:1763334984.956168:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5057 00000100:00100000:1.0:1763334984.962455:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.962531:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694656384 00000100:00100000:0.0:1763334984.962543:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694656384 00000100:00100000:0.0:1763334984.963434:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1838 00000100:00100000:0.0:1763334984.963450:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53668:x1848989694656384:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1763334984.963843:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53668:x1848989694656384:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 397us (1400us total) trans 8589939267 rc 0/0 00000100:00100000:0.0:1763334984.963851:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1838 00000100:00100000:1.0:1763334984.971150:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.971253:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694656512 00000100:00100000:0.0:1763334984.971263:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694656512 00000100:00100000:0.0:1763334984.971320:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5058 00000100:00100000:0.0:1763334984.971331:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53668:x1848989694656512:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334984.971354:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.971378:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d0c0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b077c expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.971459:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.971473:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.971483:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334984.971518:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b4:0x0]: returning size 0 00000004:00200000:0.0:1763334984.971523:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334984.971537:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.971561:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d0c0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b077c expref: 198 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.971690:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b077c expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.971700:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b4:0x0].0x0 (ffff9a5ac7d60900) 00010000:00010000:0.0:1763334984.971703:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1763334984.971706:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334984.972066:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53668:x1848989694656512:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 735us (925us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334984.972074:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5058 00000100:00100000:3.0:1763334984.974507:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334984.974657:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694656640 00000100:00100000:1.0:1763334984.974675:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694656640 00000100:00100000:1.0:1763334984.974754:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5192 00000100:00100000:1.0:1763334984.974766:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694656640:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334984.974791:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334984.974820:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d0ce lrc: 2/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0783 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334984.974852:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x251:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334984.974876:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334984.974878:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334984.974888:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d0ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0783 expref: 29 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334984.974918:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d0ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0783 expref: 29 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334984.974933:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334984.975015:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694656640:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 251us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334984.975023:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5192 00000100:00100000:1.0:1763334984.979259:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334984.979370:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694656768 00000100:00100000:3.0:1763334984.979386:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694656768 00000100:00100000:3.0:1763334984.979465:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5193 00000100:00100000:3.0:1763334984.979478:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694656768:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334984.979500:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334984.979530:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d0d5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b078a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334984.979566:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334984.979644:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334984.979647:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334984.979659:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d0d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b078a expref: 19 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334984.979686:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d0d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b078a expref: 19 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334984.979702:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:3.0:1763334984.979795:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694656768:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 319us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334984.979806:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5193 00000100:00100000:2.0:1763334984.984260:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.985788:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694657024 00000100:00100000:0.0:1763334984.985804:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694657024 00000100:00100000:0.0:1763334984.985880:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5059 00000100:00100000:0.0:1763334984.985893:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53668:x1848989694657024:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334984.985927:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334984.985952:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d0dc lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0791 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.986088:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d0e3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.986104:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d0e3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334984.986116:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d0e3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334984.986128:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 233688 00010000:00010000:0.0:1763334984.986261:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d0dc lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0791 expref: 200 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.990097:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d0e3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0791 expref: 199 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334984.990110:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:0.0:1763334984.990114:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334984.990117:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334984.990207:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53668:x1848989694657024:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4315us (5962us total) trans 8589939268 rc 0/0 00000100:00100000:0.0:1763334984.990218:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5059 00000100:00100000:0.0:1763334984.999674:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.999717:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334984.999761:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334984.999861:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694657280 00000100:00100000:1.0:1763334984.999868:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694657152 00000100:00100000:2.0:1763334984.999881:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694657280 00000100:00100000:1.0:1763334984.999890:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694657152 00000100:00100000:1.0:1763334984.999978:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694657408 00000100:00100000:1.0:1763334984.999982:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694657408 00000100:00100000:3.0:1763334984.999996:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5194 00000100:00100000:3.0:1763334985.000014:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694657152:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:3.0:1763334985.000081:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.000109:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 30 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.000119:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1763334985.000120:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5195 00010000:00010000:3.0:1763334985.000126:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334985.000133:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334985.000143:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694657280:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334985.000202:0:32239:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.000226:0:32239:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d057 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0752 expref: 19 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.000235:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334985.000238:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334985.000242:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.000277:0:32239:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d057 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0752 expref: 19 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.000291:0:32239:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d057 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0752 expref: 19 pid: 25383 timeout: 1149 lvb_type: 0 00000100:00100000:1.0:1763334985.000306:0:32239:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701900544:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334985.000385:0:32239:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3791180 going to sleep for 11 seconds 00000100:00100000:1.0:1763334985.000403:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5196 00000100:00100000:1.0:1763334985.000410:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694657408:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334985.000431:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.000442:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849d05e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0759 expref: 30 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.000448:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334985.000450:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334985.000453:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.000468:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849d05e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0759 expref: 30 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.000476:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849d05e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0759 expref: 30 pid: 25383 timeout: 1149 lvb_type: 0 00000100:00100000:1.0:1763334985.000487:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701900672:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334985.000510:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac3791d80 going to sleep for 11 seconds 00010000:00010000:3.0:1763334985.000656:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 30 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.000685:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 30 pid: 25383 timeout: 1149 lvb_type: 0 00000100:00100000:3.0:1763334985.000708:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701900416:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334985.000802:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af64256c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334985.007452:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.007495:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.007621:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a23800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701900672:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334985.007663:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334985.009081:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694657536 00000100:00100000:2.0:1763334985.009100:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694657536 00010000:00010000:2.0:1763334985.009181:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d057 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0752 expref: 20 pid: 25383 timeout: 1149 lvb_type: 0 00000100:00100000:2.0:1763334985.009224:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694657664 00000100:00100000:2.0:1763334985.009227:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694657664 00010000:00010000:2.0:1763334985.009248:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849d05e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0759 expref: 31 pid: 25383 timeout: 1149 lvb_type: 0 00000100:00100000:2.0:1763334985.009289:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2700 00000100:00100000:2.0:1763334985.009301:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694657536:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334985.009323:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334985.009358:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d057 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0752 expref: 20 pid: 25383 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.009375:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d057 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0752 expref: 20 pid: 25383 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.009414:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.009419:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.009426:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.009443:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334985.009466:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334985.009474:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334985.009567:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694657536:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 265us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.009600:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2700 00000100:00100000:2.0:1763334985.009641:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2701 00000100:00100000:2.0:1763334985.009649:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694657664:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334985.009662:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334985.009678:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849d05e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0759 expref: 31 pid: 25383 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.009691:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849d05e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0759 expref: 31 pid: 25383 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.009711:0:6532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793a00/0xcedf0054f849d05e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0759 expref: 31 pid: 25383 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.009728:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.009730:0:6532:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.009734:0:6532:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.009742:0:6532:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.009769:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334985.009808:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694657664:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 158us (2312us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.009816:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2701 00010000:00010000:0.0:1763334985.009817:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.009834:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1763334985.009843:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1763334985.009849:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1763334985.009873:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334985.009874:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694657792 00000100:00100000:2.0:1763334985.009880:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694657792 00010000:00010000:0.0:1763334985.009892:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.009914:0:25383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.009923:0:25383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334985.009927:0:25383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1763334985.009935:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (196608->233687) req@ffff9a59c9e85500 x1848989694657792/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:31/0 lens 488/0 e 0 to 0 dl 1763334996 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00010000:00010000:0.0:1763334985.009940:0:25383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1763334985.009980:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e85500 with x1848989694657792 ext(196608->233687) 00010000:00010000:2.0:1763334985.009991:0:14183:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 30 pid: 25383 timeout: 1149 lvb_type: 0 00010000:00010000:0.0:1763334985.009995:0:25383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.010009:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d0ff lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.010014:0:14183:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 30 pid: 25383 timeout: 1149 lvb_type: 0 00002000:00010000:2.0:1763334985.010038:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a59c9e85500 00000100:00100000:2.0:1763334985.010067:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 72 00000100:00100000:2.0:1763334985.010077:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694657792:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:0.0:1763334985.010119:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694657408:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 9705us (10355us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334985.010131:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5196 00000100:00100000:3.0:1763334985.011052:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab37b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701900416:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334985.011084:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.011477:0:32239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d057 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0752 expref: 19 pid: 25383 timeout: 1149 lvb_type: 0 00000100:00100000:1.0:1763334985.011499:0:32239:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a20700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:32239:1848989701900544:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334985.011523:0:32239:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.011534:0:32239:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.011541:0:32239:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.011616:0:32239:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.011626:0:32239:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.011634:0:32239:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.011640:0:32239:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334985.011645:0:32239:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.011654:0:32239:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.011670:0:32239:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.011676:0:32239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d0f8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334985.011756:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694657280:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 11623us (12093us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334985.011765:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5195 00000100:00100000:2.0:1763334985.017774:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694657792:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 7683us (8302us total) trans 17179871294 rc 0/0 00000100:00100000:2.0:1763334985.017792:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 72 00002000:00100000:2.0:1763334985.017809:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (196608->233687) req@ffff9a59c9e85500 x1848989694657792/t17179871294(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:31/0 lens 488/448 e 0 to 0 dl 1763334996 ref 1 fl Complete:H/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334985.017827:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9e85500 with x1848989694657792 ext(196608->233687) 00010000:00010000:2.0:1763334985.017841:0:14183:0:(ldlm_extent.c:773:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 31 pid: 25383 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.017866:0:14183:0:(ldlm_lockd.c:606:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 31 pid: 25383 timeout: 1149 lvb_type: 0 00002000:00010000:2.0:1763334985.017876:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9a59c9e85500 00000100:00100000:0.0:1763334985.022238:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.022445:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694657920 00000100:00100000:2.0:1763334985.022459:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694657920 00010000:00010000:2.0:1763334985.022511:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 31 pid: 25383 timeout: 1149 lvb_type: 0 00000100:00100000:2.0:1763334985.022684:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2702 00000100:00100000:2.0:1763334985.022695:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2359:x1848989694657920:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334985.022718:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1763334985.022743:0:5733:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 122687 -> 233688 00002000:00010000:2.0:1763334985.022747:0:5733:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334984 -> 1763334985 00010000:00010000:2.0:1763334985.022754:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 31 pid: 25383 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.022770:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 31 pid: 25383 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.022798:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168e200/0xcedf0054f849d034 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 98304->151551) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b073d expref: 31 pid: 25383 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.022820:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.022823:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.022829:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.022839:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.023240:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334985.023328:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694657920:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 632us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.023337:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2702 00010000:00010000:0.0:1763334985.023456:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.023468:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.023514:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.023523:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.023532:0:26564:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.023540:0:26564:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6067600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334985.023544:0:26564:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.023553:0:26564:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.023601:0:26564:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.023611:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067600/0xcedf0054f849d0f1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334985.025408:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694657152:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 25382us (25671us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334985.025428:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5194 00000100:00100000:0.0:1763334985.029494:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.029541:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.029613:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334985.029697:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694658048 00000100:00100000:3.0:1763334985.029710:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694658048 00000100:00100000:3.0:1763334985.029776:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694658304 00000100:00100000:3.0:1763334985.029780:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694658304 00000100:00100000:3.0:1763334985.029810:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694658176 00000100:00100000:3.0:1763334985.029814:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694658176 00000100:00100000:3.0:1763334985.029843:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5197 00000100:00100000:3.0:1763334985.029854:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694658048:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334985.029878:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334985.029922:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849d106 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0798 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334985.029955:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 233688, mtime: 0x691a5b49, atime: 0x691a5b49, ctime: 0x691a5b49, blocks: 0x113 00010000:00010000:3.0:1763334985.029980:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334985.029983:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334985.029996:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849d106 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0798 expref: 31 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334985.030016:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849d106 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0798 expref: 31 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334985.030037:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066a00, rc 0) 00000100:00100000:3.0:1763334985.030104:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694658048:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 251us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334985.030112:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5197 00000100:00100000:3.0:1763334985.030135:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5198 00000100:00100000:3.0:1763334985.030143:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694658304:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334985.030150:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334985.030161:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d10d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b07a6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334985.030176:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x691a5b49, atime: 0x691a5b48, ctime: 0x691a5b49, blocks: 0x3 00010000:00010000:3.0:1763334985.030185:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334985.030187:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334985.030192:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d10d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07a6 expref: 31 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334985.030203:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d10d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07a6 expref: 31 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334985.030212:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067e00, rc 0) 00000100:00100000:3.0:1763334985.030234:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694658304:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 92us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334985.030240:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5198 00000100:00100000:3.0:1763334985.030270:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5199 00000100:00100000:3.0:1763334985.030278:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694658176:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334985.030287:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334985.030300:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849d114 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b079f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334985.030317:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x248:0x0] initial LVB size: 0, mtime: 0x691a5b49, atime: 0x691a5b48, ctime: 0x691a5b49, blocks: 0x3 00010000:00010000:3.0:1763334985.030329:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334985.030330:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334985.030335:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849d114 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b079f expref: 19 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334985.030346:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849d114 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b079f expref: 19 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334985.030355:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066400, rc 0) 00000100:00100000:3.0:1763334985.030376:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694658176:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 99us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334985.030382:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5199 00000100:00100000:2.0:1763334985.065442:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.066285:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694658432 00000100:00100000:0.0:1763334985.066300:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694658432 00000100:00100000:0.0:1763334985.066485:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1974 00000100:00100000:0.0:1763334985.066499:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2361:x1848989694658432:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334985.066550:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d11b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.066585:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334985.066588:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334985.066595:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d11b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.066611:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d11b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.074416:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d11b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.074445:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d11b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.074456:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d11b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.074465:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334985.074470:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d11b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.074481:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d11b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.074511:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d11b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.074520:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d11b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334985.075356:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2361:x1848989694658432:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 8849us (9919us total) trans 0 rc 233688/233688 00000100:00100000:0.0:1763334985.075372:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1974 00000100:00100000:3.0:1763334985.080463:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.080621:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694658560 00000100:00100000:0.0:1763334985.080636:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694658560 00000100:00100000:0.0:1763334985.080740:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1975 00000100:00100000:0.0:1763334985.080752:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2359:x1848989694658560:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:0.0:1763334985.080803:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.080827:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d0ce lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0783 expref: 31 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334985.080836:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334985.080839:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334985.080843:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.080885:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d0ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0783 expref: 31 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334985.080900:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d0ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0783 expref: 31 pid: 25383 timeout: 1149 lvb_type: 1 00000100:00100000:0.0:1763334985.080927:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701900800:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334985.081021:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aec7a3840 going to sleep for 11 seconds 00000100:00100000:0.0:1763334985.084397:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701900800:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334985.084438:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334985.084996:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.085225:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694658688 00000100:00100000:2.0:1763334985.085236:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694658688 00010000:00010000:2.0:1763334985.085289:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d0ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0783 expref: 32 pid: 25383 timeout: 1149 lvb_type: 1 00000100:00100000:2.0:1763334985.085329:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2703 00000100:00100000:2.0:1763334985.085340:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2360:x1848989694658688:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334985.085357:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334985.085381:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d0ce lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0783 expref: 32 pid: 25383 timeout: 1149 lvb_type: 1 00010000:00010000:2.0:1763334985.085394:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d0ce lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0783 expref: 32 pid: 25383 timeout: 1149 lvb_type: 1 00010000:00010000:2.0:1763334985.085427:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d0ce lrc: 0/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0783 expref: 32 pid: 25383 timeout: 1149 lvb_type: 1 00010000:00010000:2.0:1763334985.085445:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.085447:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.085453:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.085464:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.085483:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334985.086101:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.086115:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334985.087684:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2360:x1848989694658688:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 2331us (2677us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.087700:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2703 00000001:00080000:3.0:1763334985.139863:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871295 is committed 00002000:00010000:1.0:1763334985.140038:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb size from disk: 0 -> 233688 00002000:00010000:1.0:1763334985.140043:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb mtime from disk: 0 -> 1763334985 00002000:00010000:1.0:1763334985.140045:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb ctime from disk: 0 -> 1763334985 00002000:00010000:1.0:1763334985.140047:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb blocks from disk: 1 -> 515 00010000:00010000:1.0:1763334985.140060:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.140078:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.140087:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.140093:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334985.140097:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.140106:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.140127:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.140133:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d122 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334985.140471:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694658560:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 59717us (60023us total) trans 17179871295 rc 0/0 00000100:00100000:1.0:1763334985.140480:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1975 00000100:00100000:3.0:1763334985.145064:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.145276:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694658816 00000100:00100000:0.0:1763334985.145289:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694658816 00000100:00100000:0.0:1763334985.145381:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5060 00000100:00100000:0.0:1763334985.145392:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53668:x1848989694658816:12345-192.168.201.60@tcp:44:lfs.0 00000100:00080000:2.0:1763334985.145559:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1763334985.187948:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939268 is committed 00000020:00080000:1.0:1763334985.187977:0:29660:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969319 batchid updated 00000100:00100000:3.0:1763334985.188139:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53668:x1848989694658816:12345-192.168.201.60@tcp:44:lfs.0 Request processed in 42743us (43082us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334985.188149:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5060 00000020:00080000:0.0:1763334985.188320:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969319 00000020:00080000:0.0:1763334985.188519:0:29663:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969319 cancel update log [0x200000bd0:0x1:0x0].13: rc = 0 00000020:00080000:0.0:1763334985.188527:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969319 00000100:00100000:2.0:1763334985.193550:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.193679:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.193858:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694658944 00000100:00100000:0.0:1763334985.193870:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694658944 00000100:00100000:0.0:1763334985.193964:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694659072 00000100:00100000:0.0:1763334985.193968:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694659072 00000100:00100000:0.0:1763334985.194002:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5200 00000100:00100000:0.0:1763334985.194011:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2361:x1848989694658944:12345-192.168.201.60@tcp:16:lfs.0 00000100:00100000:0.0:1763334985.194121:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb346850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2361:x1848989694658944:12345-192.168.201.60@tcp:16:lfs.0 Request processed in 110us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334985.194128:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5200 00000100:00100000:0.0:1763334985.194260:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5201 00000100:00100000:0.0:1763334985.194268:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2361:x1848989694659072:12345-192.168.201.60@tcp:16:lfs.0 00000100:00100000:0.0:1763334985.194310:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2361:x1848989694659072:12345-192.168.201.60@tcp:16:lfs.0 Request processed in 42us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334985.194317:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5201 00000100:00100000:1.0:1763334985.234136:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334985.234291:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694659200 00000100:00100000:3.0:1763334985.234303:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694659200 00000100:00100000:3.0:1763334985.234600:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5202 00000100:00100000:3.0:1763334985.234614:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694659200:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:3.0:1763334985.234668:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d129 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.234685:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334985.234687:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334985.234692:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d129 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.234705:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d129 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.234738:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d129 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.234748:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d129 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.234757:0:26564:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d129 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.234764:0:26564:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5aec6d5600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334985.234768:0:26564:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d129 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.234778:0:26564:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d129 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.234800:0:26564:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d129 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.234808:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d129 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334985.241692:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.241789:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.242047:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694659328 00000100:00100000:2.0:1763334985.242059:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694659328 00000100:00100000:2.0:1763334985.242108:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694659456 00000100:00100000:2.0:1763334985.242111:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694659456 00000100:00100000:2.0:1763334985.242139:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5203 00000100:00100000:2.0:1763334985.242147:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694659328:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334985.242194:0:6517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d130 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242215:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.242217:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.242222:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d130 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242237:0:6517:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d130 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242270:0:6517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d130 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242278:0:6517:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d130 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242287:0:6517:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d130 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242294:0:6517:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334985.242298:0:6517:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d130 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242307:0:6517:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d130 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242322:0:6517:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d130 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242335:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d130 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334985.242417:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694659328:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 269us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.242425:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5203 00000100:00100000:2.0:1763334985.242454:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5204 00000100:00100000:2.0:1763334985.242462:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694659456:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334985.242481:0:6517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d137 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242489:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.242491:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.242494:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d137 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242502:0:6517:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d137 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242520:0:6517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d137 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242526:0:6517:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d137 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242533:0:6517:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242539:0:6517:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334985.242541:0:6517:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d137 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242548:0:6517:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d137 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242557:0:6517:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d137 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.242564:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d137 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334985.242626:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694659456:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 165us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.242632:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5204 00000100:00100000:3.0:1763334985.243539:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694659200:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 8923us (9410us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334985.243550:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5202 00000100:00100000:1.0:1763334985.245333:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334985.245392:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694659712 00000100:00100000:3.0:1763334985.245402:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694659712 00000100:00100000:3.0:1763334985.245460:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5061 00000100:00100000:3.0:1763334985.245470:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53668:x1848989694659712:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:3.0:1763334985.245522:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334985.245548:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d0c7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1b4:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b077c expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.245568:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b4:0x0].0x0 (ffff9a5ac7d60900) 00010000:00010000:3.0:1763334985.245615:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334985.245663:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d13e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.245676:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d13e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.245685:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d13e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00010000:3.0:1763334985.245925:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000009453c7a3 reply state 000000006e174777 transno 8589939269 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d13e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334985.245936:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1763334985.246067:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53668:x1848989694659712:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 598us (740us total) trans 8589939269 rc 0/0 00000100:00100000:3.0:1763334985.246075:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5061 00000100:00100000:1.0:1763334985.250887:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1763334985.250975:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d13e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334985.250989:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d13e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334985.251001:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d13e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334985.251006:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5aec6d5200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334985.251011:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d13e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334985.251018:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d13e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334985.251036:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b4:0x0].0x0 (ffff9a5af66deb00) 00010000:00010000:0.0:1763334985.251039:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334985.251044:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d13e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334985.251049:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d13e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334985.251380:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694659840 00000100:00100000:3.0:1763334985.251390:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694659840 00000100:00100000:0.0:1763334985.251702:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5062 00000100:00100000:0.0:1763334985.251715:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53668:x1848989694659840:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334985.251740:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334985.251760:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d145 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b07ad expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.251818:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d145 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07ad expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.251831:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d145 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07ad expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.251852:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b4:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:0.0:1763334985.251855:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334985.251858:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334985.252886:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53668:x1848989694659840:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1164us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334985.252898:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5062 00000100:00100000:2.0:1763334985.256481:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.256630:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694659968 00000100:00100000:0.0:1763334985.256641:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694659968 00000100:00100000:0.0:1763334985.256696:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5205 00000100:00100000:0.0:1763334985.256706:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2361:x1848989694659968:12345-192.168.201.60@tcp:2:lfs.0 00000100:00100000:0.0:1763334985.256998:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2361:x1848989694659968:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 293us (525us total) trans 17179871296 rc 0/0 00000100:00100000:0.0:1763334985.257005:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5205 00000100:00100000:1.0:1763334985.258329:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334985.258609:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694660096 00000100:00100000:3.0:1763334985.258619:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694660096 00000100:00100000:3.0:1763334985.258658:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5206 00000100:00100000:3.0:1763334985.258667:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694660096:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:3.0:1763334985.258875:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334985.258879:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb mtime from disk: 0 -> 1763334985 00002000:00010000:3.0:1763334985.258881:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb atime from disk: 0 -> 1763334985 00002000:00010000:3.0:1763334985.258884:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb ctime from disk: 0 -> 1763334985 00002000:00010000:3.0:1763334985.258886:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334985.258945:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2362:x1848989694660096:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 279us (622us total) trans 21474838531 rc 0/0 00000100:00100000:3.0:1763334985.258952:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5206 00000100:00100000:1.0:1763334985.266501:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.266618:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694660352 00000100:00100000:0.0:1763334985.266631:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694660352 00000100:00100000:3.0:1763334985.267268:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5063 00000100:00100000:3.0:1763334985.267294:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53668:x1848989694660352:12345-192.168.201.60@tcp:55:lfs.0 00010000:00010000:3.0:1763334985.267397:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d14c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.267417:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d14c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.267433:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d14c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.267466:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d14c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.267472:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d14c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.267480:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d14c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.267486:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5aec6d5600 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334985.267490:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d14c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.267497:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d14c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.267509:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b4:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:3.0:1763334985.267512:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1763334985.267516:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d14c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.267521:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d14c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334985.268416:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53668:x1848989694660352:12345-192.168.201.60@tcp:55:lfs.0 Request processed in 1125us (1919us total) trans 0 rc -22/-22 00000100:00100000:2.0:1763334985.268429:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5063 00000100:00100000:2.0:1763334985.273553:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.273649:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694660608 00000100:00100000:0.0:1763334985.273659:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694660608 00000100:00100000:0.0:1763334985.273713:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5064 00000100:00100000:0.0:1763334985.273722:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53668:x1848989694660608:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334985.273772:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334985.273798:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d06c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0760 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.273816:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:0.0:1763334985.273822:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334985.273864:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d153 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334985.273877:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d153 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334985.273887:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d153 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00010000:0.0:1763334985.274063:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e820e4f3 reply state 0000000077cc7d0d transno 8589939270 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d153 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:0.0:1763334985.274072:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334985.274166:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53668:x1848989694660608:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 445us (623us total) trans 8589939270 rc 0/0 00000100:00100000:0.0:1763334985.274174:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5064 00010000:00010000:3.0:1763334985.277526:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d153 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.277543:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d153 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.277550:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d153 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.277557:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334985.277561:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d153 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.277569:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d153 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.278204:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:3.0:1763334985.278209:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334985.278216:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d153 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.278223:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d153 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334985.279135:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.280643:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694660736 00000100:00100000:0.0:1763334985.280656:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694660736 00000100:00100000:0.0:1763334985.280712:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5207 00000100:00100000:0.0:1763334985.280721:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694660736:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334985.280921:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 233688 -> 233688 00002000:00010000:0.0:1763334985.280926:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334985.280928:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334985.280931:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334985.280933:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 275 -> 161 00000100:00100000:0.0:1763334985.280998:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694660736:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 277us (1870us total) trans 17179871297 rc 0/0 00000100:00100000:0.0:1763334985.281006:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5207 00000100:00100000:1.0:1763334985.284136:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334985.284182:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.284971:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694660992 00000100:00100000:0.0:1763334985.284984:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694660992 00000100:00100000:0.0:1763334985.285041:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694660864 00000100:00100000:0.0:1763334985.285044:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694660864 00000100:00100000:0.0:1763334985.285069:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5208 00000100:00100000:0.0:1763334985.285078:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694660992:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334985.285294:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334985.285298:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334985.285300:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334984 -> 1763334985 00002000:00010000:0.0:1763334985.285303:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334985.285305:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334985.285372:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694660992:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 294us (1247us total) trans 17179871298 rc 0/0 00000100:00100000:0.0:1763334985.285378:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5208 00000100:00100000:0.0:1763334985.285396:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5209 00000100:00100000:0.0:1763334985.285402:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694660864:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:0.0:1763334985.285522:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334985.285525:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334985.285527:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334984 -> 1763334985 00002000:00010000:0.0:1763334985.285529:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334985.285531:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334985.285552:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694660864:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 150us (1369us total) trans 21474838532 rc 0/0 00000100:00100000:0.0:1763334985.285558:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5209 00000100:00100000:1.0:1763334985.296084:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.296178:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694661248 00000100:00100000:2.0:1763334985.296189:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694661248 00000100:00100000:2.0:1763334985.296250:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1839 00000100:00100000:2.0:1763334985.296261:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53668:x1848989694661248:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:2.0:1763334985.296333:0:29630:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1ab:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d0e3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0791 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.296369:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.296381:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d050 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b074b expref: 192 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.296390:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.299250:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d050 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b074b expref: 192 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.299274:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d050 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b074b expref: 192 pid: 29628 timeout: 1149 lvb_type: 0 00000100:00100000:2.0:1763334985.299291:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeeceaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701900928:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334985.299396:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68300 going to sleep for 11 seconds 00000100:00100000:1.0:1763334985.299471:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.300383:0:29624:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694661376 00000100:00100000:2.0:1763334985.300393:0:29624:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694661376 00000100:00100000:2.0:1763334985.300468:0:29624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 144 00000100:00100000:2.0:1763334985.300479:0:29624:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1264d40-158f-4e44-9f7a-49909c525321+9:2361:x1848989694661376:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1763334985.300538:0:29624:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6070450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1264d40-158f-4e44-9f7a-49909c525321+9:2361:x1848989694661376:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 61us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.300545:0:29624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 144 00000100:00100000:2.0:1763334985.307563:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeeceaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701900928:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334985.307631:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:1.0:1763334985.308197:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.308278:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694661504 00000100:00100000:2.0:1763334985.308286:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694661504 00010000:00010000:2.0:1763334985.308323:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d050 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b074b expref: 193 pid: 29628 timeout: 1149 lvb_type: 0 00000100:00100000:2.0:1763334985.308357:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2704 00000100:00100000:2.0:1763334985.308366:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2359:x1848989694661504:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334985.308382:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334985.308389:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d050 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b074b expref: 193 pid: 29628 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.308401:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d050 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b074b expref: 193 pid: 29628 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.308422:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d050 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b074b expref: 193 pid: 29628 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.308438:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:2.0:1763334985.308443:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.308452:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.308460:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.309234:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334985.309380:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334985.309390:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334985.309413:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334985.309434:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d145 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07ad expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.309442:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334985.309472:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d145 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07ad expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.309485:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d145 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07ad expref: 192 pid: 30972 timeout: 1149 lvb_type: 0 00000100:00100000:0.0:1763334985.309498:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e84380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701901056:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334985.309563:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2359:x1848989694661504:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1197us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.309608:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2704 00000100:00100000:0.0:1763334985.310161:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee480 going to sleep for 11 seconds 00000100:00100000:0.0:1763334985.313925:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e84380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701901056:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334985.313967:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:1.0:1763334985.314352:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.314470:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694661632 00000100:00100000:2.0:1763334985.314479:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694661632 00010000:00010000:2.0:1763334985.314516:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d145 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07ad expref: 192 pid: 30972 timeout: 1149 lvb_type: 0 00000100:00100000:2.0:1763334985.314555:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2705 00000100:00100000:2.0:1763334985.314565:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694661632:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334985.314616:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334985.314624:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d145 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07ad expref: 192 pid: 30972 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.314637:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d145 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07ad expref: 192 pid: 30972 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.314661:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d145 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1b4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07ad expref: 192 pid: 30972 timeout: 1149 lvb_type: 0 00010000:00010000:2.0:1763334985.314678:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b4:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:2.0:1763334985.314683:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.314692:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.314702:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.314722:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334985.315046:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334985.315054:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:0.0:1763334985.315553:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e84380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1763334985.315632:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334985.315673:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee300 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.315936:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694661632:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1370us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.315947:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2705 00000100:00100000:3.0:1763334985.316027:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701901184 00000100:00100000:3.0:1763334985.316034:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701901184 00000100:00100000:3.0:1763334985.316083:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1763334985.316092:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701901184:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1763334985.316161:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701901184:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 70us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334985.316168:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:2.0:1763334985.316404:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763334985.317316:0:29630:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871289 gen 2 00000004:00080000:0.0:1763334985.317325:0:29630:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179871284 committed transno 17179871289 00000004:00080000:0.0:1763334985.317347:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee546680, transno 17179871285 00000004:00080000:0.0:1763334985.318227:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee545c00, transno 17179871286 00000004:00080000:0.0:1763334985.318236:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee544700, transno 17179871287 00000004:00080000:0.0:1763334985.318239:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee545500, transno 17179871288 00000004:00080000:0.0:1763334985.318242:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee544e00, transno 17179871289 00000100:00100000:0.0:1763334985.318261:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e84380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901184:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1763334985.318338:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e84380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1763334985.318398:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334985.318431:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5afc8ee300 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.318561:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701901312 00000100:00100000:2.0:1763334985.318568:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701901312 00000100:00100000:2.0:1763334985.318654:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1763334985.318664:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:29630:x1848989701901312:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.318737:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:29630:x1848989701901312:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 75us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.318745:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1763334985.318790:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e84380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901312:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.318838:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeeceaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.318863:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.318878:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68840 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.318889:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701901440 00000100:00100000:2.0:1763334985.318892:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701901440 00000100:00100000:2.0:1763334985.318927:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1763334985.318932:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:29630:x1848989701901440:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319001:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:29630:x1848989701901440:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 68us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.319007:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1763334985.319040:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeeceaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901440:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319073:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeeceaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319098:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.319112:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68d80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.319124:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701901568 00000100:00100000:2.0:1763334985.319127:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701901568 00000100:00100000:2.0:1763334985.319149:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1763334985.319156:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701901568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319204:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeece8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701901568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 49us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.319210:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1763334985.319237:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeeceaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319270:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeeceaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319292:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.319305:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aef08bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.319316:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701901696 00000100:00100000:2.0:1763334985.319319:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701901696 00000100:00100000:2.0:1763334985.319338:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1763334985.319344:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:29630:x1848989701901696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319386:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:29630:x1848989701901696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 42us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.319391:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1763334985.319417:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeeceaa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319445:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319466:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.319479:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aec7a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.319488:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701901824 00000100:00100000:2.0:1763334985.319491:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701901824 00000100:00100000:2.0:1763334985.319509:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1763334985.319514:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701901824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319549:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701901824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 35us (82us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.319554:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1763334985.319601:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319630:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319650:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.319663:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aec7a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.319674:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701901952 00000100:00100000:2.0:1763334985.319678:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701901952 00000100:00100000:2.0:1763334985.319698:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1763334985.319704:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701901952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319763:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701901952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 60us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.319769:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1763334985.319796:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701901952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319823:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319845:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.319858:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aec7a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.319870:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701902080 00000100:00100000:2.0:1763334985.319874:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701902080 00000100:00100000:2.0:1763334985.319893:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1763334985.319912:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:29630:x1848989701902080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.319957:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:29630:x1848989701902080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 58us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.319962:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1763334985.319985:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.320013:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.320032:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.320045:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aec7a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.320054:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701902208 00000100:00100000:2.0:1763334985.320058:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701902208 00000100:00100000:2.0:1763334985.320076:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1763334985.320082:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:29630:x1848989701902208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.320121:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:29630:x1848989701902208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 39us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.320127:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1763334985.320152:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.320177:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.320198:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.320210:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aec7a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.320219:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701902336 00000100:00100000:2.0:1763334985.320222:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701902336 00000100:00100000:2.0:1763334985.320240:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1763334985.320245:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701902336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.320286:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701902336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 40us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.320292:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1763334985.320317:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.320347:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.320367:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.320380:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aec7a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.320390:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701902464 00000100:00100000:2.0:1763334985.320393:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701902464 00000100:00100000:2.0:1763334985.320412:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1763334985.320418:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701902464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.320470:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeeceaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701902464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 52us (101us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.320476:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1763334985.320499:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.320526:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.320545:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.320557:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aec7a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.320565:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701902592 00000100:00100000:2.0:1763334985.320568:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701902592 00000100:00100000:2.0:1763334985.320610:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1763334985.320615:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:29630:x1848989701902592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.320653:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:29630:x1848989701902592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 37us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.320659:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1763334985.320682:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902592:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:2.0:1763334985.320973:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].14, 728 off39016 00000001:00080000:2.0:1763334985.320987:0:29630:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939271 00000100:00100000:2.0:1763334985.321046:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae0bbc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.321073:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.321087:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aec7a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.321098:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701902720 00000100:00100000:2.0:1763334985.321102:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701902720 00000100:00100000:2.0:1763334985.321123:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1763334985.321129:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701902720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.321331:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701902720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 201us (257us total) trans 17179871299 rc 0/0 00000100:00100000:2.0:1763334985.321337:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1763334985.321368:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae0bbc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.321399:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae0bbd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.321422:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.321440:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701902848 00000100:00100000:2.0:1763334985.321443:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701902848 00000100:00100000:2.0:1763334985.321463:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1763334985.321469:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+11:29630:x1848989701902848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334985.321642:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+12:29630:x1848989701902848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 172us (218us total) trans 21474838533 rc 0/0 00000100:00100000:2.0:1763334985.321648:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1763334985.321665:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeec68cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.321680:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae0bbd180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701902848:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1763334985.321760:0:29630:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939272 00010000:00010000:2.0:1763334985.321787:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.321798:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.321807:0:29630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.321813:0:29630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334985.321818:0:29630:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.321826:0:29630:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.321841:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b4:0x0].0x0 (ffff9a5ac7d60700) 00010000:00010000:2.0:1763334985.321845:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763334985.321849:0:29630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.321855:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d161 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1b4:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.321873:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.321878:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.321884:0:29630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.321893:0:29630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334985.321896:0:29630:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00000100:00080000:3.0:1763334985.321957:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1763334985.322093:0:29630:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.322102:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:2.0:1763334985.322105:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1763334985.322108:0:29630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.322114:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d15a lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.322125:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66de000) 00010000:00010000:2.0:1763334985.322128:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334985.322134:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d0e3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0791 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334985.324727:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53668:x1848989694661248:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 28456us (28641us total) trans 8589939273 rc 0/0 00000100:00100000:2.0:1763334985.324742:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1839 00000020:00080000:2.0:1763334985.324751:0:29630:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000004:00080000:1.0:1763334985.325094:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 5 done 00000100:00100000:1.0:1763334985.336007:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.336139:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694661760 00000100:00100000:2.0:1763334985.336156:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694661760 00000100:00100000:0.0:1763334985.338047:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5065 00000100:00100000:0.0:1763334985.338073:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53668:x1848989694661760:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334985.338103:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334985.338130:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d168 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b07b4 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.338200:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d168 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07b4 expref: 193 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.338216:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d168 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07b4 expref: 193 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.338236:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334985.338239:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334985.338243:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334985.338308:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53668:x1848989694661760:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 248us (2315us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334985.338317:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5065 00000100:00100000:0.0:1763334985.346730:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.348387:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694662016 00000100:00100000:2.0:1763334985.348402:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694662016 00000100:00100000:2.0:1763334985.348467:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1840 00000100:00100000:2.0:1763334985.348480:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53668:x1848989694662016:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334985.348730:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53668:x1848989694662016:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 254us (2017us total) trans 8589939274 rc 0/0 00000100:00100000:2.0:1763334985.348738:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1840 00000100:00100000:1.0:1763334985.359627:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.360526:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694662272 00000100:00100000:2.0:1763334985.360546:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694662272 00000100:00100000:2.0:1763334985.360649:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1841 00000100:00100000:2.0:1763334985.360660:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53668:x1848989694662272:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:2.0:1763334985.360953:0:29630:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x1b4:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1763334985.361073:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d16f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.361089:0:29630:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d16f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.361101:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d16f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.361108:0:29630:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d16f lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.361115:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d16f lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.361121:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d16f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29630 initiator: MDT0 00010000:00010000:2.0:1763334985.361144:0:29630:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1763334985.361280:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53668:x1848989694662272:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 621us (1663us total) trans 8589939275 rc 0/0 00000100:00100000:2.0:1763334985.361289:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1841 00010000:00010000:3.0:1763334985.361606:0:8206:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334985.361621:0:8206:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d16f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334985.361632:0:8206:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334985.361637:0:8206:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d16f lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334985.362730:0:8206:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d16f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334985.362766:0:8206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b4:0x0].0x0 (ffff9a5ac6cab800) 00010000:00010000:3.0:1763334985.362769:0:8206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763334985.362776:0:8206:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d16f lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334985.362782:0:8206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d16f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334985.362810:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334985.362812:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334985.362815:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334985.390945:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.391054:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694662400 00000100:00100000:2.0:1763334985.391064:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694662400 00000100:00100000:2.0:1763334985.391124:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5066 00000100:00100000:2.0:1763334985.391133:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53669:x1848989694662400:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334985.391155:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334985.391176:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d176 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b07bb expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.391241:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d17d lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391257:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d17d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391270:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d17d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391285:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d184 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391292:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d184 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391299:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d184 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391407:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d18b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391416:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d18b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391423:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d18b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334985.391455:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 233688 00000004:00200000:2.0:1763334985.391459:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334985.391475:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d18b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391487:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d18b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391495:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d17d lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391501:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d17d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391508:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d17d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391514:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334985.391518:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d17d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391525:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d17d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391537:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334985.391540:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334985.391545:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d17d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391553:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d17d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391565:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d184 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391618:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d184 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391625:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d184 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391631:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334985.391635:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d184 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391641:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d184 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391650:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac6cab500) 00010000:00010000:2.0:1763334985.391652:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334985.391656:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d184 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391662:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d184 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.391691:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d176 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07bb expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.391705:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d18b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07bb expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.391713:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334985.391716:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334985.391718:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334985.391787:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53669:x1848989694662400:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 654us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.391796:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5066 00000100:00100000:1.0:1763334985.397319:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.397404:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694662656 00000100:00100000:0.0:1763334985.397415:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694662656 00000100:00100000:0.0:1763334985.397470:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5067 00000100:00100000:0.0:1763334985.397480:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53669:x1848989694662656:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334985.397503:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334985.397526:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d192 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b07c2 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.397669:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d199 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334985.397686:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d199 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334985.397699:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d199 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:0.0:1763334985.397712:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 233688 00010000:00010000:0.0:1763334985.397841:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d192 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07c2 expref: 199 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.397861:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d199 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07c2 expref: 198 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334985.397870:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334985.397873:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1763334985.397877:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334985.397942:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53669:x1848989694662656:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 463us (633us total) trans 8589939276 rc 0/0 00000100:00100000:0.0:1763334985.397950:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5067 00000100:00100000:3.0:1763334985.409059:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.409170:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694662912 00000100:00100000:2.0:1763334985.409181:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694662912 00000100:00100000:2.0:1763334985.409246:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5068 00000100:00100000:2.0:1763334985.409256:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53669:x1848989694662912:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334985.409282:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334985.409304:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1a7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b07c9 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.409404:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d1ae lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.409419:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d1ae lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.409431:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d1ae lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334985.409445:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 233688 00010000:00010000:2.0:1763334985.409739:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1a7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07c9 expref: 201 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.409758:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d1ae lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07c9 expref: 200 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.409767:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334985.409771:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1763334985.409774:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431a00, rc 0) 00000100:00100000:2.0:1763334985.412036:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53669:x1848989694662912:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2769us (2975us total) trans 8589939277 rc 0/0 00000100:00100000:2.0:1763334985.412050:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5068 00000100:00100000:1.0:1763334985.439460:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334985.439599:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694663040 00000100:00100000:3.0:1763334985.439612:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694663040 00000100:00100000:3.0:1763334985.439685:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5210 00000100:00100000:3.0:1763334985.439696:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694663040:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334985.439716:0:32239:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334985.439737:0:32239:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d1bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x250:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b07d0 expref: -99 pid: 32239 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.439762:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334985.439765:0:32239:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334985.439775:0:32239:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d1bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07d0 expref: 30 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334985.439797:0:32239:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d1bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07d0 expref: 30 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334985.439819:0:32239:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5aec6d5600, rc 0) 00000100:00100000:3.0:1763334985.439924:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694663040:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 204us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334985.439933:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5210 00000100:00100000:1.0:1763334985.447173:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afab36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701902976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1763334985.447249:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334985.447381:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701902976 00000100:00100000:3.0:1763334985.447390:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701902976 00000100:00100000:3.0:1763334985.447444:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1763334985.447454:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1848989701902976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1763334985.447477:0:6521:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 96665600 pending 0 free 3855613952 avail 3849322496 00000100:00100000:3.0:1763334985.447522:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1848989701902976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334985.447529:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1763334985.447621:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afab36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701902976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1763334985.447778:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae0bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701903488:0@lo:400:kworker.0 00000100:00100000:2.0:1763334985.447811:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.447837:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763334985.447843:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae0bbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1848989701903360:0@lo:400:kworker.0 00000100:00100000:2.0:1763334985.447867:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.447890:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701903488 00000100:00100000:2.0:1763334985.447894:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701903488 00000100:00100000:2.0:1763334985.447937:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1763334985.447943:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3292:x1848989701903488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334985.447978:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3292:x1848989701903488:12345-0@lo:400:kworker.0 Request processed in 35us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.447984:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1763334985.448011:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae0bbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701903488:0@lo:400:kworker.0 00000100:00100000:2.0:1763334985.448033:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701903360 00000100:00100000:2.0:1763334985.448037:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701903360 00000100:00080000:2.0:1763334985.448057:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1763334985.448082:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1763334985.448087:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1848989701903360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334985.448120:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8419c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1848989701903360:12345-0@lo:400:kworker.0 Request processed in 33us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.448126:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1763334985.448149:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae0bbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3292:1848989701903360:0@lo:400:kworker.0 00000100:00100000:1.0:1763334985.448206:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae0bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1848989701903232:0@lo:400:kworker.0 00000100:00100000:1.0:1763334985.448230:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334985.448250:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1763334985.448255:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ae0bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:53c3ae04-da5d-4a5f-b9b8-469954a64a68:3290:1848989701903104:0@lo:400:kworker.0 00000100:00100000:1.0:1763334985.448275:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334985.448291:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1848989701903616:0@lo:400:kworker.0 00000100:00100000:1.0:1763334985.448305:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334985.448354:0:29624:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701903104 00000100:00100000:2.0:1763334985.448358:0:29624:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701903104 00000100:00100000:0.0:1763334985.448457:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701903232 00000100:00100000:0.0:1763334985.448460:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701903232 00000100:00100000:0.0:1763334985.448485:0:32232:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701903616 00000100:00100000:0.0:1763334985.448487:0:32232:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701903616 00000100:00100000:0.0:1763334985.448500:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1763334985.448505:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1848989701903232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763334985.448537:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1848989701903232:12345-0@lo:400:kworker.0 Request processed in 32us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334985.448542:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1763334985.448552:0:32232:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1763334985.448556:0:32232:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1848989701903616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763334985.448591:0:32232:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1848989701903616:12345-0@lo:400:kworker.0 Request processed in 34us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334985.448596:0:32232:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:0.0:1763334985.448630:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1763334985.448637:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701903744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1763334985.448656:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334985.448675:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac95b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3290:1848989701903616:0@lo:400:kworker.0 00000100:00100000:0.0:1763334985.448682:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae0bbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1848989701903232:0@lo:400:kworker.0 00000100:00100000:0.0:1763334985.448700:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701903744 00000100:00100000:0.0:1763334985.448702:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701903744 00000100:00100000:0.0:1763334985.448719:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1763334985.448724:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3290:x1848989701903744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1763334985.448747:0:6520:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 54198272 pending 0 free 3855613952 avail 3853516800 00000100:00100000:0.0:1763334985.448772:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+12:3290:x1848989701903744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334985.448778:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1763334985.448806:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701903744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1763334985.448955:0:29624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1763334985.448963:0:29624:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:53c3ae04-da5d-4a5f-b9b8-469954a64a68+18:3290:x1848989701903104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1763334985.449088:0:29624:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6071850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:53c3ae04-da5d-4a5f-b9b8-469954a64a68+18:3290:x1848989701903104:12345-0@lo:400:kworker.0 Request processed in 125us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334985.449094:0:29624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1763334985.449205:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ae0bbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:53c3ae04-da5d-4a5f-b9b8-469954a64a68:3290:1848989701903104:0@lo:400:kworker.0 00000100:00100000:1.0:1763334985.516075:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.516265:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694663168 00000100:00100000:2.0:1763334985.516279:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694663168 00000100:00100000:2.0:1763334985.516373:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1976 00000100:00100000:2.0:1763334985.516387:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2362:x1848989694663168:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334985.516437:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1c3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.516456:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.516458:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.516465:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.516483:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.528142:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1c3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.528161:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1c3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.528169:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.528181:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334985.528195:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1c3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.528204:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1c3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.528223:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1c3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.528230:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1c3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334985.531734:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2362:x1848989694663168:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 15336us (15656us total) trans 0 rc 233688/233688 00000100:00100000:2.0:1763334985.531750:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1976 00000100:00100000:3.0:1763334985.538952:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.539347:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694663296 00000100:00100000:2.0:1763334985.539356:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694663296 00000100:00100000:2.0:1763334985.539426:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1977 00000100:00100000:2.0:1763334985.539435:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694663296:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:2.0:1763334985.539481:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x251:0x0] initial LVB size: 233688, mtime: 0x691a5b49, atime: 0x691a5b49, ctime: 0x691a5b49, blocks: 0x203 00010000:00010000:2.0:1763334985.539490:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ca lrc: 3/1,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.539504:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.539506:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.539512:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.539524:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.546384:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ca lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.546408:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ca lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.546418:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.546425:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334985.546430:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ca lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.546439:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ca lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.546462:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ca lrc: 2/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.546469:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ca lrc: 0/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334985.547051:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694663296:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 7609us (8100us total) trans 0 rc 233688/233688 00000100:00100000:2.0:1763334985.547068:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1977 00000100:00100000:2.0:1763334985.569675:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334985.569755:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694663424 00000100:00100000:3.0:1763334985.569777:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694663424 00000100:00100000:3.0:1763334985.569844:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 419 00000100:00100000:3.0:1763334985.569853:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53669:x1848989694663424:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:3.0:1763334985.569869:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334985.569893:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d1ae lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07c9 expref: 200 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.569928:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:3.0:1763334985.569933:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334985.569991:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d45850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53669:x1848989694663424:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 138us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334985.570002:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 419 00000100:00100000:3.0:1763334985.579855:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334985.580130:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334985.580184:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694663680 00000100:00100000:1.0:1763334985.580195:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694663680 00000100:00100000:1.0:1763334985.580259:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1842 00000100:00100000:1.0:1763334985.580270:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8219850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53669:x1848989694663680:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334985.580541:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8219850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53669:x1848989694663680:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 273us (694us total) trans 8589939278 rc 0/0 00000100:00100000:1.0:1763334985.580548:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1842 00000100:00100000:1.0:1763334985.615464:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334985.615622:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694663936 00000100:00100000:3.0:1763334985.615633:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694663936 00000100:00100000:3.0:1763334985.615686:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5069 00000100:00100000:3.0:1763334985.615696:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53670:x1848989694663936:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334985.615721:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334985.615741:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d1d1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b07d7 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.615864:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d1d8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.615879:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d1d8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.615889:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d1d8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334985.615917:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 233688 00010000:00010000:3.0:1763334985.616041:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d1d1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07d7 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.616060:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d1d8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07d7 expref: 202 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.616070:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:3.0:1763334985.616073:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763334985.616078:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6067200, rc 0) 00000100:00100000:3.0:1763334985.618719:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53670:x1848989694663936:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3012us (3255us total) trans 8589939279 rc 0/0 00000100:00100000:3.0:1763334985.618734:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5069 00000100:00100000:3.0:1763334985.625455:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.626604:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694664064 00000100:00100000:2.0:1763334985.626619:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694664064 00000100:00100000:2.0:1763334985.626699:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1978 00000100:00100000:2.0:1763334985.626711:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afab34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694664064:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334985.626749:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1e6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.626765:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.626767:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.626772:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.626786:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.635795:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1e6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.635816:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1e6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.635825:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.635832:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334985.635837:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.635847:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1e6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.635867:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.635875:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334985.635991:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afab34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694664064:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 9278us (10543us total) trans 0 rc 86016/86016 00000100:00100000:2.0:1763334985.636003:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1978 00000100:00100000:1.0:1763334985.644869:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.644988:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694664192 00000100:00100000:2.0:1763334985.645000:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694664192 00000100:00100000:2.0:1763334985.645076:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1979 00000100:00100000:2.0:1763334985.645088:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2361:x1848989694664192:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334985.645126:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ed lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.645142:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.645145:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.645150:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.645164:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.655857:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ed lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.655879:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ed lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.655887:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.655903:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334985.655908:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ed lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.655917:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ed lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.655941:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ed lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.655948:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1ed lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334985.656048:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2361:x1848989694664192:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 10958us (11183us total) trans 0 rc 86016/86016 00000100:00100000:2.0:1763334985.656059:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1979 00000100:00100000:1.0:1763334985.668285:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.668861:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694664320 00000100:00100000:2.0:1763334985.668874:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694664320 00000100:00100000:2.0:1763334985.668960:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1980 00000100:00100000:2.0:1763334985.668971:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2362:x1848989694664320:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334985.669012:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1f4 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.669029:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.669031:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.669037:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.669052:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.676082:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1f4 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.676108:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1f4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.676118:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.676125:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334985.676129:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1f4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.676139:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1f4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.676159:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1f4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.676167:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1f4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334985.676259:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2362:x1848989694664320:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 7286us (7982us total) trans 0 rc 233688/233688 00000100:00100000:2.0:1763334985.676270:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1980 00000100:00100000:0.0:1763334985.764487:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.764618:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694664448 00000100:00100000:2.0:1763334985.764628:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694664448 00000100:00100000:2.0:1763334985.764701:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1981 00000100:00100000:2.0:1763334985.764713:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2362:x1848989694664448:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334985.764750:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1fb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.764765:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.764767:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334985.764773:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.764786:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.789560:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.789624:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.789634:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.789642:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334985.789646:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.789655:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.789674:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.789680:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d1fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334985.789749:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2362:x1848989694664448:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 25036us (25276us total) trans 0 rc 233688/233688 00000100:00100000:2.0:1763334985.789760:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1981 00000100:00100000:1.0:1763334985.796500:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334985.796541:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694664576 00000100:00100000:1.0:1763334985.796551:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694664576 00000100:00100000:1.0:1763334985.796642:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1982 00000100:00100000:1.0:1763334985.796654:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694664576:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:1.0:1763334985.796707:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x251:0x0] initial LVB size: 233688, mtime: 0x691a5b49, atime: 0x691a5b49, ctime: 0x691a5b49, blocks: 0x203 00010000:00010000:1.0:1763334985.796717:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d202 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.796731:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334985.796733:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334985.796739:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d202 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.796754:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d202 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.807098:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d202 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.807119:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d202 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.807128:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d202 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.807136:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334985.807140:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d202 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.807149:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d202 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.807169:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d202 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.807177:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d202 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->237567] (req 0->237567) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334985.807265:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694664576:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 10609us (10769us total) trans 0 rc 233688/233688 00000100:00100000:3.0:1763334985.807278:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1982 00000100:00100000:1.0:1763334985.850956:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334985.850996:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694664704 00000100:00100000:1.0:1763334985.851006:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694664704 00000100:00100000:1.0:1763334985.851060:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 420 00000100:00100000:1.0:1763334985.851069:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53670:x1848989694664704:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:1.0:1763334985.851082:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334985.851105:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6067200/0xcedf0054f849d1d8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07d7 expref: 202 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.851122:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334985.851128:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334985.851175:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53670:x1848989694664704:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 107us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334985.851182:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 420 00000100:00100000:1.0:1763334985.856017:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334985.856059:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694664960 00000100:00100000:1.0:1763334985.856069:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694664960 00000100:00100000:1.0:1763334985.856121:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1843 00000100:00100000:1.0:1763334985.856132:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53670:x1848989694664960:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334985.856376:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53670:x1848989694664960:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 245us (373us total) trans 8589939280 rc 0/0 00000100:00100000:1.0:1763334985.856384:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1843 00000100:00100000:3.0:1763334985.866387:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334985.866421:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694665216 00000100:00100000:3.0:1763334985.866431:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694665216 00000100:00100000:3.0:1763334985.866490:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5070 00000100:00100000:3.0:1763334985.866500:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53644:x1848989694665216:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334985.866522:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334985.866541:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d209 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b07de expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.866657:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.866672:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d18b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07bb expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.866681:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.866711:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d18b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07bb expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.866725:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d18b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07bb expref: 203 pid: 30972 timeout: 1150 lvb_type: 0 00000100:00100000:3.0:1763334985.866740:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e86680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701903872:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334985.866817:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af6425000 going to sleep for 11 seconds 00000100:00100000:2.0:1763334985.875668:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e86680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701903872:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334985.875922:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334985.875951:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694665344 00000100:00100000:3.0:1763334985.875957:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694665344 00010000:00010000:3.0:1763334985.875991:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d18b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07bb expref: 204 pid: 30972 timeout: 1150 lvb_type: 0 00000100:00100000:3.0:1763334985.876019:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2706 00000100:00100000:3.0:1763334985.876028:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2360:x1848989694665344:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334985.876040:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334985.876046:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d18b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07bb expref: 204 pid: 30972 timeout: 1150 lvb_type: 0 00010000:00010000:3.0:1763334985.876057:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d18b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07bb expref: 204 pid: 30972 timeout: 1150 lvb_type: 0 00010000:00010000:3.0:1763334985.876081:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d18b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07bb expref: 204 pid: 30972 timeout: 1150 lvb_type: 0 00010000:00010000:3.0:1763334985.876094:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:3.0:1763334985.876099:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.876108:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.876114:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334985.876129:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334985.876174:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+203:2360:x1848989694665344:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 147us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334985.876184:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2706 00010000:00010000:2.0:1763334985.877360:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.877378:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334985.877384:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334985.877404:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 233688 00010000:00010000:2.0:1763334985.877558:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d5200/0xcedf0054f849d209 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07de expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.877590:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07de expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.877600:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334985.877604:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334985.877607:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5aec6d4a00, rc 0) 00000100:00100000:2.0:1763334985.877664:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694665216:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 11166us (11284us total) trans 8589939281 rc 0/0 00000100:00100000:2.0:1763334985.877673:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5070 00000100:00100000:3.0:1763334985.890942:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334985.891295:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694665472 00000100:00100000:0.0:1763334985.891306:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694665472 00000100:00100000:3.0:1763334985.891972:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5071 00000100:00100000:3.0:1763334985.891988:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694665472:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334985.892014:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334985.892038:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d21e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b07e5 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.892126:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d225 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.892142:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07de expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.892152:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d225 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.892187:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07de expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334985.892201:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07de expref: 204 pid: 30972 timeout: 1150 lvb_type: 0 00000100:00100000:3.0:1763334985.892216:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9e86680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701904000:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334985.892314:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af6425cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334985.901555:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334985.901626:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9e86680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701904000:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334985.901705:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d225 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:3.0:1763334985.901733:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694665600 00000100:00100000:3.0:1763334985.901740:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694665600 00010000:00010000:3.0:1763334985.901774:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07de expref: 205 pid: 30972 timeout: 1150 lvb_type: 0 00000100:00100000:3.0:1763334985.901806:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2707 00000100:00100000:3.0:1763334985.901818:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+205:2359:x1848989694665600:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334985.901831:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334985.901838:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07de expref: 205 pid: 30972 timeout: 1150 lvb_type: 0 00010000:00010000:3.0:1763334985.901850:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07de expref: 205 pid: 30972 timeout: 1150 lvb_type: 0 00010000:00010000:3.0:1763334985.901873:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5aec6d4a00/0xcedf0054f849d210 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07de expref: 205 pid: 30972 timeout: 1150 lvb_type: 0 00010000:00010000:3.0:1763334985.901886:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:3.0:1763334985.904914:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d225 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.904938:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d225 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.904945:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d225 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.904988:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334985.905058:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2359:x1848989694665600:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 3240us (3508us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334985.905069:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2707 00010000:00010000:1.0:1763334985.906009:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d225 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334985.906022:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d225 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:1.0:1763334985.906073:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 233688 00000004:00200000:1.0:1763334985.906078:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334985.906097:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d225 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334985.906134:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d21e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07e5 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.906151:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d225 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07e5 expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.906160:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334985.906163:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334985.906165:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9800, rc 0) 00000100:00100000:1.0:1763334985.909460:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694665472:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 17463us (18519us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334985.909474:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5071 00000100:00100000:3.0:1763334985.919737:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334985.919807:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694665856 00000100:00100000:2.0:1763334985.919820:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694665856 00000100:00100000:2.0:1763334985.919899:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5072 00000100:00100000:2.0:1763334985.919910:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694665856:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334985.919967:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334985.919995:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d225 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07e5 expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334985.920013:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334985.920018:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334985.920266:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d22c lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334985.920281:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d22c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334985.920290:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d22c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000001:00080000:2.0:1763334985.920339:0:29628:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939282 00000004:00010000:2.0:1763334985.920369:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000e8fcf523 reply state 0000000058ea6d90 transno 8589939283 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d22c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334985.920383:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334985.920659:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694665856:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 748us (930us total) trans 8589939283 rc 0/0 00000100:00100000:2.0:1763334985.920667:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5072 00000020:00080000:2.0:1763334985.920674:0:29628:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1763334985.926745:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334985.926777:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d22c lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.926790:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d22c lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.926797:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d22c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.926804:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334985.926809:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d22c lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.926816:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d22c lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.926832:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:3.0:1763334985.926836:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334985.926841:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d22c lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334985.926847:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d22c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:3.0:1763334985.926877:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694666112 00000100:00100000:3.0:1763334985.926902:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694666112 00000100:00100000:3.0:1763334985.926950:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1844 00000100:00100000:3.0:1763334985.926960:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53644:x1848989694666112:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:3.0:1763334985.927174:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5500380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694666112:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 214us (434us total) trans 8589939284 rc 0/0 00000100:00100000:3.0:1763334985.927182:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1844 00000100:00100000:1.0:1763334985.958482:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334985.958534:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694666368 00000100:00100000:1.0:1763334985.958545:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694666368 00000100:00100000:1.0:1763334985.958621:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5073 00000100:00100000:1.0:1763334985.958633:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694666368:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334985.958661:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334985.958664:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:1.0:1763334985.958695:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d199 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07c2 expref: 205 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.958715:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d168 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07b4 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.958725:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334985.958735:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334985.958750:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d233 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b07ec expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334985.958808:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d23a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334985.958821:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d23a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334985.958830:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d23a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000040:00080000:1.0:1763334985.959360:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1199, 88 off102680 00000004:00080000:1.0:1763334985.959371:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1050592798720ns, next at 1047075157699ns, rc = 0 00000040:00080000:1.0:1763334985.959437:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1189, 88 off101624 00000004:00080000:1.0:1763334985.959444:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1050592872547ns, next at 1047075229764ns, rc = 0 00000040:00080000:1.0:1763334985.959472:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1190, 88 off101712 00000004:00080000:1.0:1763334985.959477:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1050592904864ns, next at 1047075229764ns, rc = 0 00000040:00080000:1.0:1763334985.959494:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1200, 88 off102768 00000004:00080000:1.0:1763334985.959498:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1050592926522ns, next at 1047075157699ns, rc = 0 00000040:00080000:1.0:1763334985.959514:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1191, 88 off101800 00000004:00080000:1.0:1763334985.959518:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1050592946290ns, next at 1047075229764ns, rc = 0 00000040:00080000:1.0:1763334985.959535:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1201, 88 off102856 00000004:00080000:1.0:1763334985.959539:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1050592966835ns, next at 1047075157699ns, rc = 0 00000040:00080000:1.0:1763334985.959554:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1202, 88 off102944 00000004:00080000:1.0:1763334985.959558:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1050592986540ns, next at 1047075157699ns, rc = 0 00000040:00080000:1.0:1763334985.959602:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1192, 88 off101888 00000004:00080000:1.0:1763334985.959607:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1050593035230ns, next at 1047075229764ns, rc = 0 00000040:00080000:1.0:1763334985.959624:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1193, 88 off101976 00000004:00080000:1.0:1763334985.959630:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1050593057867ns, next at 1047075229764ns, rc = 0 00000040:00080000:1.0:1763334985.959646:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1203, 88 off103032 00000004:00080000:1.0:1763334985.959650:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1050593078202ns, next at 1047075157699ns, rc = 0 00000040:00080000:1.0:1763334985.959666:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1204, 88 off103120 00000004:00080000:1.0:1763334985.959669:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1050593097602ns, next at 1047075157699ns, rc = 0 00000040:00080000:1.0:1763334985.959685:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1194, 88 off102064 00000004:00080000:1.0:1763334985.959689:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1050593117465ns, next at 1047075229764ns, rc = 0 00010000:00010000:1.0:1763334986.021673:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d23a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07ec expref: 206 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.021691:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa100) 00010000:00010000:1.0:1763334986.021694:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334986.021713:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d233 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07ec expref: 206 pid: 29628 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1763334986.021731:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d23a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07ec expref: 205 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.021765:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa100) 00010000:00010000:1.0:1763334986.021769:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1763334986.021771:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000001:00080000:3.0:1763334986.021795:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939276 is committed 00000001:00080000:3.0:1763334986.021822:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939285 is committed 00000004:00080000:3.0:1763334986.021827:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 804 committed 00000004:00080000:3.0:1763334986.021844:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 816 committed 00000004:00080000:3.0:1763334986.021853:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 815 committed 00000004:00080000:3.0:1763334986.021860:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 803 committed 00000004:00080000:3.0:1763334986.021862:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 802 committed 00000004:00080000:3.0:1763334986.021865:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 814 committed 00000004:00080000:3.0:1763334986.021866:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 813 committed 00000004:00080000:3.0:1763334986.021868:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 801 committed 00000004:00080000:3.0:1763334986.021871:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 812 committed 00000004:00080000:3.0:1763334986.021873:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 800 committed 00000004:00080000:3.0:1763334986.021876:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 799 committed 00000004:00080000:3.0:1763334986.021879:0:29660:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 811 committed 00000100:00100000:1.0:1763334986.021923:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53644:x1848989694666368:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 63291us (63451us total) trans 8589939285 rc 0/0 00000020:00080000:3.0:1763334986.021933:0:29660:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9a5aeec68180 refcount 2 committed 0 result 0 batchid 4294969320 00000100:00100000:1.0:1763334986.021935:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5073 00000020:00080000:3.0:1763334986.021941:0:29660:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5af6856500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a5aeec68d80 00000020:00080000:3.0:1763334986.021946:0:29660:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5af6856600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9a5aeec68300 00000020:00080000:3.0:1763334986.021949:0:29660:0:(update_trans.c:69:top_multiple_thandle_dump()) st ffff9a5af6856300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9a5afa4ca400 00000020:00080000:3.0:1763334986.021952:0:29660:0:(update_trans.c:74:top_multiple_thandle_dump()) cookie [0x200000bd0:0x1:0x0].14 00000100:00100000:3.0:1763334986.022154:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701904128:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1763334986.022199:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294969320 committed batchid 4294969319 00000100:00100000:3.0:1763334986.022224:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334986.022283:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701904640:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334986.022311:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334986.022332:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1763334986.022337:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac8418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701904256:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334986.022361:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334986.022374:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701904768:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334986.022389:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334986.022453:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701904128 00000100:00100000:2.0:1763334986.022461:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701904128 00000100:00100000:2.0:1763334986.022501:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701904640 00000100:00100000:2.0:1763334986.022505:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701904640 00000100:00100000:2.0:1763334986.022529:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701904256 00000100:00100000:2.0:1763334986.022533:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701904256 00000100:00100000:1.0:1763334986.022533:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701905280:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334986.022553:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701904768 00000100:00100000:2.0:1763334986.022557:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701904768 00000100:00100000:1.0:1763334986.022598:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334986.022614:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701905280 00000100:00100000:2.0:1763334986.022618:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701905280 00000100:00100000:1.0:1763334986.022632:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1763334986.022641:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701905152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334986.022647:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5211 00000100:00100000:2.0:1763334986.022659:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+7:3291:x1848989701904128:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.022669:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.022690:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701904384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.022713:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.022725:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701904896:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.022746:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.022755:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701905408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.022773:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.022784:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1763334986.022789:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701904512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.022808:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.022821:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac841b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701905024:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.022843:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.022852:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701905536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.022875:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1763334986.022886:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 233688 -> 233688 00002000:00010000:2.0:1763334986.022902:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334985 -> 1763334985 00002000:00010000:2.0:1763334986.022905:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00000100:00100000:1.0:1763334986.022906:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701905152 00002000:00010000:2.0:1763334986.022907:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334985 -> 1763334985 00002000:00010000:2.0:1763334986.022912:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 161 -> 161 00000100:00100000:1.0:1763334986.022912:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701905152 00000100:00100000:1.0:1763334986.022934:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701904384 00000100:00100000:1.0:1763334986.022938:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701904384 00000100:00100000:1.0:1763334986.022953:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701904896 00000100:00100000:2.0:1763334986.022955:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701904128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 298us (730us total) trans 17179871300 rc 0/0 00000100:00100000:1.0:1763334986.022956:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701904896 00000100:00100000:2.0:1763334986.022967:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5211 00000100:00100000:2.0:1763334986.022983:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701905408 00000100:00100000:2.0:1763334986.022987:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701905408 00000020:00080000:0.0:1763334986.023072:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969319 00000100:00100000:0.0:1763334986.023093:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701904512 00000100:00100000:0.0:1763334986.023097:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701904512 00000004:00080000:3.0:1763334986.023135:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c4380/2, rc 0, transno 17179871300 00000100:00100000:1.0:1763334986.023143:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701905024 00000100:00100000:3.0:1763334986.023144:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701904128:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.023148:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701905024 00000100:00100000:1.0:1763334986.023163:0:21625:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701905536 00000100:00100000:1.0:1763334986.023165:0:21625:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701905536 00000100:00100000:1.0:1763334986.023178:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5212 00000100:00100000:1.0:1763334986.023184:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701904640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334986.023290:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 85452 -> 85452 00002000:00010000:1.0:1763334986.023295:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334986.023297:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334986.023299:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334986.023301:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1763334986.023343:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701904640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 158us (1031us total) trans 21474838534 rc 0/0 00000100:00100000:1.0:1763334986.023350:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5212 00000100:00100000:1.0:1763334986.023373:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5213 00000100:00100000:1.0:1763334986.023380:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701904256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334986.023458:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334986.023461:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334986.023464:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334986.023467:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00000004:00080000:3.0:1763334986.023470:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac8418e00/2, rc 0, transno 21474838534 00002000:00010000:1.0:1763334986.023470:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334986.023479:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8418e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701904640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.023503:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701904256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 123us (1140us total) trans 21474838535 rc 0/0 00000100:00100000:1.0:1763334986.023512:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5213 00000004:00080000:3.0:1763334986.023524:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac8418000/2, rc 0, transno 21474838535 00000100:00100000:1.0:1763334986.023529:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5214 00000100:00100000:3.0:1763334986.023534:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac8418000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701904256:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.023540:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701904768:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1763334986.023655:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:3.0:1763334986.023660:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5215 00002000:00010000:1.0:1763334986.023661:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334986.023666:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334986.023669:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334986.023671:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334986.023675:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701905280:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.023707:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701904768:12345-0@lo:2:osp-syn-0-0.0 Request processed in 168us (1314us total) trans 21474838536 rc 0/0 00000100:00100000:1.0:1763334986.023721:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5214 00000100:00100000:1.0:1763334986.023736:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5216 00000100:00100000:1.0:1763334986.023743:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3292:x1848989701905152:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334986.023815:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 85452 -> 85452 00002000:00010000:3.0:1763334986.023818:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334986.023820:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334986.023823:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:3.0:1763334986.023825:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:1.0:1763334986.023850:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334986.023854:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334986.023857:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334986.023860:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334986.023865:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334986.023866:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3292:x1848989701905280:12345-0@lo:2:osp-syn-1-0.0 Request processed in 193us (1291us total) trans 17179871301 rc 0/0 00000100:00100000:3.0:1763334986.023874:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5215 00000100:00100000:3.0:1763334986.023905:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5217 00000100:00100000:1.0:1763334986.023910:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3292:x1848989701905152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 167us (1239us total) trans 17179871302 rc 0/0 00000100:00100000:3.0:1763334986.023916:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701904384:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.023923:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5216 00000100:00100000:1.0:1763334986.023942:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5218 00000100:00100000:1.0:1763334986.023950:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701904896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334986.024013:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334986.024016:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334985 -> 1763334985 00002000:00010000:3.0:1763334986.024018:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:3.0:1763334986.024021:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334985 -> 1763334985 00002000:00010000:3.0:1763334986.024023:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:1.0:1763334986.024057:0:21625:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb size from disk: 262144 -> 262144 00000100:00100000:3.0:1763334986.024061:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701904384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (1345us total) trans 17179871303 rc 0/0 00002000:00010000:1.0:1763334986.024063:0:21625:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb mtime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334986.024069:0:21625:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334986.024074:0:21625:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb ctime from disk: 1763334984 -> 1763334984 00000100:00100000:3.0:1763334986.024075:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5217 00002000:00010000:1.0:1763334986.024078:0:21625:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334986.024094:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5219 00000100:00100000:3.0:1763334986.024104:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701905024:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.024112:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701904896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 162us (1363us total) trans 21474838537 rc 0/0 00000100:00100000:1.0:1763334986.024120:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5218 00000100:00100000:1.0:1763334986.024137:0:21625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5220 00000100:00100000:1.0:1763334986.024145:0:21625:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701905536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334986.024196:0:6517:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334986.024200:0:6517:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb mtime from disk: 1763334985 -> 1763334985 00002000:00010000:3.0:1763334986.024203:0:6517:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:3.0:1763334986.024205:0:6517:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb ctime from disk: 1763334985 -> 1763334985 00002000:00010000:3.0:1763334986.024207:0:6517:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334986.024240:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701905024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 138us (1395us total) trans 21474838538 rc 0/0 00000100:00100000:3.0:1763334986.024248:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5219 00000100:00100000:1.0:1763334986.024265:0:21625:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701905536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 120us (1388us total) trans 17179871304 rc 0/0 00000100:00100000:1.0:1763334986.024274:0:21625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5220 00000004:00080000:1.0:1763334986.024333:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5af6a83100/2, rc 0, transno 17179871302 00000100:00100000:1.0:1763334986.024339:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701905152:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334986.024347:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5576680/2, rc 0, transno 17179871301 00000100:00100000:1.0:1763334986.024351:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5576680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701905280:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334986.024373:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841b100/2, rc 0, transno 21474838538 00000100:00100000:1.0:1763334986.024377:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701905024:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334986.024384:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5574380/2, rc 0, transno 17179871304 00000100:00100000:1.0:1763334986.024387:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5574380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701905536:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334986.024394:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59c58c4a80/2, rc 0, transno 17179871303 00000100:00100000:1.0:1763334986.024397:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701904384:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334986.024404:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841ad80/2, rc 0, transno 21474838537 00000100:00100000:1.0:1763334986.024407:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701904896:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1763334986.024423:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841a300/2, rc 0, transno 21474838536 00000100:00100000:1.0:1763334986.024427:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701904768:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334986.024548:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5221 00000100:00100000:2.0:1763334986.024560:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701905408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334986.024568:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5222 00000100:00100000:0.0:1763334986.024600:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701904512:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334986.024709:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334986.024713:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb mtime from disk: 1763334984 -> 1763334984 00002000:00010000:2.0:1763334986.024716:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:2.0:1763334986.024719:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb ctime from disk: 1763334984 -> 1763334984 00002000:00010000:2.0:1763334986.024722:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1763334986.024727:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334986.024731:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334986.024734:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334986.024736:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334986.024738:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000004:00080000:1.0:1763334986.024817:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac5575500/2, rc 0, transno 17179871305 00000100:00100000:1.0:1763334986.024823:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5575500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701905408:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334986.025777:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3289:x1848989701905408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1213us (2994us total) trans 17179871305 rc 0/0 00000100:00100000:2.0:1763334986.025789:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5221 00000100:00100000:0.0:1763334986.026379:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701904512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1778us (3566us total) trans 21474838539 rc 0/0 00000100:00100000:0.0:1763334986.026388:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5222 00000004:00080000:1.0:1763334986.026470:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac841b480/2, rc 0, transno 21474838539 00000100:00100000:1.0:1763334986.026477:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac841b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701904512:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334986.034651:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.038326:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694666496 00000100:00100000:1.0:1763334986.038343:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694666496 00000100:00100000:1.0:1763334986.038421:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5223 00000100:00100000:1.0:1763334986.038432:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+30:53644:x1848989694666496:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334986.038453:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334986.038473:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d241 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b07f3 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.038503:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849d106 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0798 expref: 31 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334986.038512:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334986.038514:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334986.038518:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d241 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07f3 expref: 31 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.038553:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849d106 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0798 expref: 31 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334986.038567:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849d106 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0798 expref: 31 pid: 6519 timeout: 1150 lvb_type: 1 00000100:00100000:1.0:1763334986.038606:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5577800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701905664:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334986.038942:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af6a65180 going to sleep for 11 seconds 00000100:00100000:0.0:1763334986.052003:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.052051:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5577800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701905664:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334986.052084:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d241 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07f3 expref: 31 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334986.052085:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694666624 00000100:00100000:3.0:1763334986.052094:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694666624 00010000:00010000:1.0:1763334986.052107:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00010000:00010000:3.0:1763334986.052128:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849d106 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0798 expref: 32 pid: 6519 timeout: 1150 lvb_type: 1 00000100:00100000:3.0:1763334986.052162:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2708 00000100:00100000:1.0:1763334986.052169:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+32:53644:x1848989694666496:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 13737us (17527us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334986.052175:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2360:x1848989694666624:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763334986.052191:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5223 00010000:00010000:3.0:1763334986.052194:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334986.052219:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849d106 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0798 expref: 31 pid: 6519 timeout: 1150 lvb_type: 1 00010000:00010000:3.0:1763334986.052235:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849d106 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0798 expref: 31 pid: 6519 timeout: 1150 lvb_type: 1 00010000:00010000:3.0:1763334986.052257:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066a00/0xcedf0054f849d106 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0798 expref: 31 pid: 6519 timeout: 1150 lvb_type: 1 00010000:00010000:3.0:1763334986.052270:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334986.052272:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334986.052279:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d241 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07f3 expref: 30 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.052289:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d241 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07f3 expref: 30 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.052388:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d241 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07f3 expref: 30 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334986.052404:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac5577800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701905792:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334986.052466:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af6a65180 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.059930:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac5577800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701905792:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334986.059957:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334986.060022:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694666624:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 7850us (8027us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.060034:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2708 00000100:00100000:1.0:1763334986.060347:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.060398:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694666752 00000100:00100000:0.0:1763334986.060407:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694666752 00000100:00100000:0.0:1763334986.060458:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5224 00000100:00100000:0.0:1763334986.060469:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:53644:x1848989694666752:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334986.060487:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334986.060506:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d248 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b07fa expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.060532:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849d114 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b079f expref: 22 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.060541:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.060543:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.060547:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d248 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07fa expref: 22 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.060607:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849d114 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b079f expref: 22 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.060623:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849d114 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b079f expref: 22 pid: 6519 timeout: 1150 lvb_type: 1 00000100:00100000:0.0:1763334986.060638:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701905920:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334986.060732:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad0fff540 going to sleep for 11 seconds 00000100:00100000:0.0:1763334986.066622:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.066667:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701905920:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334986.066701:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d248 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07fa expref: 22 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.066722:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:3.0:1763334986.066739:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694666880 00000100:00100000:3.0:1763334986.066747:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694666880 00000100:00100000:1.0:1763334986.066774:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:53644:x1848989694666752:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 6307us (6427us total) trans 0 rc 0/0 00010000:00010000:3.0:1763334986.066784:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849d114 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b079f expref: 23 pid: 6519 timeout: 1150 lvb_type: 1 00000100:00100000:1.0:1763334986.066785:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5224 00000100:00100000:3.0:1763334986.066831:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2709 00000100:00100000:3.0:1763334986.066841:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694666880:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334986.066855:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334986.066877:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849d114 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b079f expref: 22 pid: 6519 timeout: 1150 lvb_type: 1 00010000:00010000:3.0:1763334986.066908:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849d114 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b079f expref: 22 pid: 6519 timeout: 1150 lvb_type: 1 00010000:00010000:3.0:1763334986.066932:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066400/0xcedf0054f849d114 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b079f expref: 22 pid: 6519 timeout: 1150 lvb_type: 1 00010000:00010000:3.0:1763334986.066946:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334986.066948:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334986.066954:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07fa expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.066964:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07fa expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.066998:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07fa expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334986.067012:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec58a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701906048:192.168.201.60@tcp:105: 00000100:00100000:3.0:1763334986.067080:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1763334986.074775:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.074802:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec58a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701906048:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334986.074828:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334986.074885:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694666880:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 8045us (8274us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334986.074905:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2709 00000100:00100000:1.0:1763334986.075694:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694667008 00000100:00100000:1.0:1763334986.075702:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694667008 00000100:00100000:1.0:1763334986.075753:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5225 00000100:00100000:1.0:1763334986.075763:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+30:53644:x1848989694667008:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334986.075782:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334986.075800:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849d24f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0801 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.075829:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d10d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07a6 expref: 31 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334986.075837:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334986.075839:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334986.075844:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849d24f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0801 expref: 31 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.075920:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d10d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07a6 expref: 31 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334986.075934:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d10d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07a6 expref: 31 pid: 6519 timeout: 1150 lvb_type: 1 00000100:00100000:1.0:1763334986.075949:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701906176:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334986.076449:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af6a65180 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.080215:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701906176:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334986.080251:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849d24f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0801 expref: 31 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.080269:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478000, rc 0) 00000100:00100000:1.0:1763334986.080330:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+31:53644:x1848989694667008:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 4568us (5566us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.080339:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5225 00000100:00100000:3.0:1763334986.088186:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.088515:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694667136 00000100:00100000:1.0:1763334986.088525:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694667136 00010000:00010000:1.0:1763334986.088566:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d10d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07a6 expref: 31 pid: 6519 timeout: 1150 lvb_type: 1 00000100:00100000:1.0:1763334986.088654:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2710 00000100:00100000:1.0:1763334986.088665:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2359:x1848989694667136:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334986.088681:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334986.088703:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d10d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07a6 expref: 31 pid: 6519 timeout: 1150 lvb_type: 1 00010000:00010000:1.0:1763334986.088717:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d10d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07a6 expref: 31 pid: 6519 timeout: 1150 lvb_type: 1 00010000:00010000:1.0:1763334986.088740:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6067e00/0xcedf0054f849d10d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07a6 expref: 31 pid: 6519 timeout: 1150 lvb_type: 1 00010000:00010000:1.0:1763334986.088757:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334986.088759:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334986.088765:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849d24f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0801 expref: 30 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.088775:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849d24f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0801 expref: 30 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.088819:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849d24f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0801 expref: 30 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334986.088834:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701906304:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334986.088925:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af6a65180 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.091548:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701906304:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334986.091677:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334986.091737:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694667136:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 3073us (3562us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.091748:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2710 00000100:00100000:0.0:1763334986.099671:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.099738:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694667264 00000100:00100000:3.0:1763334986.099753:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694667264 00002000:00010000:3.0:1763334986.099795:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (233983->18446744073709551615) 00002000:00100000:3.0:1763334986.099801:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b5c00 with x1848989694667264 ext(233983->18446744073709551615) 00002000:00010000:3.0:1763334986.099813:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac95b5c00. 00000100:00100000:3.0:1763334986.099838:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1983 00000100:00100000:3.0:1763334986.099848:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2359:x1848989694667264:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334986.100095:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 233688 -> 233983 00002000:00010000:3.0:1763334986.100099:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334985 -> 1763334986 00002000:00010000:3.0:1763334986.100102:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:3.0:1763334986.100104:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334985 -> 1763334986 00002000:00010000:3.0:1763334986.100106:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 161 -> 161 00000100:00100000:3.0:1763334986.100174:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac95b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2359:x1848989694667264:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 326us (512us total) trans 17179871306 rc 0/0 00000100:00100000:3.0:1763334986.100181:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1983 00002000:00010000:3.0:1763334986.100186:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (233983->18446744073709551615) 00002000:00100000:3.0:1763334986.100189:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac95b5c00 with x1848989694667264 ext(233983->18446744073709551615) 00002000:00010000:3.0:1763334986.100193:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac95b5c00. 00000100:00100000:3.0:1763334986.102494:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.102614:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694667392 00000100:00100000:1.0:1763334986.102625:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694667392 00002000:00010000:1.0:1763334986.102670:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334986.102675:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec58000 with x1848989694667392 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334986.102688:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeec58000. 00000100:00100000:1.0:1763334986.102719:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1984 00000100:00100000:1.0:1763334986.102729:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694667392:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334986.102987:0:21630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334986.102990:0:21630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334985 -> 1763334986 00002000:00010000:1.0:1763334986.102993:0:21630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:1.0:1763334986.102995:0:21630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334985 -> 1763334986 00002000:00010000:1.0:1763334986.102998:0:21630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334986.103075:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694667392:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 344us (591us total) trans 21474838540 rc 0/0 00000100:00100000:1.0:1763334986.103088:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1984 00002000:00010000:1.0:1763334986.103092:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334986.103095:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec58000 with x1848989694667392 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334986.103099:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeec58000. 00000100:00100000:2.0:1763334986.104958:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.105041:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694667520 00000100:00100000:3.0:1763334986.105052:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694667520 00002000:00010000:3.0:1763334986.105089:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:3.0:1763334986.105093:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ae0bbce00 with x1848989694667520 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334986.105105:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ae0bbce00. 00000100:00100000:3.0:1763334986.105134:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1985 00000100:00100000:3.0:1763334986.105142:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2359:x1848989694667520:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334986.105344:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334986.105347:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334985 -> 1763334986 00002000:00010000:3.0:1763334986.105350:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:3.0:1763334986.105352:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334985 -> 1763334986 00002000:00010000:3.0:1763334986.105354:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334986.110939:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2359:x1848989694667520:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 5782us (5975us total) trans 17179871307 rc 0/0 00000100:00100000:3.0:1763334986.110954:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1985 00002000:00010000:3.0:1763334986.110962:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:3.0:1763334986.110966:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ae0bbce00 with x1848989694667520 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334986.110979:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ae0bbce00. 00000100:00100000:0.0:1763334986.114425:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.114520:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694667648 00000100:00100000:1.0:1763334986.114531:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694667648 00000100:00100000:1.0:1763334986.115264:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5074 00000100:00100000:1.0:1763334986.115279:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694667648:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334986.115304:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334986.115328:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d256 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0808 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.115437:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849d25d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.115452:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849d25d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.115464:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849d25d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:1.0:1763334986.115489:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 233985 00000004:00200000:1.0:1763334986.115494:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334986.115509:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849d25d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.115536:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d256 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0808 expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.115552:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849d25d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0808 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.115562:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa100) 00010000:00010000:1.0:1763334986.115565:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334986.116770:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:0.0:1763334986.118128:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee546680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694667648:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 2841us (3700us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.118142:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5074 00000100:00100000:0.0:1763334986.128449:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.128546:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694667904 00000100:00100000:2.0:1763334986.128557:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694667904 00000100:00100000:2.0:1763334986.128655:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5075 00000100:00100000:2.0:1763334986.128666:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694667904:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334986.128721:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1763334986.128746:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479800/0xcedf0054f849d25d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0808 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.128768:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d23a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07ec expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.128779:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa100) 00010000:00010000:2.0:1763334986.128788:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334986.129040:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d264 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.129054:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d264 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.129069:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d264 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000001:00080000:2.0:1763334986.129124:0:29628:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939286 00000004:00010000:2.0:1763334986.129151:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000045ce3bca reply state 00000000d48133ff transno 8589939287 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d264 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334986.129160:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334986.129242:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee545c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694667904:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 577us (802us total) trans 8589939287 rc 0/0 00000100:00100000:2.0:1763334986.129250:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5075 00000020:00080000:2.0:1763334986.129255:0:29628:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763334986.131314:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334986.131397:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d264 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.131409:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d264 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.131416:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d264 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.131422:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334986.131426:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d264 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.131434:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d264 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.131450:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac6cab500) 00010000:00010000:3.0:1763334986.131454:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334986.131458:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d264 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.131464:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d264 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334986.133966:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694668032 00000100:00100000:1.0:1763334986.133982:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694668032 00000100:00100000:1.0:1763334986.134049:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5076 00000100:00100000:1.0:1763334986.134058:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694668032:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334986.134081:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334986.134103:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d26b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b080f expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.134163:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d26b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b080f expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.134177:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d26b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b080f expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.134197:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:1.0:1763334986.134201:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334986.134205:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334986.134279:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694668032:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 222us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.134286:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5076 00000100:00100000:0.0:1763334986.142688:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.142855:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694668160 00000100:00100000:2.0:1763334986.142866:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694668160 00002000:00010000:2.0:1763334986.142913:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (133906->18446744073709551615) 00002000:00100000:2.0:1763334986.142918:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee544700 with x1848989694668160 ext(133906->18446744073709551615) 00002000:00010000:2.0:1763334986.142930:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee544700. 00000100:00100000:2.0:1763334986.142962:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1986 00000100:00100000:2.0:1763334986.142971:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2359:x1848989694668160:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334986.143303:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 233983 -> 133906 00002000:00010000:2.0:1763334986.143306:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334986 -> 1763334986 00002000:00010000:2.0:1763334986.143309:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:2.0:1763334986.143311:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334986 -> 1763334986 00002000:00010000:2.0:1763334986.143313:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 161 -> 161 00000100:00100000:2.0:1763334986.143377:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee544700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2359:x1848989694668160:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 405us (699us total) trans 17179871308 rc 0/0 00000100:00100000:2.0:1763334986.143388:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1986 00002000:00010000:2.0:1763334986.143392:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (133906->18446744073709551615) 00002000:00100000:2.0:1763334986.143395:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee544700 with x1848989694668160 ext(133906->18446744073709551615) 00002000:00010000:2.0:1763334986.143400:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee544700. 00000100:00100000:0.0:1763334986.143767:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.144923:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694668288 00000100:00100000:1.0:1763334986.144933:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694668288 00002000:00010000:1.0:1763334986.144968:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334986.144972:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee545500 with x1848989694668288 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334986.144983:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aee545500. 00000100:00100000:1.0:1763334986.145014:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1987 00000100:00100000:1.0:1763334986.145022:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694668288:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334986.145193:0:21630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334986.145197:0:21630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334986 -> 1763334986 00002000:00010000:1.0:1763334986.145199:0:21630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:1.0:1763334986.145202:0:21630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334986 -> 1763334986 00002000:00010000:1.0:1763334986.145204:0:21630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334986.145255:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee545500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694668288:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 234us (1490us total) trans 21474838541 rc 0/0 00000100:00100000:1.0:1763334986.145262:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1987 00002000:00010000:1.0:1763334986.145265:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:1.0:1763334986.145268:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee545500 with x1848989694668288 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334986.145272:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aee545500. 00000100:00100000:0.0:1763334986.145740:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.146960:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694668416 00000100:00100000:3.0:1763334986.146972:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694668416 00002000:00010000:0.0:1763334986.147644:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334986.147651:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee544e00 with x1848989694668416 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334986.147662:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee544e00. 00000100:00100000:0.0:1763334986.147690:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1988 00000100:00100000:0.0:1763334986.147700:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2360:x1848989694668416:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334986.147919:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334986.147923:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334986 -> 1763334986 00002000:00010000:0.0:1763334986.147925:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334986.147928:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334986 -> 1763334986 00002000:00010000:0.0:1763334986.147930:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334986.150314:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee544e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+34:2360:x1848989694668416:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 2602us (4562us total) trans 17179871309 rc 0/0 00000100:00100000:0.0:1763334986.150329:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1988 00002000:00010000:0.0:1763334986.150337:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334986.150341:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aee544e00 with x1848989694668416 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334986.150352:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aee544e00. 00000100:00100000:1.0:1763334986.156039:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.158356:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694668544 00000100:00100000:2.0:1763334986.158373:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694668544 00000100:00100000:2.0:1763334986.158720:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5077 00000100:00100000:2.0:1763334986.158733:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694668544:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334986.158756:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334986.158781:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d272 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0816 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.158869:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d279 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.158895:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d279 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.158907:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d279 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334986.158938:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00000004:00200000:2.0:1763334986.158942:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334986.158959:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d279 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.158985:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d272 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0816 expref: 192 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.159003:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d279 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0816 expref: 191 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.159012:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:2.0:1763334986.159015:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334986.159019:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334986.159079:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694668544:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 349us (3051us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334986.159086:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5077 00000100:00100000:3.0:1763334986.164985:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.165403:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694668800 00000100:00100000:1.0:1763334986.165414:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694668800 00000100:00100000:1.0:1763334986.165475:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1845 00000100:00100000:1.0:1763334986.165485:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694668800:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:1.0:1763334986.165862:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53644:x1848989694668800:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 377us (887us total) trans 8589939288 rc 0/0 00000100:00100000:1.0:1763334986.165870:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1845 00000100:00100000:0.0:1763334986.202397:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.203541:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694668928 00000100:00100000:2.0:1763334986.203557:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694668928 00000100:00100000:2.0:1763334986.203659:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5078 00000100:00100000:2.0:1763334986.203673:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53671:x1848989694668928:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334986.203705:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334986.203735:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d280 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b081d expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.203865:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d287 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.203883:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d287 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.203908:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d287 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.203927:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d28e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.203935:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d28e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.203946:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d28e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204097:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d295 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204107:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d295 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204115:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d295 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334986.204161:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00000004:00200000:2.0:1763334986.204167:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334986.204681:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d295 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204702:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d295 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204713:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d287 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204721:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d287 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204729:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d287 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204735:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334986.204740:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d287 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204749:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d287 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204764:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334986.204768:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334986.204774:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d287 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204781:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d287 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204797:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d28e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204803:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d28e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204809:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d28e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204814:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334986.204816:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d28e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204823:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d28e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204829:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac6caba00) 00010000:00010000:2.0:1763334986.204832:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334986.204834:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d28e lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204841:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d28e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.204880:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d280 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b081d expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.204910:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d295 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b081d expref: 193 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.204918:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:2.0:1763334986.204920:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334986.204923:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431c00, rc 0) 00000100:00100000:2.0:1763334986.205031:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee546300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53671:x1848989694668928:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1360us (2647us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334986.205040:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5078 00000100:00100000:0.0:1763334986.209864:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.212745:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694669056 00000100:00100000:1.0:1763334986.212769:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694669056 00000100:00100000:1.0:1763334986.212983:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 421 00000100:00100000:1.0:1763334986.212996:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2360:x1848989694669056:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334986.213020:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334986.213055:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d295 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b081d expref: 193 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.213084:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:1.0:1763334986.213090:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334986.213180:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d45050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694669056:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 187us (3331us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.213189:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 421 00000100:00100000:0.0:1763334986.218671:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.218880:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694669312 00000100:00100000:3.0:1763334986.218906:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694669312 00000100:00100000:3.0:1763334986.218979:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5079 00000100:00100000:3.0:1763334986.218993:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53671:x1848989694669312:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334986.219022:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334986.219053:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d29c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0824 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.219209:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.219230:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d279 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0816 expref: 193 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.219242:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.219290:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d279 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0816 expref: 193 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.219307:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d279 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0816 expref: 193 pid: 29628 timeout: 1150 lvb_type: 0 00000100:00100000:3.0:1763334986.219330:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec59180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701906432:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334986.219438:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1763334986.230627:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.230785:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec59180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701906432:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334986.230825:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334986.231045:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694669440 00000100:00100000:1.0:1763334986.231055:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694669440 00010000:00010000:1.0:1763334986.231104:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d279 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0816 expref: 194 pid: 29628 timeout: 1150 lvb_type: 0 00000100:00100000:1.0:1763334986.231185:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2711 00000100:00100000:1.0:1763334986.231198:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2360:x1848989694669440:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334986.231218:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334986.231227:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d279 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0816 expref: 194 pid: 29628 timeout: 1150 lvb_type: 0 00010000:00010000:1.0:1763334986.231241:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d279 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0816 expref: 194 pid: 29628 timeout: 1150 lvb_type: 0 00010000:00010000:1.0:1763334986.231367:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d279 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0816 expref: 194 pid: 29628 timeout: 1150 lvb_type: 0 00010000:00010000:1.0:1763334986.231389:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:1.0:1763334986.231394:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.231404:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.231412:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.231445:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334986.231594:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.231603:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:3.0:1763334986.231628:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00010000:00010000:3.0:1763334986.231827:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d29c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0824 expref: 195 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.231845:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0824 expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.231853:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:3.0:1763334986.231855:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1763334986.231859:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8200, rc 0) 00000100:00100000:1.0:1763334986.232146:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2360:x1848989694669440:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 948us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.232157:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2711 00000100:00100000:3.0:1763334986.232600:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee545f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53671:x1848989694669312:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 13608us (13943us total) trans 8589939289 rc 0/0 00000100:00100000:3.0:1763334986.232609:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5079 00000100:00100000:2.0:1763334986.239778:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.239910:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694669568 00000100:00100000:3.0:1763334986.239927:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694669568 00000100:00100000:3.0:1763334986.240015:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5080 00000100:00100000:3.0:1763334986.240029:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53671:x1848989694669568:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334986.240066:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334986.240102:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d2b1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b082b expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.240258:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d2b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.240276:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0824 expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.240286:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d2b8 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.240328:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0824 expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.240345:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0824 expref: 194 pid: 29628 timeout: 1150 lvb_type: 0 00000100:00100000:3.0:1763334986.240361:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec59180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701906560:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334986.240473:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1763334986.244840:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec59180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701906560:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334986.244882:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d2b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334986.245080:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.245165:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694669696 00000100:00100000:1.0:1763334986.245176:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694669696 00010000:00010000:1.0:1763334986.245220:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0824 expref: 195 pid: 29628 timeout: 1150 lvb_type: 0 00000100:00100000:1.0:1763334986.245272:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2712 00000100:00100000:1.0:1763334986.245283:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2359:x1848989694669696:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334986.245302:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334986.245309:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0824 expref: 195 pid: 29628 timeout: 1150 lvb_type: 0 00010000:00010000:1.0:1763334986.245322:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0824 expref: 195 pid: 29628 timeout: 1150 lvb_type: 0 00010000:00010000:1.0:1763334986.245350:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d2a3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0824 expref: 195 pid: 29628 timeout: 1150 lvb_type: 0 00010000:00010000:1.0:1763334986.245375:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:1.0:1763334986.245380:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d2b8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.245391:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.245400:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d2b8 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.246760:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334986.247327:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+194:2359:x1848989694669696:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 2036us (2238us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.247342:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2712 00010000:00010000:3.0:1763334986.248013:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.248033:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:3.0:1763334986.248098:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00000004:00200000:3.0:1763334986.248104:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334986.248128:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d2b8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.248170:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d2b1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b082b expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.248193:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d2b8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b082b expref: 193 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.248203:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:3.0:1763334986.248206:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334986.248210:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8a00, rc 0) 00000100:00100000:3.0:1763334986.248288:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53671:x1848989694669568:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 8263us (8524us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334986.248296:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5080 00000100:00100000:2.0:1763334986.252402:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.252934:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694669952 00000100:00100000:0.0:1763334986.252950:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694669952 00000100:00100000:0.0:1763334986.253102:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5081 00000100:00100000:0.0:1763334986.253115:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53671:x1848989694669952:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334986.253142:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334986.253173:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d2bf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0832 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.253405:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d2c6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334986.253425:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d2c6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334986.253439:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d2c6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:0.0:1763334986.253454:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00010000:00010000:0.0:1763334986.253768:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d2bf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0832 expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.253789:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d2c6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0832 expref: 195 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.253799:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:0.0:1763334986.253803:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334986.253807:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793400, rc 0) 00000100:00100000:0.0:1763334986.253904:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53671:x1848989694669952:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 791us (1517us total) trans 8589939290 rc 0/0 00000100:00100000:0.0:1763334986.253913:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5081 00000100:00100000:1.0:1763334986.256556:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.256622:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.256647:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.256733:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694670080 00000100:00100000:0.0:1763334986.256745:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694670080 00000100:00100000:0.0:1763334986.256796:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694670208 00000100:00100000:0.0:1763334986.256798:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694670208 00000100:00100000:0.0:1763334986.256813:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694670336 00000100:00100000:0.0:1763334986.256815:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694670336 00000100:00100000:0.0:1763334986.256835:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5226 00000100:00100000:0.0:1763334986.256845:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+35:2360:x1848989694670080:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:0.0:1763334986.256915:0:26216:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.256939:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d241 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07f3 expref: 35 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.256948:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334986.256951:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334986.256956:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.257000:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d241 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07f3 expref: 35 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.257014:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d241 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07f3 expref: 35 pid: 26564 timeout: 1150 lvb_type: 0 00000100:00100000:0.0:1763334986.257033:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee544380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701906688:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334986.257124:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad0fffe40 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.257373:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5227 00000100:00100000:1.0:1763334986.257385:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694670208:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334986.257411:0:6519:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.257424:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d248 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07fa expref: 23 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.257430:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334986.257432:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334986.257435:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 4/0,1 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.257454:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07fa expref: 23 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.257463:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d248 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07fa expref: 23 pid: 26564 timeout: 1150 lvb_type: 0 00000100:00100000:1.0:1763334986.257473:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701906816:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334986.257502:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af6a65a80 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.257521:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5228 00000100:00100000:1.0:1763334986.257529:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+35:2360:x1848989694670336:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334986.257551:0:7819:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.257562:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849d24f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0801 expref: 35 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.257601:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334986.257604:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334986.257607:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.257627:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849d24f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0801 expref: 35 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.257641:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849d24f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0801 expref: 35 pid: 26564 timeout: 1150 lvb_type: 0 00000100:00100000:1.0:1763334986.257650:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701906944:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334986.257673:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5af6a65180 going to sleep for 11 seconds 00000100:00100000:2.0:1763334986.261027:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.261267:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee544380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701906688:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334986.261303:0:26216:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334986.261947:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694670464 00000100:00100000:1.0:1763334986.261959:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694670464 00010000:00010000:1.0:1763334986.262010:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d241 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07f3 expref: 36 pid: 26564 timeout: 1150 lvb_type: 0 00000100:00100000:1.0:1763334986.262059:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2713 00000100:00100000:1.0:1763334986.262071:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+36:2360:x1848989694670464:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334986.262091:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334986.262121:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d241 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07f3 expref: 36 pid: 26564 timeout: 1150 lvb_type: 0 00010000:00010000:1.0:1763334986.262136:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d241 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07f3 expref: 36 pid: 26564 timeout: 1150 lvb_type: 0 00010000:00010000:1.0:1763334986.262167:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d241 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07f3 expref: 36 pid: 26564 timeout: 1150 lvb_type: 0 00010000:00010000:1.0:1763334986.262186:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334986.262189:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334986.262194:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.262206:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.262231:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334986.262315:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+35:2360:x1848989694670464:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 246us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.262323:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2713 00010000:00010000:0.0:1763334986.262920:0:26216:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.262934:0:26216:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.262969:0:26216:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.262978:0:26216:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.262988:0:26216:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.262996:0:26216:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334986.263001:0:26216:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.263011:0:26216:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.263028:0:26216:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.263037:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792000/0xcedf0054f849d2d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334986.263151:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701906816:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334986.263176:0:6519:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334986.263834:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+34:2360:x1848989694670080:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 6986us (7293us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.263851:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5226 00000100:00100000:2.0:1763334986.264308:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.264862:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694670592 00000100:00100000:0.0:1763334986.264876:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694670592 00010000:00010000:0.0:1763334986.265187:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d248 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07fa expref: 24 pid: 26564 timeout: 1150 lvb_type: 0 00000100:00100000:0.0:1763334986.265238:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2714 00000100:00100000:0.0:1763334986.265249:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694670592:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334986.265267:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334986.265293:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d248 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07fa expref: 24 pid: 26564 timeout: 1150 lvb_type: 0 00010000:00010000:0.0:1763334986.265306:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d248 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07fa expref: 24 pid: 26564 timeout: 1150 lvb_type: 0 00010000:00010000:0.0:1763334986.265339:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d248 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07fa expref: 24 pid: 26564 timeout: 1150 lvb_type: 0 00010000:00010000:0.0:1763334986.265358:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.265360:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.265366:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.265382:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.265417:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334986.265490:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.265503:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701906944:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334986.265533:0:7819:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334986.265534:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2362:x1848989694670592:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 284us (1226us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.265551:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2714 00000100:00100000:0.0:1763334986.265595:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694670720 00000100:00100000:0.0:1763334986.265599:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694670720 00010000:00010000:0.0:1763334986.265614:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849d24f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0801 expref: 34 pid: 26564 timeout: 1150 lvb_type: 0 00000100:00100000:0.0:1763334986.265670:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2715 00000100:00100000:0.0:1763334986.265677:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+34:2360:x1848989694670720:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334986.265691:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334986.265707:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849d24f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0801 expref: 34 pid: 26564 timeout: 1150 lvb_type: 0 00010000:00010000:0.0:1763334986.265718:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849d24f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0801 expref: 34 pid: 26564 timeout: 1150 lvb_type: 0 00010000:00010000:0.0:1763334986.265732:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478000/0xcedf0054f849d24f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0801 expref: 34 pid: 26564 timeout: 1150 lvb_type: 0 00010000:00010000:0.0:1763334986.265742:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.265744:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.265747:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.265754:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.265780:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334986.265802:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2360:x1848989694670720:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 125us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.265809:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2715 00010000:00010000:2.0:1763334986.265812:0:7819:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.265821:0:7819:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.265835:0:6519:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.265842:0:6519:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.265849:0:7819:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.265858:0:7819:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.265858:0:6519:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.265867:0:6519:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.265869:0:7819:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.265874:0:6519:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.265877:0:7819:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334986.265880:0:6519:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334986.265882:0:7819:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.265902:0:7819:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.265916:0:7819:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.265923:0:7819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d2e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334986.265994:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2360:x1848989694670336:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 8465us (9345us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334986.266003:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5228 00010000:00010000:0.0:1763334986.266328:0:6519:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.266344:0:6519:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.266355:0:6519:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.266362:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d2db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334986.266410:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694670208:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 9029us (9787us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.266416:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5227 00000100:00100000:1.0:1763334986.269836:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.269907:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694670976 00000100:00100000:0.0:1763334986.269924:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694670976 00000100:00100000:0.0:1763334986.270008:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5082 00000100:00100000:0.0:1763334986.270021:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53671:x1848989694670976:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334986.270101:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1763334986.270138:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d2b8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b082b expref: 195 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.270163:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d26b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b080f expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.270175:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:0.0:1763334986.270181:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334986.270228:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d2e9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334986.270246:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d2e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334986.270257:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d2e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000040:00080000:0.0:1763334986.277246:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1205, 88 off103208 00000004:00080000:0.0:1763334986.277269:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1050910696730ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334986.277330:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1195, 88 off102152 00000004:00080000:0.0:1763334986.277337:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1050910765639ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334986.277373:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1196, 88 off102240 00000004:00080000:0.0:1763334986.277379:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1050910806499ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334986.277394:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1206, 88 off103296 00000004:00080000:0.0:1763334986.277397:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1050910825759ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334986.277420:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1197, 88 off102328 00000004:00080000:0.0:1763334986.277425:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1050910852683ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334986.277441:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1207, 88 off103384 00000004:00080000:0.0:1763334986.277445:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1050910873448ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334986.277458:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1208, 88 off103472 00000004:00080000:0.0:1763334986.277461:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1050910889742ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334986.277484:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1198, 88 off102416 00000004:00080000:0.0:1763334986.277488:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1050910916517ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334986.277517:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1199, 88 off102504 00000004:00080000:0.0:1763334986.277522:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1050910950300ns, next at 1047075229764ns, rc = 0 00000040:00080000:0.0:1763334986.277549:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1209, 88 off103560 00000004:00080000:0.0:1763334986.277554:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1050910982290ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334986.277598:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1210, 88 off103648 00000004:00080000:0.0:1763334986.277605:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1050911033244ns, next at 1047075157699ns, rc = 0 00000040:00080000:0.0:1763334986.277624:0:29628:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1200, 88 off102592 00000004:00080000:0.0:1763334986.277627:0:29628:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1050911055578ns, next at 1047075229764ns, rc = 0 00000001:00080000:1.0:1763334986.319140:0:32483:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939291 is committed 00000004:00080000:1.0:1763334986.319163:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 810 committed 00000004:00080000:1.0:1763334986.319175:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 822 committed 00000004:00080000:1.0:1763334986.319185:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 821 committed 00000004:00080000:1.0:1763334986.319187:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 809 committed 00000004:00080000:1.0:1763334986.319191:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 808 committed 00000004:00080000:1.0:1763334986.319194:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 820 committed 00000004:00080000:1.0:1763334986.319197:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 819 committed 00000004:00080000:1.0:1763334986.319199:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 807 committed 00000004:00080000:1.0:1763334986.319202:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 818 committed 00000004:00080000:1.0:1763334986.319204:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 806 committed 00000004:00080000:1.0:1763334986.319206:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 805 committed 00000004:00080000:1.0:1763334986.319208:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 817 committed 00000020:00080000:1.0:1763334986.319227:0:32483:0:(update_trans.c:1333:distribute_txn_batchid_cb()) lustre-MDT0000: 4294969320 batchid updated 00000100:00100000:1.0:1763334986.319407:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701907072:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.319518:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.319565:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701907584:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.319623:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.319648:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1763334986.319655:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701907200:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.319674:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.319691:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701907712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.319712:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.319746:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701907328:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.319769:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.319783:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1763334986.319788:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701907456:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.319806:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.319834:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701907072 00000100:00100000:1.0:1763334986.319843:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701907072 00000100:00100000:1.0:1763334986.319921:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701907584 00000100:00100000:1.0:1763334986.319926:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701907584 00000100:00100000:1.0:1763334986.319944:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701907200 00000100:00100000:1.0:1763334986.319948:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701907200 00000100:00100000:1.0:1763334986.319965:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701907712 00000100:00100000:1.0:1763334986.319968:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701907712 00000100:00100000:1.0:1763334986.319983:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701907328 00000100:00100000:1.0:1763334986.319986:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701907328 00000100:00100000:1.0:1763334986.319995:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701907456 00000100:00100000:1.0:1763334986.319998:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701907456 00000100:00100000:1.0:1763334986.320015:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5229 00000100:00100000:1.0:1763334986.320024:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701907072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.320336:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701907072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 312us (818us total) trans 17179871310 rc 0/0 00000100:00100000:1.0:1763334986.320348:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5229 00000100:00100000:1.0:1763334986.320371:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5230 00000100:00100000:1.0:1763334986.320377:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701907584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334986.320465:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334986.320469:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb mtime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334986.320473:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334986.320476:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb ctime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334986.320478:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334986.320503:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701907584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 126us (880us total) trans 17179871311 rc 0/0 00000100:00100000:1.0:1763334986.320510:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5230 00000100:00100000:1.0:1763334986.320524:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5231 00000100:00100000:1.0:1763334986.320530:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701907200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.320664:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701907200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 133us (987us total) trans 17179871312 rc 0/0 00000100:00100000:1.0:1763334986.320671:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5231 00000100:00100000:1.0:1763334986.320684:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5232 00000100:00100000:1.0:1763334986.320691:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701907712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.320789:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3291:x1848989701907712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 98us (1075us total) trans 17179871313 rc 0/0 00000100:00100000:1.0:1763334986.320794:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5232 00000100:00100000:1.0:1763334986.320806:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5233 00000100:00100000:1.0:1763334986.320811:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701907328:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334986.320902:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334986.320905:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334986.320908:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334986.320911:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334986.320913:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334986.320947:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701907328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 136us (1178us total) trans 17179871314 rc 0/0 00000100:00100000:1.0:1763334986.320955:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5233 00000100:00100000:1.0:1763334986.320967:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5234 00000100:00100000:1.0:1763334986.320973:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701907456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334986.321054:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 85452 -> 85452 00002000:00010000:1.0:1763334986.321057:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334986.321059:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:1.0:1763334986.321061:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:1.0:1763334986.321064:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1763334986.321089:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3289:x1848989701907456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 116us (1282us total) trans 17179871315 rc 0/0 00000100:00100000:1.0:1763334986.321095:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5234 00000004:00080000:1.0:1763334986.321183:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac6c1df80/2, rc 0, transno 17179871315 00000100:00100000:1.0:1763334986.321191:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701907456:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334986.321202:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac6c1f800/2, rc 0, transno 17179871314 00000100:00100000:1.0:1763334986.321205:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701907328:0@lo:2:osp-syn-1-0.0 00000020:00080000:1.0:1763334986.321223:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969320 00000020:00080000:1.0:1763334986.321424:0:29663:0:(update_trans.c:1295:distribute_txn_cancel_records()) lustre-MDT0000-osd: batchid 4294969320 cancel update log [0x200000bd0:0x1:0x0].14: rc = 0 00000020:00080000:1.0:1763334986.321435:0:29663:0:(update_trans.c:1571:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294969320 00000004:00080000:1.0:1763334986.321456:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac6c1ce00/2, rc 0, transno 17179871312 00000100:00100000:1.0:1763334986.321462:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701907200:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334986.321469:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac6c1d500/2, rc 0, transno 17179871313 00000100:00100000:1.0:1763334986.321472:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701907712:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334986.321478:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac6c1f100/2, rc 0, transno 17179871310 00000100:00100000:1.0:1763334986.321481:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701907072:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334986.321487:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac6c1c380/2, rc 0, transno 17179871311 00000100:00100000:1.0:1763334986.321489:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701907584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1763334986.321967:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701908224:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334986.322018:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334986.322048:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1763334986.322053:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701908096:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334986.322072:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334986.322092:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701908224 00000100:00100000:2.0:1763334986.322099:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701908224 00000100:00100000:2.0:1763334986.322133:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701908096 00000100:00100000:2.0:1763334986.322135:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701908096 00000100:00100000:2.0:1763334986.322151:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5235 00000100:00100000:2.0:1763334986.322157:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3292:x1848989701908224:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334986.322299:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334986.322302:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:2.0:1763334986.322304:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:2.0:1763334986.322307:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:2.0:1763334986.322309:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334986.322343:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3292:x1848989701908224:12345-0@lo:2:osp-syn-0-0.0 Request processed in 186us (325us total) trans 21474838542 rc 0/0 00000100:00100000:2.0:1763334986.322349:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5235 00000100:00100000:2.0:1763334986.322367:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5236 00000100:00100000:2.0:1763334986.322373:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+19:3292:x1848989701908096:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334986.322446:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 85452 -> 85452 00002000:00010000:2.0:1763334986.322449:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334983 -> 1763334983 00002000:00010000:2.0:1763334986.322451:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:2.0:1763334986.322453:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334983 -> 1763334983 00002000:00010000:2.0:1763334986.322455:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1763334986.322478:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb345450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3292:x1848989701908096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 105us (403us total) trans 21474838543 rc 0/0 00000100:00100000:2.0:1763334986.322483:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5236 00000004:00080000:2.0:1763334986.322657:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca871c00/2, rc 0, transno 21474838543 00000100:00100000:2.0:1763334986.322662:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701908096:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334986.322669:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca871f80/2, rc 0, transno 21474838542 00000100:00100000:2.0:1763334986.322672:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701908224:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1763334986.322788:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000704e7b5f reply state 00000000f0d17903 transno 8589939291 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d2e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:3.0:1763334986.322802:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1763334986.322927:0:29628:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763334986.322945:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53671:x1848989694670976:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 52926us (53124us total) trans 8589939291 rc 0/0 00000100:00100000:3.0:1763334986.322952:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5082 00010000:00010000:3.0:1763334986.322978:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d2e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.322987:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d2e9 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.322994:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d2e9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.323000:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334986.323005:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d2e9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.323013:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d2e9 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.323032:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:3.0:1763334986.323036:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334986.323042:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d2e9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.323048:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d2e9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334986.323450:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5b01f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701907840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334986.323460:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ad809fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701907968:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334986.323510:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.323542:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701907968 00000100:00100000:0.0:1763334986.323552:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701908480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.323563:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701907968 00000100:00100000:0.0:1763334986.323607:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.323637:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701908480 00000100:00100000:1.0:1763334986.323642:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701908480 00000100:00100000:1.0:1763334986.323681:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5237 00000100:00100000:1.0:1763334986.323690:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3290:x1848989701907968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334986.323831:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5238 00000100:00100000:0.0:1763334986.323840:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3290:x1848989701908480:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334986.323969:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334986.323972:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb mtime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334986.323976:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334986.323978:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb ctime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334986.323981:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334986.324019:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+23:3290:x1848989701908480:12345-0@lo:2:osp-syn-0-0.0 Request processed in 181us (411us total) trans 21474838545 rc 0/0 00000100:00100000:0.0:1763334986.324027:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5238 00000004:00080000:0.0:1763334986.324069:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee9d6a00/2, rc 0, transno 21474838545 00000100:00100000:0.0:1763334986.324075:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee9d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701908480:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.324852:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3290:x1848989701907968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1156us (1335us total) trans 21474838544 rc 0/0 00000100:00100000:1.0:1763334986.324873:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5237 00000100:00100000:3.0:1763334986.325916:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334986.325982:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59ca870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701908352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334986.326040:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1763334986.326286:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ad809fb80/2, rc 0, transno 21474838544 00000100:00100000:0.0:1763334986.326293:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ad809fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701907968:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1763334986.326373:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701907840 00000100:00100000:2.0:1763334986.326383:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701907840 00000100:00100000:2.0:1763334986.326443:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701908352 00000100:00100000:2.0:1763334986.326447:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701908352 00000100:00100000:2.0:1763334986.326479:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5239 00000100:00100000:2.0:1763334986.326490:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+23:3289:x1848989701907840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.326502:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5240 00000100:00100000:1.0:1763334986.326514:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+23:3289:x1848989701908352:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1763334986.326945:0:7819:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334986.326945:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb size from disk: 262144 -> 262144 00002000:00010000:1.0:1763334986.326953:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb mtime from disk: 1763334984 -> 1763334984 00002000:00010000:2.0:1763334986.326954:0:7819:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334986.326959:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:2.0:1763334986.326960:0:7819:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334986.326963:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb ctime from disk: 1763334984 -> 1763334984 00002000:00010000:2.0:1763334986.326965:0:7819:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334986.326970:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb blocks from disk: 515 -> 515 00002000:00010000:2.0:1763334986.326971:0:7819:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334986.327745:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+25:3289:x1848989701908352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1230us (1698us total) trans 21474838547 rc 0/0 00000100:00100000:2.0:1763334986.327753:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3289:x1848989701907840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1262us (1839us total) trans 21474838546 rc 0/0 00000100:00100000:1.0:1763334986.327761:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5240 00000100:00100000:2.0:1763334986.327769:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5239 00000100:00100000:1.0:1763334986.327913:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000004:00080000:0.0:1763334986.328350:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5b01f2c380/2, rc 0, transno 21474838546 00000100:00100000:0.0:1763334986.328358:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5b01f2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701907840:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334986.328370:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a59ca870000/2, rc 0, transno 21474838547 00000100:00100000:0.0:1763334986.328375:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59ca870000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701908352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334986.328540:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694671104 00000100:00100000:3.0:1763334986.328548:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694671104 00000100:00100000:3.0:1763334986.328641:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5083 00000100:00100000:3.0:1763334986.328651:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53671:x1848989694671104:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334986.328675:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334986.328703:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d2f0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0839 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.328774:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d2f0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0839 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.328790:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d2f0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0839 expref: 189 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.328811:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:3.0:1763334986.328814:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1763334986.328819:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8000, rc 0) 00000100:00100000:3.0:1763334986.328898:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53671:x1848989694671104:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 247us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334986.328905:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5083 00000100:00100000:2.0:1763334986.333681:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.334982:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694671232 00000100:00100000:1.0:1763334986.335002:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694671232 00000100:00100000:1.0:1763334986.335100:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5084 00000100:00100000:1.0:1763334986.335113:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53671:x1848989694671232:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334986.335142:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334986.335177:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d2f7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0840 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.335306:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d2fe lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.335327:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d2fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.335343:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d2fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334986.335381:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00000004:00200000:1.0:1763334986.335387:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334986.335410:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d2fe lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.335440:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d2f7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0840 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.335466:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d2fe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0840 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.335483:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:1.0:1763334986.335487:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334986.335493:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478800, rc 0) 00000100:00100000:1.0:1763334986.335650:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53671:x1848989694671232:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 538us (1985us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.335659:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5084 00000100:00100000:2.0:1763334986.344242:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.344331:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694671360 00000100:00100000:1.0:1763334986.344347:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694671360 00000100:00100000:1.0:1763334986.344429:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5241 00000100:00100000:1.0:1763334986.344442:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2360:x1848989694671360:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334986.344469:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334986.345111:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d305 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0847 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334986.345147:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 133906, mtime: 0x691a5b4a, atime: 0x691a5b49, ctime: 0x691a5b4a, blocks: 0xa1 00010000:00010000:1.0:1763334986.345175:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334986.345178:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334986.345191:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d305 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0847 expref: 33 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334986.345212:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d305 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0847 expref: 33 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334986.345344:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:1.0:1763334986.345435:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2360:x1848989694671360:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 995us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.345451:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5241 00000100:00100000:2.0:1763334986.346329:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.346363:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.346438:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694671488 00000100:00100000:1.0:1763334986.346448:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694671488 00000100:00100000:0.0:1763334986.346756:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694671616 00000100:00100000:0.0:1763334986.346762:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694671616 00000100:00100000:0.0:1763334986.346802:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5242 00000100:00100000:0.0:1763334986.346813:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694671488:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334986.346834:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334986.346861:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d30c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b084e expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334986.346964:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5243 00000100:00100000:1.0:1763334986.346973:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2360:x1848989694671616:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334986.346982:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334986.346996:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d313 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0855 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334986.347014:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x691a5b4a, atime: 0x691a5b49, ctime: 0x691a5b4a, blocks: 0x3 00010000:00010000:1.0:1763334986.347034:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334986.347036:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334986.347046:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d313 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0855 expref: 34 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334986.347063:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d313 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0855 expref: 34 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334986.347074:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:1.0:1763334986.347134:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+34:2360:x1848989694671616:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 162us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.347141:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5243 00002000:00010000:0.0:1763334986.347518:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x248:0x0] initial LVB size: 0, mtime: 0x691a5b4a, atime: 0x691a5b49, ctime: 0x691a5b4a, blocks: 0x3 00010000:00010000:0.0:1763334986.347535:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.347537:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.347771:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d30c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b084e expref: 23 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.347789:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d30c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b084e expref: 23 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.347799:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334986.347848:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694671488:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1036us (1523us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.347856:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5242 00000100:00100000:2.0:1763334986.391434:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.392133:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694671744 00000100:00100000:0.0:1763334986.392150:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694671744 00000100:00100000:0.0:1763334986.392254:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1989 00000100:00100000:0.0:1763334986.392267:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+34:2360:x1848989694671744:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334986.392317:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d31a lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.392338:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.392340:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.392348:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d31a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.392368:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d31a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.397969:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d31a lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.397996:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d31a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.398006:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d31a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.398023:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334986.398028:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d31a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.398037:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d31a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.398064:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d31a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.398077:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d31a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334986.398230:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+34:2360:x1848989694671744:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 5953us (6797us total) trans 0 rc 133906/133906 00000100:00100000:0.0:1763334986.398242:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1989 00000100:00100000:2.0:1763334986.403450:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.403557:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694671872 00000100:00100000:0.0:1763334986.403672:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694671872 00000100:00100000:0.0:1763334986.404325:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1990 00000100:00100000:0.0:1763334986.404342:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694671872:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:0.0:1763334986.404391:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.404413:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cf93 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f0 expref: 23 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.404422:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.404424:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.404428:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.404473:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cf93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f0 expref: 23 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.404489:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cf93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f0 expref: 23 pid: 21625 timeout: 1151 lvb_type: 1 00000100:00100000:0.0:1763334986.404514:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14183:1848989701908608:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334986.404872:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad0ffff00 going to sleep for 11 seconds 00000100:00100000:0.0:1763334986.407790:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14183:1848989701908608:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334986.407830:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334986.408994:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.409295:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694672000 00000100:00100000:0.0:1763334986.409309:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694672000 00010000:00010000:0.0:1763334986.409365:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cf93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f0 expref: 24 pid: 21625 timeout: 1151 lvb_type: 1 00000100:00100000:0.0:1763334986.409411:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2716 00000100:00100000:0.0:1763334986.409423:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694672000:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334986.409443:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334986.409471:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cf93 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f0 expref: 24 pid: 21625 timeout: 1151 lvb_type: 1 00010000:00010000:0.0:1763334986.409485:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cf93 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f0 expref: 24 pid: 21625 timeout: 1151 lvb_type: 1 00010000:00010000:0.0:1763334986.409517:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849cf93 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f0 expref: 24 pid: 21625 timeout: 1151 lvb_type: 1 00010000:00010000:0.0:1763334986.409540:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.409544:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.409551:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.409562:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.409663:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334986.409731:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694672000:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 309us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.409740:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2716 00010000:00010000:2.0:1763334986.410512:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.410528:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000001:00080000:1.0:1763334986.448566:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838548 is committed 00000001:00080000:1.0:1763334986.448617:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838545 is committed 00000001:00080000:1.0:1763334986.448647:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838547 is committed 00002000:00010000:0.0:1763334986.449102:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 85452 -> 135168 00002000:00010000:0.0:1763334986.449109:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334983 -> 1763334987 00002000:00010000:0.0:1763334986.449112:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334983 -> 1763334987 00010000:00010000:0.0:1763334986.449135:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.449151:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.449162:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.449170:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334986.449176:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.449187:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.449223:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.449230:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d321 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334986.449376:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694671872:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 45030us (45932us total) trans 21474838548 rc 0/0 00000100:00100000:0.0:1763334986.449388:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1990 00000100:00100000:2.0:1763334986.454526:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.455243:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694672128 00000100:00100000:0.0:1763334986.455257:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694672128 00000100:00100000:0.0:1763334986.455408:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1991 00000100:00100000:0.0:1763334986.455421:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+34:2359:x1848989694672128:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:0.0:1763334986.455468:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.455493:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f849cf9a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f7 expref: 34 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.455502:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.455504:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.455509:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.455551:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f849cf9a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f7 expref: 34 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.455653:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f849cf9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f7 expref: 34 pid: 26564 timeout: 1151 lvb_type: 1 00000100:00100000:0.0:1763334986.455674:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701908736:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334986.455816:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad0ffff00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.459409:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.459518:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694672256 00000100:00100000:3.0:1763334986.459534:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694672256 00010000:00010000:3.0:1763334986.459625:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f849cf9a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f7 expref: 35 pid: 26564 timeout: 1151 lvb_type: 1 00000100:00100000:3.0:1763334986.459680:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2717 00000100:00100000:3.0:1763334986.459691:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+35:2359:x1848989694672256:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334986.459709:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334986.459737:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f849cf9a lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f7 expref: 35 pid: 26564 timeout: 1151 lvb_type: 1 00010000:00010000:3.0:1763334986.459752:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f849cf9a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f7 expref: 35 pid: 26564 timeout: 1151 lvb_type: 1 00010000:00010000:3.0:1763334986.459783:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334986.459785:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334986.459791:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.459802:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.459825:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334986.459913:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d3a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+35:2359:x1848989694672256:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 222us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334986.459921:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2717 00010000:00010000:0.0:1763334986.460175:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac168fe00/0xcedf0054f849cf9a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06f7 expref: 34 pid: 26564 timeout: 1151 lvb_type: 1 00000100:00100000:0.0:1763334986.460195:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701908736:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334986.460219:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.460230:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.460237:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000001:00080000:3.0:1763334986.507010:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871316 is committed 00000001:00080000:3.0:1763334986.507052:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871315 is committed 00002000:00010000:0.0:1763334986.507273:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 85452 -> 135168 00002000:00010000:0.0:1763334986.507279:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334983 -> 1763334987 00002000:00010000:0.0:1763334986.507282:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334983 -> 1763334987 00010000:00010000:0.0:1763334986.507301:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.507315:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.507326:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.507335:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334986.507340:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.507350:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.507373:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.507381:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d328 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334986.507941:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694672128:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 52514us (53423us total) trans 17179871316 rc 0/0 00000100:00100000:0.0:1763334986.507954:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1991 00000100:00100000:1.0:1763334986.511970:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.512549:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694672384 00000100:00100000:0.0:1763334986.512566:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694672384 00000100:00100000:0.0:1763334986.512781:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1992 00000100:00100000:0.0:1763334986.512796:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694672384:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:0.0:1763334986.512853:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.512888:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d00a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0713 expref: 15 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.512901:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.512904:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.512910:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.512959:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d00a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0713 expref: 15 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.512977:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d00a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0713 expref: 15 pid: 21625 timeout: 1151 lvb_type: 1 00000100:00100000:0.0:1763334986.512995:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14183:1848989701908864:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334986.513717:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad0ffff00 going to sleep for 11 seconds 00000100:00100000:0.0:1763334986.517808:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14183:1848989701908864:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334986.517848:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334986.518744:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.518864:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694672512 00000100:00100000:2.0:1763334986.518875:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694672512 00010000:00010000:2.0:1763334986.518936:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d00a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0713 expref: 16 pid: 21625 timeout: 1151 lvb_type: 1 00000100:00100000:2.0:1763334986.518980:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2718 00000100:00100000:2.0:1763334986.518992:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694672512:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334986.519011:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334986.519041:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d00a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0713 expref: 16 pid: 21625 timeout: 1151 lvb_type: 1 00010000:00010000:2.0:1763334986.519056:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d00a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0713 expref: 16 pid: 21625 timeout: 1151 lvb_type: 1 00010000:00010000:2.0:1763334986.519085:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d00a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0713 expref: 16 pid: 21625 timeout: 1151 lvb_type: 1 00010000:00010000:2.0:1763334986.519106:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.519109:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.519115:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.519127:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.519753:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334986.519846:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694672512:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 852us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334986.519857:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2718 00010000:00010000:0.0:1763334986.520453:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.520467:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000001:00080000:0.0:1763334986.565423:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838549 is committed 00002000:00010000:1.0:1763334986.565832:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb mtime from disk: 1763334984 -> 1763334987 00002000:00010000:1.0:1763334986.565838:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb ctime from disk: 1763334984 -> 1763334987 00010000:00010000:1.0:1763334986.565857:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.565871:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.565937:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.565946:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334986.565951:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.565963:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.565991:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.566000:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d32f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334986.566359:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2360:x1848989694672384:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 53557us (54396us total) trans 21474838549 rc 0/0 00000100:00100000:1.0:1763334986.566372:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1992 00000100:00100000:1.0:1763334986.569654:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.569770:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694672640 00000100:00100000:0.0:1763334986.569784:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694672640 00000100:00100000:0.0:1763334986.569940:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1993 00000100:00100000:0.0:1763334986.569953:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694672640:12345-192.168.201.60@tcp:4:lfs.0 00002000:00010000:0.0:1763334986.570026:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x251:0x0] initial LVB size: 233688, mtime: 0x691a5b49, atime: 0x691a5b49, ctime: 0x691a5b49, blocks: 0x203 00010000:00010000:0.0:1763334986.570038:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d336 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.570054:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.570057:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.570064:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d336 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.570081:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d336 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.597725:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1763334986.599073:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871317 is committed 00002000:00010000:0.0:1763334986.599397:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb mtime from disk: 1763334985 -> 1763334987 00002000:00010000:0.0:1763334986.599403:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb ctime from disk: 1763334985 -> 1763334987 00010000:00010000:0.0:1763334986.599426:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d336 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.599440:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d336 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.599451:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d336 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.599458:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334986.599464:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d336 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.599478:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d336 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.599505:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d336 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.599512:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793000/0xcedf0054f849d336 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334986.600154:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694672640:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 30192us (30504us total) trans 17179871317 rc 0/0 00000100:00100000:0.0:1763334986.600168:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1993 00000100:00100000:3.0:1763334986.613058:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.613161:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694672896 00000100:00100000:0.0:1763334986.613176:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694672896 00000100:00100000:0.0:1763334986.613243:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5085 00000100:00100000:0.0:1763334986.613269:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53671:x1848989694672896:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334986.613341:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334986.613376:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d2fe lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0840 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.613398:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:0.0:1763334986.613404:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334986.613807:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d33d lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334986.613825:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d33d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334986.613841:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d33d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000001:00080000:0.0:1763334986.613929:0:29628:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939292 00000004:00010000:0.0:1763334986.613962:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000eb996599 reply state 00000000cb5eb337 transno 8589939293 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d33d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:0.0:1763334986.613973:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334986.614087:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53671:x1848989694672896:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 832us (1048us total) trans 8589939293 rc 0/0 00000100:00100000:0.0:1763334986.614097:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5085 00000020:00080000:0.0:1763334986.614104:0:29628:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763334986.616993:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.617409:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694673024 00000100:00100000:0.0:1763334986.617423:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694673024 00000100:00100000:0.0:1763334986.617500:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5244 00000100:00100000:0.0:1763334986.617510:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+14:53671:x1848989694673024:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334986.617533:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334986.617564:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d344 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b085c expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334986.617624:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 135168, mtime: 0x691a5b4b, atime: 0x691a5b40, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:0.0:1763334986.617654:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.617656:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.617666:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d344 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b085c expref: 15 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.617686:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d344 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b085c expref: 15 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.617707:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334986.617776:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+15:53671:x1848989694673024:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 268us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.617784:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5244 00010000:00010000:3.0:1763334986.618013:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d33d lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.618023:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d33d lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.618031:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d33d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.618037:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334986.618043:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d33d lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.618051:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d33d lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.618069:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:3.0:1763334986.618072:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334986.618077:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d33d lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.618084:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d33d lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334986.620353:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.620397:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.620632:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694673152 00000100:00100000:1.0:1763334986.620647:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694673152 00002000:00010000:1.0:1763334986.620710:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/586 (133906->18446744073709551615) 00002000:00100000:1.0:1763334986.620715:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9830700 with x1848989694673152 ext(133906->18446744073709551615) 00002000:00010000:1.0:1763334986.620731:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9830700. 00000100:00100000:1.0:1763334986.620756:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694673280 00000100:00100000:1.0:1763334986.620759:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694673280 00002000:00010000:1.0:1763334986.620773:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/590 (0->18446744073709551615) 00002000:00100000:1.0:1763334986.620776:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9833100 with x1848989694673280 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334986.620783:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9833100. 00000100:00100000:1.0:1763334986.620801:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1994 00000100:00100000:1.0:1763334986.620811:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2359:x1848989694673152:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:1.0:1763334986.621230:0:21630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 135168 -> 133906 00002000:00010000:1.0:1763334986.621234:0:21630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:1.0:1763334986.621237:0:21630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334986.621240:0:21630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:1.0:1763334986.621243:0:21630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:1.0:1763334986.621313:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2359:x1848989694673152:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 503us (975us total) trans 21474838550 rc 0/0 00000100:00100000:1.0:1763334986.621321:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1994 00002000:00010000:1.0:1763334986.621325:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/586 (133906->18446744073709551615) 00002000:00100000:1.0:1763334986.621328:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9830700 with x1848989694673152 ext(133906->18446744073709551615) 00002000:00010000:1.0:1763334986.621333:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a59c9830700. 00000100:00100000:1.0:1763334986.621354:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1995 00000100:00100000:1.0:1763334986.621361:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694673280:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:1.0:1763334986.621517:0:21630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334986.621521:0:21630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334983 -> 1763334987 00002000:00010000:1.0:1763334986.621524:0:21630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334986.621527:0:21630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334983 -> 1763334987 00002000:00010000:1.0:1763334986.621529:0:21630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334986.621550:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694673280:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 189us (1153us total) trans 17179871318 rc 0/0 00000100:00100000:1.0:1763334986.621556:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1995 00002000:00010000:1.0:1763334986.621559:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/590 (0->18446744073709551615) 00002000:00100000:1.0:1763334986.621561:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a59c9833100 with x1848989694673280 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334986.621565:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a59c9833100. 00000100:00100000:1.0:1763334986.624388:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.624502:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694673408 00000100:00100000:2.0:1763334986.624516:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694673408 00000100:00100000:2.0:1763334986.624635:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5086 00000100:00100000:2.0:1763334986.624647:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53671:x1848989694673408:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334986.624681:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334986.624709:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d34b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0863 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.624819:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d352 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334986.624838:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d352 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334986.624852:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d352 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334986.624893:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00000004:00200000:2.0:1763334986.624898:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334986.624918:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d352 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334986.624952:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d34b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0863 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.624969:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d352 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0863 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.624978:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:2.0:1763334986.624982:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334986.624986:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430200, rc 0) 00000100:00100000:2.0:1763334986.625049:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53671:x1848989694673408:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 405us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334986.625056:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5086 00000100:00100000:1.0:1763334986.628001:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.628128:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694673664 00000100:00100000:0.0:1763334986.628143:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694673664 00000100:00100000:0.0:1763334986.628216:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5087 00000100:00100000:0.0:1763334986.628228:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53671:x1848989694673664:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334986.628298:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334986.628334:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d352 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0863 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.628359:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:0.0:1763334986.628364:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334986.628720:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d359 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334986.628736:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d359 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334986.628747:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d359 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000001:00080000:0.0:1763334986.628813:0:29628:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939294 00000004:00010000:0.0:1763334986.628844:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006965dbbd reply state 00000000e6b84dad transno 8589939295 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d359 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:0.0:1763334986.628854:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334986.628979:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53671:x1848989694673664:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 752us (991us total) trans 8589939295 rc 0/0 00000100:00100000:0.0:1763334986.628987:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5087 00000020:00080000:0.0:1763334986.628994:0:29628:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763334986.632315:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d359 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.632340:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d359 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.632349:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d359 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.632356:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334986.632362:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d359 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.632371:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d359 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.632392:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:3.0:1763334986.632396:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334986.632401:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d359 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.632412:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d359 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334986.632746:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.633415:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694673792 00000100:00100000:2.0:1763334986.633431:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694673792 00000100:00100000:2.0:1763334986.633506:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5245 00000100:00100000:2.0:1763334986.633519:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:53671:x1848989694673792:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334986.633545:0:7819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334986.633605:0:7819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431400/0xcedf0054f849d360 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b086a expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334986.633639:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 135168, mtime: 0x691a5b4b, atime: 0x691a5b44, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:2.0:1763334986.633671:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.633673:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.633683:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431400/0xcedf0054f849d360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b086a expref: 28 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.633703:0:7819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431400/0xcedf0054f849d360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b086a expref: 28 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.633719:0:7819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334986.633796:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:53671:x1848989694673792:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 281us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334986.633805:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5245 00000100:00100000:1.0:1763334986.636066:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.636104:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.636186:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694673920 00000100:00100000:3.0:1763334986.636200:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694673920 00002000:00010000:3.0:1763334986.636256:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/591 (133906->18446744073709551615) 00002000:00100000:3.0:1763334986.636262:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac6c1ca80 with x1848989694673920 ext(133906->18446744073709551615) 00002000:00010000:3.0:1763334986.636277:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac6c1ca80. 00000100:00100000:3.0:1763334986.636312:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694674048 00000100:00100000:3.0:1763334986.636315:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694674048 00002000:00010000:3.0:1763334986.636332:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/587 (0->18446744073709551615) 00002000:00100000:3.0:1763334986.636335:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac6c1e300 with x1848989694674048 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334986.636343:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac6c1e300. 00000100:00100000:3.0:1763334986.636370:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1996 00000100:00100000:3.0:1763334986.636382:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694673920:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:3.0:1763334986.636846:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 135168 -> 133906 00002000:00010000:3.0:1763334986.636851:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:3.0:1763334986.636853:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334986.636856:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:3.0:1763334986.636858:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:3.0:1763334986.636948:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694673920:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 566us (896us total) trans 17179871319 rc 0/0 00000100:00100000:3.0:1763334986.636956:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1996 00002000:00010000:3.0:1763334986.636960:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/591 (133906->18446744073709551615) 00002000:00100000:3.0:1763334986.636963:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac6c1ca80 with x1848989694673920 ext(133906->18446744073709551615) 00002000:00010000:3.0:1763334986.636968:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac6c1ca80. 00000100:00100000:3.0:1763334986.636992:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1997 00000100:00100000:3.0:1763334986.637000:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694674048:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:3.0:1763334986.637152:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334986.637156:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334983 -> 1763334987 00002000:00010000:3.0:1763334986.637158:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334986.637161:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334983 -> 1763334987 00002000:00010000:3.0:1763334986.637164:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334986.637188:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694674048:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 189us (1083us total) trans 21474838551 rc 0/0 00000100:00100000:3.0:1763334986.637195:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1997 00002000:00010000:3.0:1763334986.637198:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/587 (0->18446744073709551615) 00002000:00100000:3.0:1763334986.637201:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac6c1e300 with x1848989694674048 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334986.637205:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac6c1e300. 00000100:00100000:1.0:1763334986.642236:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.642445:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694674176 00000100:00100000:2.0:1763334986.642459:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694674176 00000100:00100000:0.0:1763334986.643138:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5088 00000100:00100000:0.0:1763334986.643160:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53671:x1848989694674176:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334986.643194:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334986.643226:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d367 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0871 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.643717:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d36e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.643739:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d36e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.643753:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d36e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:1.0:1763334986.643789:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00000004:00200000:1.0:1763334986.643795:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334986.643815:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d36e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.643863:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d367 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0871 expref: 195 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.643895:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d36e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0871 expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.643907:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:1.0:1763334986.643911:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334986.643917:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334986.644020:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53671:x1848989694674176:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 868us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.644030:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5088 00000100:00100000:1.0:1763334986.648534:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.649458:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694674432 00000100:00100000:2.0:1763334986.649478:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694674432 00000100:00100000:2.0:1763334986.649566:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5089 00000100:00100000:2.0:1763334986.649601:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53671:x1848989694674432:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334986.649680:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334986.649719:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d36e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0871 expref: 194 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.649743:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:2.0:1763334986.649749:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334986.650080:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d375 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334986.650096:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d375 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334986.650106:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d375 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:2.0:1763334986.650165:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939296 00000004:00010000:2.0:1763334986.650193:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000f1cbdbae reply state 000000001f87e46f transno 8589939297 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d375 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334986.650207:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334986.650348:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53671:x1848989694674432:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 750us (1830us total) trans 8589939297 rc 0/0 00000100:00100000:2.0:1763334986.650357:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5089 00000020:00080000:2.0:1763334986.650363:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763334986.658806:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334986.658933:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d375 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334986.658949:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d375 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334986.658957:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d375 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334986.658964:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334986.658970:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d375 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334986.658978:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d375 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334986.659001:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:3.0:1763334986.659005:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334986.659012:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d375 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334986.659018:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d375 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334986.659190:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694674560 00000100:00100000:0.0:1763334986.659204:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694674560 00000100:00100000:0.0:1763334986.659345:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5246 00000100:00100000:0.0:1763334986.659358:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+17:53671:x1848989694674560:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334986.659384:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334986.659410:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d37c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0878 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334986.659438:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24c:0x0] initial LVB size: 262144, mtime: 0x691a5b4b, atime: 0x691a5b48, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:0.0:1763334986.659467:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.659469:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.659478:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d37c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0878 expref: 18 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.659722:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d37c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0878 expref: 18 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.659737:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793000, rc 0) 00000100:00100000:0.0:1763334986.664761:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+18:53671:x1848989694674560:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5384us (5951us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.664777:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5246 00000100:00100000:3.0:1763334986.667468:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.667706:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694674688 00000100:00100000:0.0:1763334986.667720:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694674688 00000100:00100000:2.0:1763334986.668366:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5247 00000100:00100000:2.0:1763334986.668382:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:53671:x1848989694674688:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334986.668406:0:7819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334986.668430:0:7819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d383 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b087f expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.668467:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ceac lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06aa expref: 30 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.668477:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d1bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07d0 expref: 30 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.668485:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d01f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b072f expref: 30 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.668505:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d018 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0728 expref: 30 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.668512:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849d011 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0721 expref: 30 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.668521:0:7819:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d003 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b071a expref: 30 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.668528:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.668530:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.668535:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d383 lrc: 9/0,0 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b087f expref: 30 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.668610:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d003 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b071a expref: 30 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.668624:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d003 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b071a expref: 30 pid: 21625 timeout: 1151 lvb_type: 1 00000100:00100000:2.0:1763334986.668638:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9833800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701908992:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334986.668767:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849d011 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0721 expref: 30 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.668776:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849d011 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0721 expref: 30 pid: 25383 timeout: 1151 lvb_type: 1 00000100:00100000:2.0:1763334986.668784:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701909120:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334986.668806:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d018 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0728 expref: 30 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.668820:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d018 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0728 expref: 30 pid: 25383 timeout: 1151 lvb_type: 1 00000100:00100000:2.0:1763334986.668827:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9831180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701909248:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334986.668846:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d01f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b072f expref: 30 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.668853:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d01f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b072f expref: 30 pid: 6519 timeout: 1151 lvb_type: 1 00000100:00100000:2.0:1763334986.668860:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9831500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701909376:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334986.668890:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d1bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07d0 expref: 30 pid: 32239 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.668897:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d1bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07d0 expref: 30 pid: 32239 timeout: 1151 lvb_type: 1 00000100:00100000:2.0:1763334986.668904:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701909504:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334986.668927:0:7819:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ceac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06aa expref: 30 pid: 21625 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.668935:0:7819:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ceac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06aa expref: 30 pid: 21625 timeout: 1151 lvb_type: 1 00000100:00100000:2.0:1763334986.668948:0:7819:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9830000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701909632:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334986.668974:0:7819:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98540 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.672935:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.672974:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.673017:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.673057:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694674944 00000100:00100000:1.0:1763334986.673069:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694674944 00010000:00010000:1.0:1763334986.673115:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849d011 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0721 expref: 31 pid: 25383 timeout: 1151 lvb_type: 1 00000100:00100000:1.0:1763334986.673148:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694674816 00000100:00100000:1.0:1763334986.673151:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694674816 00010000:00010000:1.0:1763334986.673160:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d003 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b071a expref: 32 pid: 21625 timeout: 1151 lvb_type: 1 00000100:00100000:1.0:1763334986.673178:0:6532:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694675072 00000100:00100000:1.0:1763334986.673180:0:6532:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694675072 00010000:00010000:1.0:1763334986.673192:0:6532:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d018 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0728 expref: 33 pid: 25383 timeout: 1151 lvb_type: 1 00000100:00100000:1.0:1763334986.673205:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2719 00000100:00100000:1.0:1763334986.673215:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2360:x1848989694674944:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334986.673232:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334986.673259:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849d011 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0721 expref: 33 pid: 25383 timeout: 1151 lvb_type: 1 00010000:00010000:1.0:1763334986.673271:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849d011 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0721 expref: 33 pid: 25383 timeout: 1151 lvb_type: 1 00010000:00010000:1.0:1763334986.673301:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334986.673362:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+33:2360:x1848989694674944:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 148us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.673370:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2719 00000100:00100000:1.0:1763334986.673392:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2720 00000100:00100000:1.0:1763334986.673401:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2360:x1848989694674816:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334986.673409:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334986.673419:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d003 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b071a expref: 32 pid: 21625 timeout: 1151 lvb_type: 1 00010000:00010000:1.0:1763334986.673433:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d003 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b071a expref: 32 pid: 21625 timeout: 1151 lvb_type: 1 00010000:00010000:1.0:1763334986.673445:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334986.673466:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+32:2360:x1848989694674816:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 65us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.673472:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2720 00000100:00100000:1.0:1763334986.673485:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2721 00000100:00100000:1.0:1763334986.673508:0:6532:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694675072:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334986.673515:0:6532:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334986.673524:0:6532:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d018 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0728 expref: 31 pid: 25383 timeout: 1151 lvb_type: 1 00010000:00010000:1.0:1763334986.673533:0:6532:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d018 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0728 expref: 31 pid: 25383 timeout: 1151 lvb_type: 1 00010000:00010000:1.0:1763334986.673544:0:6532:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334986.673564:0:6532:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9e84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2360:x1848989694675072:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 56us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.673615:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2721 00010000:00010000:2.0:1763334986.674017:0:7819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d003 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x250:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b071a expref: 30 pid: 21625 timeout: 1151 lvb_type: 1 00000100:00100000:2.0:1763334986.674035:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9833800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701908992:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334986.674044:0:7819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849d011 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x250:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0721 expref: 29 pid: 25383 timeout: 1151 lvb_type: 1 00000100:00100000:2.0:1763334986.674053:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701909120:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334986.674062:0:7819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d018 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x250:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0728 expref: 28 pid: 25383 timeout: 1151 lvb_type: 1 00000100:00100000:2.0:1763334986.674069:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9831180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701909248:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334986.679824:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.680003:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9831500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701909376:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334986.680221:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.680682:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9831880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701909504:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334986.680694:0:7819:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9830000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:7819:1848989701909632:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334986.680747:0:7819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d383 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x250:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b087f expref: 27 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.680770:0:7819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431c00, rc 0) 00000100:00100000:2.0:1763334986.680844:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:53671:x1848989694674688:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 12466us (13388us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334986.680855:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5247 00000100:00100000:0.0:1763334986.682125:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694675200 00000100:00100000:0.0:1763334986.682145:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694675200 00010000:00010000:0.0:1763334986.682198:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d01f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b072f expref: 27 pid: 6519 timeout: 1151 lvb_type: 1 00000100:00100000:0.0:1763334986.682267:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694675328 00000100:00100000:0.0:1763334986.682272:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694675328 00010000:00010000:0.0:1763334986.682286:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d1bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07d0 expref: 28 pid: 32239 timeout: 1151 lvb_type: 1 00000100:00100000:0.0:1763334986.682314:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2722 00000100:00100000:0.0:1763334986.682323:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694675200:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334986.682341:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334986.682370:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d01f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b072f expref: 28 pid: 6519 timeout: 1151 lvb_type: 1 00010000:00010000:0.0:1763334986.682385:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d01f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b072f expref: 28 pid: 6519 timeout: 1151 lvb_type: 1 00010000:00010000:0.0:1763334986.682415:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d01f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x250:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b072f expref: 28 pid: 6519 timeout: 1151 lvb_type: 1 00010000:00010000:0.0:1763334986.682435:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334986.682483:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694675200:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 160us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.682702:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2723 00000100:00100000:1.0:1763334986.682711:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694675328:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334986.682723:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334986.682733:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d1bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07d0 expref: 27 pid: 32239 timeout: 1151 lvb_type: 1 00010000:00010000:1.0:1763334986.682742:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d1bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07d0 expref: 27 pid: 32239 timeout: 1151 lvb_type: 1 00010000:00010000:1.0:1763334986.682755:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5aec6d5600/0xcedf0054f849d1bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x250:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b07d0 expref: 27 pid: 32239 timeout: 1151 lvb_type: 1 00010000:00010000:1.0:1763334986.682765:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334986.682788:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5501180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694675328:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 80us (2569us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.682795:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2723 00000100:00100000:0.0:1763334986.684700:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2722 00000100:00100000:1.0:1763334986.687827:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.687966:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694675456 00000100:00100000:0.0:1763334986.687981:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694675456 00010000:00010000:0.0:1763334986.688034:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ceac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06aa expref: 25 pid: 21625 timeout: 1151 lvb_type: 1 00000100:00100000:0.0:1763334986.688086:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2724 00000100:00100000:0.0:1763334986.688098:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2361:x1848989694675456:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334986.688119:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334986.688147:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ceac lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06aa expref: 25 pid: 21625 timeout: 1151 lvb_type: 1 00010000:00010000:0.0:1763334986.688162:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ceac lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06aa expref: 25 pid: 21625 timeout: 1151 lvb_type: 1 00010000:00010000:0.0:1763334986.688200:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792e00/0xcedf0054f849ceac lrc: 0/0,0 mode: --/PR res: [0x280000400:0x250:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b06aa expref: 25 pid: 21625 timeout: 1151 lvb_type: 1 00010000:00010000:0.0:1763334986.688219:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.688221:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.688228:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d383 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b087f expref: 24 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.688239:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d383 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b087f expref: 24 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.688451:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431c00/0xcedf0054f849d383 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x250:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b087f expref: 24 pid: 7819 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334986.688468:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701909760:192.168.201.60@tcp:105: 00000100:00100000:0.0:1763334986.688891:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad0ffff00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.708376:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.708420:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.708708:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701909760:192.168.201.60@tcp:105: 00010000:00010000:0.0:1763334986.708741:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334986.708817:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d3a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694675456:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 20721us (21005us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.708834:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2724 00000100:00100000:2.0:1763334986.709171:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694675584 00000100:00100000:2.0:1763334986.709185:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694675584 00002000:00010000:2.0:1763334986.709242:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/588 (133906->18446744073709551615) 00002000:00100000:2.0:1763334986.709248:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5503b80 with x1848989694675584 ext(133906->18446744073709551615) 00002000:00010000:2.0:1763334986.709263:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac5503b80. 00000100:00100000:2.0:1763334986.709293:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694675712 00000100:00100000:2.0:1763334986.709298:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694675712 00002000:00010000:2.0:1763334986.709310:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/592 (0->18446744073709551615) 00002000:00100000:2.0:1763334986.709312:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44d180 with x1848989694675712 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334986.709319:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44d180. 00000100:00100000:2.0:1763334986.709346:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1998 00000100:00100000:2.0:1763334986.709356:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694675584:12345-192.168.201.60@tcp:10:lfs.0 00000100:00100000:1.0:1763334986.709566:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1999 00000100:00100000:1.0:1763334986.709604:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694675712:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:1.0:1763334986.709902:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334986.709906:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb mtime from disk: 1763334984 -> 1763334987 00002000:00010000:1.0:1763334986.709909:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334986.709911:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb ctime from disk: 1763334984 -> 1763334987 00002000:00010000:1.0:1763334986.709913:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334986.709957:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694675712:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 359us (1536us total) trans 17179871320 rc 0/0 00000100:00100000:1.0:1763334986.709965:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1999 00002000:00010000:1.0:1763334986.709968:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/592 (0->18446744073709551615) 00002000:00100000:1.0:1763334986.709971:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa44d180 with x1848989694675712 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334986.709975:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa44d180. 00002000:00010000:2.0:1763334986.710297:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb size from disk: 262144 -> 133906 00002000:00010000:2.0:1763334986.710301:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:2.0:1763334986.710303:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:2.0:1763334986.710305:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:2.0:1763334986.710307:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:2.0:1763334986.710343:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5503b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694675584:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 988us (1989us total) trans 21474838552 rc 0/0 00000100:00100000:2.0:1763334986.710349:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1998 00002000:00010000:2.0:1763334986.710352:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/588 (133906->18446744073709551615) 00002000:00100000:2.0:1763334986.710355:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5503b80 with x1848989694675584 ext(133906->18446744073709551615) 00002000:00010000:2.0:1763334986.710359:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac5503b80. 00000100:00100000:1.0:1763334986.720414:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.720836:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694675840 00000100:00100000:3.0:1763334986.720850:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694675840 00000100:00100000:3.0:1763334986.721086:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5090 00000100:00100000:3.0:1763334986.721098:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53671:x1848989694675840:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334986.721131:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334986.721163:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d38a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0886 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.721806:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d391 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.721830:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d391 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.721846:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d391 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:3.0:1763334986.721991:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00000004:00200000:3.0:1763334986.721998:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334986.722029:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d391 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.722067:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d38a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0886 expref: 197 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.722624:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d391 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0886 expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.722634:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:3.0:1763334986.722638:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334986.722642:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9a00, rc 0) 00000100:00100000:3.0:1763334986.722732:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53671:x1848989694675840:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1635us (2336us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334986.722741:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5090 00000100:00100000:1.0:1763334986.731759:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.732895:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694676096 00000100:00100000:2.0:1763334986.732913:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694676096 00000100:00100000:2.0:1763334986.733064:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5091 00000100:00100000:2.0:1763334986.733077:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53671:x1848989694676096:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334986.733150:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334986.733186:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d391 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0886 expref: 196 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.733211:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:2.0:1763334986.733217:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334986.734292:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d398 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.734318:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d398 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.734331:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d398 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000001:00080000:2.0:1763334986.734408:0:29628:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939298 00000004:00010000:2.0:1763334986.734436:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000fd7b1e7b reply state 0000000015d1aa0a transno 8589939299 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d398 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334986.734445:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334986.737233:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53671:x1848989694676096:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 4144us (5474us total) trans 8589939299 rc 0/0 00000100:00100000:2.0:1763334986.737248:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5091 00000020:00080000:2.0:1763334986.737257:0:29628:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1763334986.741054:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1763334986.741335:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d398 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.741352:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d398 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.741361:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d398 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.741368:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334986.741374:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d398 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.741383:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d398 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.741406:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:3.0:1763334986.741410:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334986.741417:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d398 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.741427:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d398 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334986.742113:0:7819:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694676224 00000100:00100000:2.0:1763334986.742131:0:7819:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694676224 00000100:00100000:2.0:1763334986.742220:0:7819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5248 00000100:00100000:2.0:1763334986.742235:0:7819:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:53671:x1848989694676224:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334986.742261:0:7819:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334986.742296:0:7819:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d39f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b088d expref: -99 pid: 7819 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334986.742330:0:7819:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x251:0x0] initial LVB size: 233688, mtime: 0x691a5b4b, atime: 0x691a5b49, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:2.0:1763334986.742360:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.742364:0:7819:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.742374:0:7819:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d39f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b088d expref: 26 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.742394:0:7819:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d39f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b088d expref: 26 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.742408:0:7819:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430e00, rc 0) 00000100:00100000:2.0:1763334986.742485:0:7819:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:53671:x1848989694676224:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 253us (1447us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334986.742493:0:7819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5248 00000100:00100000:1.0:1763334986.747823:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.748541:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694676352 00000100:00100000:0.0:1763334986.748565:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694676352 00000100:00100000:0.0:1763334986.748854:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5249 00000100:00100000:0.0:1763334986.748869:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac3794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+19:53671:x1848989694676352:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334986.748905:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334986.748934:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849d3a6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0894 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.748976:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d0d5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b078a expref: 20 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.748988:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.748990:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.748997:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849d3a6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0894 expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.749051:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d0d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b078a expref: 20 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.749068:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d0d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b078a expref: 20 pid: 6519 timeout: 1151 lvb_type: 1 00000100:00100000:0.0:1763334986.749086:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701909888:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334986.749509:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad0fff600 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.756110:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.756199:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694676480 00000100:00100000:2.0:1763334986.756212:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694676480 00000100:00100000:0.0:1763334986.756379:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701909888:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334986.756422:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849d3a6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0894 expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.756448:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792e00, rc 0) 00000100:00100000:0.0:1763334986.756525:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac3794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:53671:x1848989694676352:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7659us (8957us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.756535:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5249 00010000:00010000:2.0:1763334986.757728:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d0d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b078a expref: 20 pid: 6519 timeout: 1151 lvb_type: 1 00000100:00100000:2.0:1763334986.757789:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2725 00000100:00100000:2.0:1763334986.757805:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac3797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694676480:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334986.757826:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334986.757855:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d0d5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b078a expref: 20 pid: 6519 timeout: 1151 lvb_type: 1 00010000:00010000:2.0:1763334986.757870:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d0d5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b078a expref: 20 pid: 6519 timeout: 1151 lvb_type: 1 00010000:00010000:2.0:1763334986.757914:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d0d5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b078a expref: 20 pid: 6519 timeout: 1151 lvb_type: 1 00010000:00010000:2.0:1763334986.757934:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.757936:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.757943:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849d3a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0894 expref: 19 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.757955:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849d3a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0894 expref: 19 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.758004:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792e00/0xcedf0054f849d3a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0894 expref: 19 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334986.758021:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9830000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701910016:192.168.201.60@tcp:105: 00000100:00100000:2.0:1763334986.758122:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98540 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.762034:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.762156:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694676608 00000100:00100000:0.0:1763334986.762172:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694676608 00002000:00010000:0.0:1763334986.762232:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/593 (133906->18446744073709551615) 00002000:00100000:0.0:1763334986.762238:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac3794a80 with x1848989694676608 ext(133906->18446744073709551615) 00002000:00010000:0.0:1763334986.762255:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac3794a80. 00000100:00100000:0.0:1763334986.762296:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2000 00000100:00100000:0.0:1763334986.762308:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac3794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694676608:12345-192.168.201.60@tcp:10:lfs.0 00000100:00100000:1.0:1763334986.764343:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.764437:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694676736 00000100:00100000:3.0:1763334986.764449:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694676736 00002000:00010000:3.0:1763334986.764490:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/589 (0->18446744073709551615) 00002000:00100000:3.0:1763334986.764497:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac3795180 with x1848989694676736 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334986.764512:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac3795180. 00000100:00100000:3.0:1763334986.764543:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2001 00000100:00100000:3.0:1763334986.764553:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac3795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694676736:12345-192.168.201.60@tcp:10:lfs.0 00002000:00010000:3.0:1763334986.764972:0:21630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334986.764978:0:21630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb mtime from disk: 1763334985 -> 1763334987 00002000:00010000:3.0:1763334986.764982:0:21630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:3.0:1763334986.764984:0:21630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb ctime from disk: 1763334985 -> 1763334987 00002000:00010000:3.0:1763334986.764987:0:21630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334986.765069:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac3795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694676736:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 516us (736us total) trans 21474838553 rc 0/0 00000100:00100000:3.0:1763334986.765079:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2001 00002000:00010000:3.0:1763334986.765083:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/589 (0->18446744073709551615) 00002000:00100000:3.0:1763334986.765086:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac3795180 with x1848989694676736 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334986.765091:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac3795180. 00002000:00010000:0.0:1763334986.766116:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb size from disk: 233688 -> 133906 00002000:00010000:0.0:1763334986.766126:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.766128:0:14183:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334986.766131:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.766133:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1763334986.766198:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac3794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694676608:12345-192.168.201.60@tcp:10:lfs.0 Request processed in 3889us (4178us total) trans 17179871321 rc 0/0 00000100:00100000:0.0:1763334986.766207:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2000 00002000:00010000:0.0:1763334986.766212:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/593 (133906->18446744073709551615) 00002000:00100000:0.0:1763334986.766216:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac3794a80 with x1848989694676608 ext(133906->18446744073709551615) 00002000:00010000:0.0:1763334986.766222:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac3794a80. 00000100:00100000:2.0:1763334986.768187:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9830000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5733:1848989701910016:192.168.201.60@tcp:105: 00010000:00010000:2.0:1763334986.768223:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334986.768291:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac3797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694676480:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 10491us (12198us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334986.768302:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2725 00000100:00100000:1.0:1763334986.769511:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.770254:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694676992 00000100:00100000:2.0:1763334986.770268:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694676992 00000100:00100000:2.0:1763334986.770435:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5092 00000100:00100000:2.0:1763334986.770447:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac3794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53671:x1848989694676992:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1763334986.770693:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d3ad lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.770716:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d3ad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334986.770729:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d3ad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00010000:2.0:1763334986.770925:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007e28de40 reply state 00000000145eaa48 transno 8589939300 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d3ad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334986.770936:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334986.771230:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac3794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53671:x1848989694676992:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 782us (1721us total) trans 8589939300 rc 0/0 00000100:00100000:2.0:1763334986.771239:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5092 00000100:00100000:1.0:1763334986.774517:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.775514:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694677120 00000100:00100000:0.0:1763334986.775531:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694677120 00000100:00100000:0.0:1763334986.775623:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5250 00000100:00100000:0.0:1763334986.775636:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac3795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:53671:x1848989694677120:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334986.775660:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334986.775686:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d3b4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b089b expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.775726:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d305 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0847 expref: 28 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.775735:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.775738:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.775743:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d3b4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b089b expref: 28 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.775791:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d305 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0847 expref: 28 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334986.775805:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d305 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0847 expref: 28 pid: 6519 timeout: 1151 lvb_type: 1 00000100:00100000:0.0:1763334986.775820:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701910144:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334986.775943:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad0fff600 going to sleep for 11 seconds 00010000:00010000:3.0:1763334986.776627:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d3ad lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.776641:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d3ad lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.776652:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d3ad lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.776659:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334986.776664:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d3ad lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.776673:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d3ad lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.776692:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:3.0:1763334986.776695:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334986.776701:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d3ad lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334986.776707:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d3ad lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:0.0:1763334986.779356:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701910144:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334986.779407:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d3b4 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b089b expref: 28 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.779432:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334986.779822:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac3795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+28:53671:x1848989694677120:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 4186us (5317us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.779832:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5250 00000100:00100000:1.0:1763334986.779924:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.780344:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694677248 00000100:00100000:0.0:1763334986.780353:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694677248 00010000:00010000:0.0:1763334986.780396:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d305 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0847 expref: 28 pid: 6519 timeout: 1151 lvb_type: 1 00000100:00100000:0.0:1763334986.780436:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2726 00000100:00100000:0.0:1763334986.780446:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac3796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694677248:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334986.780466:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334986.780494:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d305 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0847 expref: 28 pid: 6519 timeout: 1151 lvb_type: 1 00010000:00010000:0.0:1763334986.780508:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d305 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0847 expref: 28 pid: 6519 timeout: 1151 lvb_type: 1 00010000:00010000:0.0:1763334986.780537:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d305 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0847 expref: 28 pid: 6519 timeout: 1151 lvb_type: 1 00010000:00010000:0.0:1763334986.780552:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.780554:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334986.780563:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d3b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b089b expref: 27 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.780599:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b089b expref: 27 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.780644:0:5733:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b089b expref: 27 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334986.780661:0:5733:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701910272:192.168.201.60@tcp:105: 00000100:00100000:0.0:1763334986.780743:0:5733:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ad0fff600 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.784357:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.784428:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694677376 00000100:00100000:2.0:1763334986.784440:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694677376 00000100:00100000:0.0:1763334986.784461:0:5733:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee544000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5733:1848989701910272:192.168.201.60@tcp:105: 00010000:00010000:0.0:1763334986.784492:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334986.784749:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5251 00000100:00100000:2.0:1763334986.784761:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac3796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+20:53671:x1848989694677376:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334986.784788:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1763334986.784808:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac3796680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694677248:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4362us (4887us total) trans 0 rc 0/0 00010000:00010000:2.0:1763334986.784816:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d3bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08a2 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334986.784819:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2726 00010000:00010000:2.0:1763334986.784851:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d30c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b084e expref: 21 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.784866:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.784868:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.784873:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d3bb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a2 expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.784921:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d30c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b084e expref: 21 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.784936:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d30c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b084e expref: 21 pid: 26564 timeout: 1151 lvb_type: 1 00000100:00100000:2.0:1763334986.784951:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9830000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701910400:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334986.785010:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.791429:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.791800:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9830000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:26564:1848989701910400:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334986.791845:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d3bb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a2 expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.791871:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430200, rc 0) 00000100:00100000:2.0:1763334986.791950:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac3796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:53671:x1848989694677376:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 7190us (7606us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334986.791961:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5251 00000100:00100000:0.0:1763334986.792987:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694677504 00000100:00100000:0.0:1763334986.793001:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694677504 00010000:00010000:0.0:1763334986.793048:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d30c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b084e expref: 21 pid: 26564 timeout: 1151 lvb_type: 1 00000100:00100000:3.0:1763334986.793726:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2727 00000100:00100000:3.0:1763334986.793745:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac3796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694677504:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334986.793765:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334986.793797:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d30c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b084e expref: 21 pid: 26564 timeout: 1151 lvb_type: 1 00010000:00010000:3.0:1763334986.793814:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d30c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b084e expref: 21 pid: 26564 timeout: 1151 lvb_type: 1 00010000:00010000:3.0:1763334986.793846:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d30c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b084e expref: 21 pid: 26564 timeout: 1151 lvb_type: 1 00010000:00010000:3.0:1763334986.793871:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334986.793873:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334986.793892:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d3bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a2 expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.793904:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d3bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a2 expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.793954:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d3bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a2 expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334986.793971:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec5a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701910528:192.168.201.60@tcp:105: 00000100:00100000:3.0:1763334986.794072:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b600 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.797920:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.798166:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec5a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5735:1848989701910528:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334986.798199:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334986.798280:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac3796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694677504:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4540us (6865us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334986.798293:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2727 00000100:00100000:2.0:1763334986.798397:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694677632 00000100:00100000:2.0:1763334986.798406:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694677632 00000100:00100000:2.0:1763334986.798462:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5252 00000100:00100000:2.0:1763334986.798474:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac3797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:53671:x1848989694677632:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334986.798495:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334986.798520:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849d3c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08a9 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.798556:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d313 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0855 expref: 28 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.798566:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.798594:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.798600:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849d3c2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a9 expref: 28 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.798643:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d313 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0855 expref: 28 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334986.798661:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d313 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0855 expref: 28 pid: 6519 timeout: 1151 lvb_type: 1 00000100:00100000:2.0:1763334986.798679:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9830000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701910656:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334986.798747:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.801824:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.802018:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9830000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701910656:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334986.802066:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849d3c2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a9 expref: 28 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.802094:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430400, rc 0) 00000100:00100000:2.0:1763334986.802174:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac3797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+28:53671:x1848989694677632:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3701us (4268us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334986.802186:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5252 00000100:00100000:3.0:1763334986.802487:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694677760 00000100:00100000:3.0:1763334986.802498:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694677760 00010000:00010000:3.0:1763334986.802540:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d313 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0855 expref: 28 pid: 6519 timeout: 1151 lvb_type: 1 00000100:00100000:3.0:1763334986.802609:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2728 00000100:00100000:3.0:1763334986.802632:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac3794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694677760:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334986.802653:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334986.802679:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d313 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0855 expref: 28 pid: 6519 timeout: 1151 lvb_type: 1 00010000:00010000:3.0:1763334986.802693:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d313 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0855 expref: 28 pid: 6519 timeout: 1151 lvb_type: 1 00010000:00010000:3.0:1763334986.802724:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d313 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0855 expref: 28 pid: 6519 timeout: 1151 lvb_type: 1 00010000:00010000:3.0:1763334986.802740:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334986.802743:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334986.802749:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849d3c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a9 expref: 27 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.802761:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849d3c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a9 expref: 27 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.802804:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849d3c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a9 expref: 27 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334986.802820:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec5a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701910784:192.168.201.60@tcp:105: 00000100:00100000:3.0:1763334986.802907:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b600 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.807838:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.807856:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec5a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701910784:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334986.807900:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334986.807972:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac3794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694677760:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 5341us (6165us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334986.807986:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2728 00000100:00100000:2.0:1763334986.809800:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694677888 00000100:00100000:2.0:1763334986.809821:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694677888 00000100:00100000:2.0:1763334986.809908:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5253 00000100:00100000:2.0:1763334986.809921:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac3797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694677888:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334986.810504:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 133906 -> 133906 00002000:00010000:2.0:1763334986.810510:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334986 -> 1763334986 00002000:00010000:2.0:1763334986.810513:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:2.0:1763334986.810515:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334986 -> 1763334987 00002000:00010000:2.0:1763334986.810517:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 161 -> 79 00000100:00100000:2.0:1763334986.810627:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac3797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694677888:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 708us (2803us total) trans 17179871322 rc 0/0 00000100:00100000:2.0:1763334986.810638:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5253 00000100:00100000:3.0:1763334986.810683:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.811797:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694678016 00000100:00100000:2.0:1763334986.811814:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694678016 00000100:00100000:0.0:1763334986.812663:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334986.814045:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694678144 00000100:00100000:2.0:1763334986.814062:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694678144 00000100:00100000:2.0:1763334986.814886:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5254 00000100:00100000:2.0:1763334986.814904:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694678016:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334986.815189:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334986.815193:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334986 -> 1763334986 00002000:00010000:2.0:1763334986.815196:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:2.0:1763334986.815199:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334986 -> 1763334987 00002000:00010000:2.0:1763334986.815201:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334986.815302:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694678016:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 403us (4618us total) trans 21474838554 rc 0/0 00000100:00100000:2.0:1763334986.815312:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5254 00000100:00100000:2.0:1763334986.815337:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5255 00000100:00100000:2.0:1763334986.815346:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694678144:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334986.815460:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334986.817679:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334986 -> 1763334986 00002000:00010000:2.0:1763334986.817685:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:2.0:1763334986.817687:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334986 -> 1763334987 00002000:00010000:2.0:1763334986.817690:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334986.817792:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee544000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694678144:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 2439us (5128us total) trans 17179871323 rc 0/0 00000100:00100000:2.0:1763334986.817806:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5255 00000100:00100000:0.0:1763334986.822091:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.822222:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694678400 00000100:00100000:3.0:1763334986.822236:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694678400 00000100:00100000:3.0:1763334986.823147:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1846 00000100:00100000:3.0:1763334986.823167:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53671:x1848989694678400:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:3.0:1763334986.823266:0:29631:0:(mdt_open.c:2488:mdt_close_resync_done()) ### [0x200000404:0x1ab:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d2c6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0832 expref: 198 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.823336:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334986.823352:0:29631:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d2f0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0839 expref: 198 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.823363:0:29631:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334986.823409:0:29631:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d2f0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0839 expref: 198 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.823426:0:29631:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d2f0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0839 expref: 198 pid: 29628 timeout: 1151 lvb_type: 0 00000100:00100000:3.0:1763334986.823443:0:29631:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec5b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701910912:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334986.823550:0:29631:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b600 going to sleep for 11 seconds 00000100:00100000:3.0:1763334986.831424:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.831615:0:29631:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec5b100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:29631:1848989701910912:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334986.831652:0:29631:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:0.0:1763334986.831934:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694678528 00000100:00100000:0.0:1763334986.831945:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694678528 00010000:00010000:0.0:1763334986.831994:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d2f0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0839 expref: 199 pid: 29628 timeout: 1151 lvb_type: 0 00000100:00100000:0.0:1763334986.832030:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2729 00000100:00100000:0.0:1763334986.832042:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+199:2359:x1848989694678528:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334986.832061:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334986.832068:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d2f0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0839 expref: 199 pid: 29628 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334986.832083:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d2f0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0839 expref: 199 pid: 29628 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334986.832111:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d2f0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0839 expref: 199 pid: 29628 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334986.832131:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:0.0:1763334986.832138:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334986.832151:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334986.832161:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334986.832195:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334986.832329:0:29631:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00010000:00010000:1.0:1763334986.832337:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000040:00080000:1.0:1763334986.833015:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1211, 88 off103736 00000004:00080000:1.0:1763334986.833028:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1051466455336ns, next at 1047075157699ns, rc = 0 00000040:00080000:1.0:1763334986.833093:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1201, 88 off102680 00000004:00080000:1.0:1763334986.833099:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1051466527623ns, next at 1047075229764ns, rc = 0 00000040:00080000:1.0:1763334986.833126:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1202, 88 off102768 00000004:00080000:1.0:1763334986.833131:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1051466559196ns, next at 1047075229764ns, rc = 0 00000040:00080000:1.0:1763334986.833148:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1212, 88 off103824 00000004:00080000:1.0:1763334986.833152:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1051466580534ns, next at 1047075157699ns, rc = 0 00000040:00080000:1.0:1763334986.833168:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1203, 88 off102856 00000004:00080000:1.0:1763334986.833172:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1051466600386ns, next at 1047075229764ns, rc = 0 00000040:00080000:1.0:1763334986.833187:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1213, 88 off103912 00000004:00080000:1.0:1763334986.833192:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1051466619874ns, next at 1047075157699ns, rc = 0 00000040:00080000:1.0:1763334986.833209:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1214, 88 off104000 00000004:00080000:1.0:1763334986.833213:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1051466640944ns, next at 1047075157699ns, rc = 0 00000040:00080000:1.0:1763334986.833228:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1204, 88 off102944 00000004:00080000:1.0:1763334986.833232:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1051466659799ns, next at 1047075229764ns, rc = 0 00000040:00080000:1.0:1763334986.833245:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1205, 88 off103032 00000004:00080000:1.0:1763334986.833249:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1051466677549ns, next at 1047075229764ns, rc = 0 00000040:00080000:1.0:1763334986.833264:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1215, 88 off104088 00000004:00080000:1.0:1763334986.833268:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1051466695964ns, next at 1047075157699ns, rc = 0 00000040:00080000:1.0:1763334986.833282:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1216, 88 off104176 00000004:00080000:1.0:1763334986.833286:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1051466714568ns, next at 1047075157699ns, rc = 0 00000040:00080000:1.0:1763334986.833300:0:29631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1206, 88 off103120 00000004:00080000:1.0:1763334986.833304:0:29631:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1051466731936ns, next at 1047075229764ns, rc = 0 00000100:00100000:0.0:1763334986.835020:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+199:2359:x1848989694678528:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 2963us (3593us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.835051:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2729 00000001:00080000:1.0:1763334986.883607:0:32483:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939295 is committed 00000001:00080000:1.0:1763334986.883640:0:32483:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939301 is committed 00000004:00080000:1.0:1763334986.883646:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 816 committed 00000004:00080000:1.0:1763334986.883656:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 828 committed 00000004:00080000:1.0:1763334986.883664:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 827 committed 00000004:00080000:1.0:1763334986.883667:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 815 committed 00000004:00080000:1.0:1763334986.883669:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 814 committed 00000004:00080000:1.0:1763334986.883671:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 826 committed 00000004:00080000:1.0:1763334986.883673:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 825 committed 00000004:00080000:1.0:1763334986.883675:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 813 committed 00000004:00080000:1.0:1763334986.883677:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 824 committed 00000004:00080000:1.0:1763334986.883679:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 812 committed 00000004:00080000:1.0:1763334986.883681:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 811 committed 00000004:00080000:1.0:1763334986.883683:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 823 committed 00000100:00100000:1.0:1763334986.883953:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac3795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701911040:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.884045:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.884090:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac3796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701911552:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.884114:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.884133:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701912064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.884157:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.884187:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1763334986.884193:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac3794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701911168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.884214:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.884232:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac3795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701911680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.884250:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.884267:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701912192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.884288:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.884321:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac3795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701911296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.884348:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.884366:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701911808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.884386:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.884403:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701912320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.884421:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.884442:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1763334986.884448:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac3797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701911424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1763334986.884468:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.884483:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701911936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.884503:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.884512:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701912448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334986.884532:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334986.884564:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701911040 00000100:00100000:1.0:1763334986.884606:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701911040 00000100:00100000:1.0:1763334986.884656:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701911552 00000100:00100000:1.0:1763334986.884660:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701911552 00000100:00100000:1.0:1763334986.884674:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701912064 00000100:00100000:1.0:1763334986.884677:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701912064 00000100:00100000:1.0:1763334986.884689:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701911168 00000100:00100000:1.0:1763334986.884692:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701911168 00000100:00100000:1.0:1763334986.884702:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701911680 00000100:00100000:1.0:1763334986.884704:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701911680 00000100:00100000:1.0:1763334986.884713:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701912192 00000100:00100000:1.0:1763334986.884715:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701912192 00000100:00100000:1.0:1763334986.884724:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701911296 00000100:00100000:1.0:1763334986.884727:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701911296 00000100:00100000:1.0:1763334986.884735:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701911808 00000100:00100000:1.0:1763334986.884737:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701911808 00000100:00100000:1.0:1763334986.884745:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701912320 00000100:00100000:1.0:1763334986.884747:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701912320 00000100:00100000:1.0:1763334986.884756:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701911424 00000100:00100000:1.0:1763334986.884758:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701911424 00000100:00100000:1.0:1763334986.884769:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701911936 00000100:00100000:1.0:1763334986.884772:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701911936 00000100:00100000:1.0:1763334986.884781:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701912448 00000100:00100000:1.0:1763334986.884783:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701912448 00000100:00100000:1.0:1763334986.884800:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5256 00000100:00100000:1.0:1763334986.884810:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701911040:12345-0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1763334986.885415:0:29631:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 0000000056aa70dc reply state 0000000027a1c4b6 transno 8589939301 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29631 initiator: MDT0 00000100:00100000:3.0:1763334986.885434:0:29631:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1763334986.885447:0:29631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:3.0:1763334986.885450:0:29631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763334986.885462:0:29631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793400/0xcedf0054f849d2c6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0832 expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00080000:3.0:1763334986.885674:0:29631:0:(ldlm_lib.c:3433:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1763334986.885689:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53671:x1848989694678400:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 62530us (63613us total) trans 8589939301 rc 0/0 00000100:00100000:3.0:1763334986.885699:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1846 00010000:00010000:0.0:1763334986.886226:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334986.886239:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334986.886246:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334986.886252:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334986.886257:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334986.886266:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334986.886283:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28faa00) 00010000:00010000:0.0:1763334986.886285:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334986.886289:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00010000:00010000:0.0:1763334986.886295:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d3c9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29631 initiator: MDT0 00000100:00100000:0.0:1763334986.886667:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5257 00000100:00100000:0.0:1763334986.886687:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701911552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334986.886947:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb size from disk: 133906 -> 133906 00002000:00010000:0.0:1763334986.886951:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.886953:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:0.0:1763334986.886956:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.886958:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24c:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1763334986.887097:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701911552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 418us (2981us total) trans 21474838555 rc 0/0 00000100:00100000:0.0:1763334986.887105:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5257 00000100:00100000:0.0:1763334986.887128:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5258 00000100:00100000:0.0:1763334986.887135:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701912064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334986.887236:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334986.887239:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.887241:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334986.887243:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.887245:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334986.887268:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701912064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (3110us total) trans 17179871324 rc 0/0 00000100:00100000:0.0:1763334986.887274:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5258 00000100:00100000:0.0:1763334986.887287:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5259 00000100:00100000:0.0:1763334986.887293:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701911168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334986.887384:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334986.887387:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334986 -> 1763334986 00002000:00010000:0.0:1763334986.887389:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334986.887391:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.887394:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334986.887417:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701911168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 124us (3202us total) trans 21474838556 rc 0/0 00000100:00100000:0.0:1763334986.887422:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5259 00000100:00100000:0.0:1763334986.887433:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5260 00000100:00100000:0.0:1763334986.887438:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701911680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334986.887506:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334986.887509:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.887511:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334986.887513:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.887515:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334986.887536:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701911680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 97us (3285us total) trans 21474838557 rc 0/0 00000100:00100000:0.0:1763334986.887540:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5260 00000100:00100000:0.0:1763334986.887551:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5261 00000100:00100000:0.0:1763334986.887557:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3291:x1848989701912192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334986.887653:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb size from disk: 133906 -> 133906 00002000:00010000:0.0:1763334986.887656:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.887658:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334986.887661:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.887663:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24f:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1763334986.887691:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701912192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (3402us total) trans 17179871325 rc 0/0 00000100:00100000:0.0:1763334986.887697:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5261 00000100:00100000:0.0:1763334986.887709:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5262 00000100:00100000:0.0:1763334986.887714:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701911296:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334986.887790:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb size from disk: 133906 -> 133906 00002000:00010000:0.0:1763334986.887793:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.887795:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:0.0:1763334986.887797:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.887799:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24a:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1763334986.887840:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701911296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 125us (3491us total) trans 21474838558 rc 0/0 00000100:00100000:0.0:1763334986.887847:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5262 00000100:00100000:0.0:1763334986.887860:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5263 00000100:00100000:0.0:1763334986.887867:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701911808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334986.887975:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 133906 -> 133906 00002000:00010000:0.0:1763334986.887978:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334986 -> 1763334986 00002000:00010000:0.0:1763334986.887980:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334986.887983:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.887985:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 79 -> 79 00000100:00100000:0.0:1763334986.888014:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701911808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 147us (3626us total) trans 17179871326 rc 0/0 00000100:00100000:0.0:1763334986.888020:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5263 00000100:00100000:0.0:1763334986.888034:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5264 00000100:00100000:0.0:1763334986.888040:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701912320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334986.888116:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334986.888119:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.888121:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:0.0:1763334986.888123:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.888125:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1763334986.888151:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701912320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 111us (3729us total) trans 17179871327 rc 0/0 00000100:00100000:0.0:1763334986.888157:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5264 00000100:00100000:0.0:1763334986.888170:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5265 00000100:00100000:0.0:1763334986.888177:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701911424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1763334986.888255:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334986.888258:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.888260:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:0.0:1763334986.888262:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.888264:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334986.888292:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701911424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 115us (3822us total) trans 21474838559 rc 0/0 00000100:00100000:0.0:1763334986.888298:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5265 00000100:00100000:0.0:1763334986.888310:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5266 00000100:00100000:0.0:1763334986.888316:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701911936:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334986.888410:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334986.888413:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334986 -> 1763334986 00002000:00010000:0.0:1763334986.888415:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334986.888417:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.888420:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334986.888448:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701911936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (3943us total) trans 17179871328 rc 0/0 00000100:00100000:0.0:1763334986.888454:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5266 00000100:00100000:0.0:1763334986.888467:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5267 00000100:00100000:0.0:1763334986.888475:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3289:x1848989701912448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1763334986.888555:0:25383:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb size from disk: 133906 -> 133906 00002000:00010000:0.0:1763334986.888559:0:25383:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.888561:0:25383:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334986.888563:0:25383:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:0.0:1763334986.888565:0:25383:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x251:0x0] updating lvb blocks from disk: 515 -> 515 00000100:00100000:0.0:1763334986.888621:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+11:3289:x1848989701912448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 146us (4088us total) trans 17179871329 rc 0/0 00000100:00100000:0.0:1763334986.888627:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5267 00000100:00100000:3.0:1763334986.889078:0:3289:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838547 gen 2 00000004:00080000:3.0:1763334986.889087:0:3289:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474838524 committed transno 21474838547 00000004:00080000:3.0:1763334986.889116:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e15f80, transno 21474838525 00000004:00080000:3.0:1763334986.889137:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e17100, transno 21474838526 00000004:00080000:3.0:1763334986.889140:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e14e00, transno 21474838527 00000004:00080000:3.0:1763334986.889142:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e14380, transno 21474838528 00000004:00080000:3.0:1763334986.889145:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e16d80, transno 21474838529 00000004:00080000:3.0:1763334986.889149:0:3289:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 21474838533 committed transno 21474838547 00000004:00080000:3.0:1763334986.889167:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac8418e00, transno 21474838534 00000004:00080000:3.0:1763334986.889170:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac8418000, transno 21474838535 00000004:00080000:3.0:1763334986.889173:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841a300, transno 21474838536 00000004:00080000:3.0:1763334986.889175:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841ad80, transno 21474838537 00000004:00080000:3.0:1763334986.889178:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841b100, transno 21474838538 00000004:00080000:3.0:1763334986.889180:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac841b480, transno 21474838539 00000004:00080000:3.0:1763334986.889183:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca871f80, transno 21474838542 00000004:00080000:3.0:1763334986.889185:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca871c00, transno 21474838543 00000004:00080000:3.0:1763334986.889188:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ad809fb80, transno 21474838544 00000004:00080000:3.0:1763334986.889191:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee9d6a00, transno 21474838545 00000004:00080000:3.0:1763334986.889195:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5b01f2c380, transno 21474838546 00000004:00080000:3.0:1763334986.889197:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59ca870000, transno 21474838547 00000100:00100000:3.0:1763334986.889204:0:3289:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5ac3797b80 x1848989701911424/t21474838559(21474838559) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763335002 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763334986.889217:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac3797b80/2, rc 0, transno 21474838559 00000100:00100000:3.0:1763334986.889223:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac3797b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701911424:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334986.889239:0:3289:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871315 gen 2 00000004:00080000:3.0:1763334986.889244:0:3289:0:(osp_trans.c:1035:osp_request_commit_cb()) trans no 17179871299 committed transno 17179871315 00000004:00080000:3.0:1763334986.889254:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c4380, transno 17179871300 00000004:00080000:3.0:1763334986.889275:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5576680, transno 17179871301 00000004:00080000:3.0:1763334986.889278:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5af6a83100, transno 17179871302 00000004:00080000:3.0:1763334986.889281:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a59c58c4a80, transno 17179871303 00000004:00080000:3.0:1763334986.889284:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5574380, transno 17179871304 00000004:00080000:3.0:1763334986.889287:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac5575500, transno 17179871305 00000004:00080000:3.0:1763334986.889290:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac6c1f100, transno 17179871310 00000004:00080000:3.0:1763334986.889293:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac6c1c380, transno 17179871311 00000004:00080000:3.0:1763334986.889296:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac6c1ce00, transno 17179871312 00000004:00080000:3.0:1763334986.889299:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac6c1d500, transno 17179871313 00000004:00080000:3.0:1763334986.889302:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac6c1f800, transno 17179871314 00000004:00080000:3.0:1763334986.889305:0:3289:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac6c1df80, transno 17179871315 00000100:00100000:3.0:1763334986.889310:0:3289:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5aee4d3480 x1848989701911936/t17179871328(17179871328) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1763335002 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1763334986.889318:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee4d3480/2, rc 0, transno 17179871328 00000100:00100000:3.0:1763334986.889322:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701911936:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334986.889338:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee4d1c00/2, rc 0, transno 17179871329 00000100:00100000:3.0:1763334986.889341:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701912448:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334986.889352:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac3795500/2, rc 0, transno 21474838558 00000100:00100000:3.0:1763334986.889355:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac3795500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701911296:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334986.889364:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee4d0700/2, rc 0, transno 17179871326 00000100:00100000:3.0:1763334986.889367:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701911808:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1763334986.889375:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee4d0000/2, rc 0, transno 17179871327 00000100:00100000:3.0:1763334986.889378:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701912320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334986.890086:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 6 in progress, 2 in flight, 12 done 00002000:00010000:1.0:1763334986.890247:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334986.890250:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334986.890253:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1763334986.890256:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:1.0:1763334986.890258:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334986.890324:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+11:3291:x1848989701911040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 5513us (6277us total) trans 21474838560 rc 0/0 00000100:00100000:1.0:1763334986.890335:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5256 00000004:00080000:2.0:1763334986.891793:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac3796a00/2, rc 0, transno 21474838555 00000100:00100000:2.0:1763334986.891808:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac3796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701911552:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334986.891825:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee4d0a80/2, rc 0, transno 17179871324 00000100:00100000:2.0:1763334986.891829:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701912064:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763334986.891847:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac3794380/2, rc 0, transno 21474838556 00000100:00100000:2.0:1763334986.891851:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac3794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701911168:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334986.891860:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac3795880/2, rc 0, transno 21474838557 00000100:00100000:2.0:1763334986.891864:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac3795880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701911680:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1763334986.891882:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5aee4d1180/2, rc 0, transno 17179871325 00000100:00100000:2.0:1763334986.891885:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701912192:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763334986.891896:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac3795f80/2, rc 0, transno 21474838560 00000100:00100000:2.0:1763334986.891900:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac3795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701911040:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334986.898322:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 6 in progress, 0 in flight, 17 done 00000100:00100000:3.0:1763334986.898988:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.899126:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694678656 00000100:00100000:0.0:1763334986.899142:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694678656 00000100:00100000:0.0:1763334986.899227:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5093 00000100:00100000:0.0:1763334986.899239:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+187:53671:x1848989694678656:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334986.899272:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334986.899309:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d3d0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08b0 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.899396:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d3d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08b0 expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.899413:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d3d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08b0 expref: 188 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334986.899436:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334986.899441:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334986.899446:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334986.899530:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53671:x1848989694678656:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 293us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334986.899538:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5093 00000100:00100000:1.0:1763334986.904559:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.905045:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694678912 00000100:00100000:3.0:1763334986.905064:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694678912 00000100:00100000:3.0:1763334986.905143:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1847 00000100:00100000:3.0:1763334986.905156:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac821ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53671:x1848989694678912:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1763334986.905664:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac821ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53671:x1848989694678912:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 508us (1121us total) trans 8589939302 rc 0/0 00000100:00100000:3.0:1763334986.905675:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1847 00000100:00100000:3.0:1763334986.924248:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.924454:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694679040 00000100:00100000:1.0:1763334986.924471:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694679040 00000100:00100000:1.0:1763334986.924559:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5094 00000100:00100000:1.0:1763334986.924619:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53672:x1848989694679040:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334986.924658:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334986.924689:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d3d7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08b7 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.924791:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d3de lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.924811:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d3de lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.924825:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d3de lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.924845:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3e5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.924851:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.924858:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925026:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d3ec lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925035:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d3ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925042:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d3ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334986.925088:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00000004:00200000:1.0:1763334986.925094:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334986.925116:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d3ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925132:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d3ec lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925142:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d3de lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925153:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d3de lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925160:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d3de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925167:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334986.925172:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d3de lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925181:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d3de lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925195:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:1.0:1763334986.925199:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334986.925204:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d3de lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925210:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d3de lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925226:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925232:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3e5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925238:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925242:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334986.925246:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925272:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3e5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925279:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ad28fa800) 00010000:00010000:1.0:1763334986.925282:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1763334986.925285:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3e5 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925291:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3e5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.925330:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d3d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08b7 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.925343:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d3ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08b7 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.925351:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334986.925353:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334986.925356:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334986.925439:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53672:x1848989694679040:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 868us (1208us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334986.925449:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5094 00000100:00100000:3.0:1763334986.933210:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334986.934167:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694679296 00000100:00100000:0.0:1763334986.934187:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694679296 00000100:00100000:1.0:1763334986.934422:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5095 00000100:00100000:1.0:1763334986.934437:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53672:x1848989694679296:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334986.934465:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334986.934496:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d3f3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08be expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.934655:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3fa lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.934672:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3fa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334986.934684:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3fa lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:1.0:1763334986.934697:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00010000:00010000:1.0:1763334986.934869:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d3f3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08be expref: 193 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.934905:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3fa lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08be expref: 192 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.934914:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334986.934918:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1763334986.934923:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478800, rc 0) 00000100:00100000:1.0:1763334986.935021:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53672:x1848989694679296:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 586us (1827us total) trans 8589939303 rc 0/0 00000100:00100000:1.0:1763334986.935028:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5095 00000100:00100000:2.0:1763334986.942499:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334986.942642:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694679552 00000100:00100000:1.0:1763334986.942658:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694679552 00000100:00100000:1.0:1763334986.942777:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5096 00000100:00100000:1.0:1763334986.942790:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53672:x1848989694679552:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334986.942825:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334986.942855:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d408 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08c5 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.943005:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d40f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.943026:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d40f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334986.943040:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d40f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334986.943056:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00010000:00010000:1.0:1763334986.943698:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d408 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08c5 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.943728:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d40f lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08c5 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334986.943739:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334986.943742:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334986.943747:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478e00, rc 0) 00000100:00100000:1.0:1763334986.944421:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53672:x1848989694679552:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1629us (1933us total) trans 8589939304 rc 0/0 00000100:00100000:1.0:1763334986.944433:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5096 00000100:00100000:2.0:1763334986.979291:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.980141:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694679680 00000100:00100000:3.0:1763334986.980158:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694679680 00000100:00100000:3.0:1763334986.980278:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2002 00000100:00100000:3.0:1763334986.980291:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694679680:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:3.0:1763334986.980345:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.980370:0:14385:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d3b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b089b expref: 29 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.980381:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334986.980384:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1763334986.980388:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.980433:0:14385:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b089b expref: 29 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.980447:0:14385:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d3b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b089b expref: 29 pid: 26564 timeout: 1151 lvb_type: 0 00000100:00100000:3.0:1763334986.980464:0:14385:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec58700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14385:1848989701912576:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334986.980627:0:14385:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334986.986133:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334986.986762:0:14385:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec58700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_005:lustre-OST0001_UUID:14385:1848989701912576:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334986.986804:0:14385:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334986.987230:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694679808 00000100:00100000:2.0:1763334986.987241:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694679808 00010000:00010000:2.0:1763334986.987294:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d3b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b089b expref: 30 pid: 26564 timeout: 1151 lvb_type: 0 00000100:00100000:2.0:1763334986.987343:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2730 00000100:00100000:2.0:1763334986.987354:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694679808:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334986.987375:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334986.987406:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d3b4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b089b expref: 30 pid: 26564 timeout: 1151 lvb_type: 0 00010000:00010000:2.0:1763334986.987421:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b089b expref: 30 pid: 26564 timeout: 1151 lvb_type: 0 00010000:00010000:2.0:1763334986.987454:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d3b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b089b expref: 30 pid: 26564 timeout: 1151 lvb_type: 0 00010000:00010000:2.0:1763334986.987476:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.987478:0:5733:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334986.987484:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.987496:0:5733:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334986.987540:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334986.987653:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694679808:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 300us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334986.987662:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2730 00010000:00010000:3.0:1763334986.988009:0:14385:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.988021:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.998196:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.998223:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.999379:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.999389:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334986.999396:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.999406:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.999433:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334986.999442:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d41d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334986.999900:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694679680:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 19601us (20619us total) trans 0 rc 133906/133906 00000100:00100000:2.0:1763334986.999915:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2002 00000100:00100000:2.0:1763334987.010135:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.010212:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694679936 00000100:00100000:0.0:1763334987.010227:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694679936 00000100:00080000:2.0:1763334987.010825:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1763334987.012809:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2003 00000100:00100000:1.0:1763334987.012846:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694679936:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:1.0:1763334987.012915:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.012952:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d344 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b085c expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.012961:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334987.012964:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334987.012969:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.013016:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d344 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b085c expref: 21 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.013032:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d344 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b085c expref: 21 pid: 26564 timeout: 1151 lvb_type: 0 00000100:00100000:1.0:1763334987.013049:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14183:1848989701912704:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334987.013176:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1780 going to sleep for 11 seconds 00000100:00100000:1.0:1763334987.016114:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14183:1848989701912704:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334987.016154:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334987.017317:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.017392:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694680064 00000100:00100000:0.0:1763334987.017404:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694680064 00010000:00010000:0.0:1763334987.017454:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d344 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b085c expref: 22 pid: 26564 timeout: 1151 lvb_type: 0 00000100:00100000:0.0:1763334987.017500:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2731 00000100:00100000:0.0:1763334987.017510:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2359:x1848989694680064:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334987.017527:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334987.017552:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d344 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b085c expref: 22 pid: 26564 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.017566:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d344 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b085c expref: 22 pid: 26564 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.017632:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d344 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b085c expref: 22 pid: 26564 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.017653:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.017655:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.017661:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.017672:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.017700:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334987.017771:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d39450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694680064:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 261us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.017780:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2731 00010000:00010000:1.0:1763334987.018335:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.018348:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.031830:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.031857:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.031866:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.031884:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334987.031888:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.031898:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.031926:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.031936:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d424 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334987.032065:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694679936:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 19233us (21939us total) trans 0 rc 133906/133906 00000100:00100000:1.0:1763334987.032076:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2003 00000100:00100000:3.0:1763334987.038168:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.039187:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694680192 00000100:00100000:1.0:1763334987.039204:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694680192 00000100:00080000:2.0:1763334987.039952:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1763334987.045323:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2004 00000100:00100000:1.0:1763334987.045350:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694680192:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:1.0:1763334987.045409:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.045437:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431400/0xcedf0054f849d360 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b086a expref: 28 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.045447:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334987.045450:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334987.045455:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.045511:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431400/0xcedf0054f849d360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b086a expref: 28 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.045529:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431400/0xcedf0054f849d360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b086a expref: 28 pid: 7819 timeout: 1151 lvb_type: 0 00000100:00100000:1.0:1763334987.045549:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701912832:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334987.045715:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1780 going to sleep for 11 seconds 00000100:00100000:1.0:1763334987.051410:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701912832:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334987.051461:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334987.052081:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.053396:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694680320 00000100:00100000:0.0:1763334987.053413:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694680320 00010000:00010000:0.0:1763334987.053475:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431400/0xcedf0054f849d360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b086a expref: 29 pid: 7819 timeout: 1151 lvb_type: 0 00000100:00100000:0.0:1763334987.053530:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2732 00000100:00100000:0.0:1763334987.053541:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9831180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694680320:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334987.053563:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334987.053620:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431400/0xcedf0054f849d360 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b086a expref: 29 pid: 7819 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.053637:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431400/0xcedf0054f849d360 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b086a expref: 29 pid: 7819 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.053668:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431400/0xcedf0054f849d360 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b086a expref: 29 pid: 7819 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.053689:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.053691:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.053697:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.053714:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.054568:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334987.054663:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.054683:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334987.057637:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9831180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694680320:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4085us (5546us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.057654:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2732 00010000:00010000:1.0:1763334987.062762:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.062791:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.062801:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.062808:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334987.062813:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.062822:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.062847:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.062854:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d42b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334987.063008:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694680192:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 17662us (24853us total) trans 0 rc 133906/133906 00000100:00100000:1.0:1763334987.063021:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2004 00000100:00100000:1.0:1763334987.070531:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.071206:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694680448 00000100:00100000:0.0:1763334987.071222:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694680448 00000100:00100000:2.0:1763334987.071376:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2005 00000100:00100000:2.0:1763334987.071388:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694680448:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334987.071438:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.071463:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d37c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0878 expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.071472:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334987.071475:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334987.071479:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.071523:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d37c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0878 expref: 20 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.071540:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d37c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0878 expref: 20 pid: 26564 timeout: 1151 lvb_type: 0 00000100:00100000:2.0:1763334987.071559:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c9832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14183:1848989701912960:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334987.071695:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98300 going to sleep for 11 seconds 00000100:00100000:2.0:1763334987.075961:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c9832d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14183:1848989701912960:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334987.076009:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334987.078209:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.078839:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694680576 00000100:00100000:0.0:1763334987.078852:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694680576 00010000:00010000:0.0:1763334987.078919:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d37c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0878 expref: 21 pid: 26564 timeout: 1151 lvb_type: 0 00000100:00100000:0.0:1763334987.079008:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2733 00000100:00100000:0.0:1763334987.079020:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694680576:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334987.079039:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334987.079069:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d37c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0878 expref: 21 pid: 26564 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.079086:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d37c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0878 expref: 21 pid: 26564 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.079114:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d37c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0878 expref: 21 pid: 26564 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.079141:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.079143:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.079150:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.079162:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.079406:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334987.079648:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.079660:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334987.079983:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9832d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694680576:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 961us (1783us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.079995:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2733 00010000:00010000:1.0:1763334987.084656:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.084684:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.084694:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.084702:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334987.084706:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.084716:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.084742:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.084750:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d432 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334987.085392:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694680448:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 13994us (14865us total) trans 0 rc 133906/133906 00000100:00100000:1.0:1763334987.085408:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2005 00000100:00100000:2.0:1763334987.090081:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.090818:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694680704 00000100:00100000:1.0:1763334987.090836:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694680704 00000100:00100000:1.0:1763334987.091176:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2006 00000100:00100000:1.0:1763334987.091189:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694680704:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:1.0:1763334987.091489:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.091514:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d39f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b088d expref: 27 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.091525:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334987.091527:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334987.091532:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.091609:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d39f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b088d expref: 27 pid: 7819 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.091627:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d39f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b088d expref: 27 pid: 7819 timeout: 1151 lvb_type: 0 00000100:00100000:1.0:1763334987.091646:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c58c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701913088:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334987.091892:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1780 going to sleep for 11 seconds 00000100:00100000:2.0:1763334987.095238:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.095406:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c58c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701913088:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334987.095458:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334987.095729:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694680832 00000100:00100000:0.0:1763334987.095739:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694680832 00010000:00010000:0.0:1763334987.095789:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d39f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b088d expref: 28 pid: 7819 timeout: 1151 lvb_type: 0 00000100:00100000:0.0:1763334987.095835:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2734 00000100:00100000:0.0:1763334987.095845:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c9832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694680832:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334987.095864:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334987.095901:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d39f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b088d expref: 28 pid: 7819 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.095916:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d39f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b088d expref: 28 pid: 7819 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.095954:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d39f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x251:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b088d expref: 28 pid: 7819 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.095973:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.095976:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.095981:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.095993:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.097071:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.097091:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.097491:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334987.097557:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9832680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694680832:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1707us (2329us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.097588:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2734 00010000:00010000:1.0:1763334987.102561:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.102981:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.102992:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.103001:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334987.103006:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.103017:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.103042:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.103050:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d439 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334987.103184:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c9833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694680704:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 11989us (13111us total) trans 0 rc 133906/133906 00000100:00100000:1.0:1763334987.103197:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2006 00000100:00100000:1.0:1763334987.119712:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.119834:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694680960 00000100:00100000:0.0:1763334987.119849:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694680960 00000100:00100000:0.0:1763334987.119964:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 422 00000100:00100000:0.0:1763334987.119975:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53672:x1848989694680960:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:0.0:1763334987.120000:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334987.120035:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d40f lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08c5 expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.120057:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.120062:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334987.120137:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53672:x1848989694680960:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 164us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.120146:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 422 00000100:00080000:2.0:1763334987.120641:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1763334987.123190:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.123730:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694681216 00000100:00100000:1.0:1763334987.123746:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694681216 00000100:00100000:1.0:1763334987.123827:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1848 00000100:00100000:1.0:1763334987.123840:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53672:x1848989694681216:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334987.124198:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53672:x1848989694681216:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 360us (1024us total) trans 8589939305 rc 0/0 00000100:00100000:1.0:1763334987.124206:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1848 00000100:00100000:1.0:1763334987.128737:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334987.129445:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694681472 00000100:00100000:2.0:1763334987.129461:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694681472 00000100:00100000:2.0:1763334987.129622:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5097 00000100:00100000:2.0:1763334987.129637:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c58c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53644:x1848989694681472:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334987.129668:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334987.129697:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d440 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08cc expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.129833:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.129853:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d3ec lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08b7 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.129866:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.129919:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d3ec lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08b7 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.129935:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d3ec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08b7 expref: 195 pid: 30972 timeout: 1151 lvb_type: 0 00000100:00100000:2.0:1763334987.129951:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e17100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701913216:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334987.130527:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98300 going to sleep for 11 seconds 00000100:00100000:2.0:1763334987.135555:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334987.135640:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694681600 00000100:00100000:3.0:1763334987.135653:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694681600 00010000:00010000:3.0:1763334987.135710:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d3ec lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08b7 expref: 196 pid: 30972 timeout: 1151 lvb_type: 0 00000100:00100000:3.0:1763334987.135768:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2735 00000100:00100000:3.0:1763334987.135790:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2360:x1848989694681600:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334987.135812:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334987.135821:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d3ec lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08b7 expref: 196 pid: 30972 timeout: 1151 lvb_type: 0 00010000:00010000:3.0:1763334987.135836:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d3ec lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08b7 expref: 196 pid: 30972 timeout: 1151 lvb_type: 0 00010000:00010000:3.0:1763334987.135881:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:3.0:1763334987.135888:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334987.135900:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334987.135908:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334987.135931:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334987.136000:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d3ec lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08b7 expref: 196 pid: 30972 timeout: 1151 lvb_type: 0 00000100:00100000:1.0:1763334987.136024:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e17100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701913216:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334987.136053:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334987.136065:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:2360:x1848989694681600:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 273us (521us total) trans 0 rc 0/0 00010000:00010000:1.0:1763334987.136067:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334987.136077:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:3.0:1763334987.136084:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2735 00000004:00200000:1.0:1763334987.136253:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00010000:00010000:1.0:1763334987.136487:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d440 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08cc expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.136510:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08cc expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.136520:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334987.136523:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334987.136526:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430e00, rc 0) 00000100:00100000:1.0:1763334987.136613:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c58c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694681472:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 6937us (7849us total) trans 8589939306 rc 0/0 00000100:00100000:1.0:1763334987.136622:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5097 00000100:00100000:2.0:1763334987.139775:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.140500:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694681728 00000100:00100000:1.0:1763334987.140519:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694681728 00000100:00100000:1.0:1763334987.140773:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5098 00000100:00100000:1.0:1763334987.140788:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694681728:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334987.140824:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334987.140859:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d455 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08d3 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.141103:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334987.141123:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08cc expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.141135:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334987.141220:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08cc expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.141239:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08cc expref: 196 pid: 30972 timeout: 1151 lvb_type: 0 00000100:00100000:1.0:1763334987.141359:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701913344:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334987.141698:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1780 going to sleep for 11 seconds 00000100:00100000:2.0:1763334987.145622:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.145692:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694681856 00000100:00100000:0.0:1763334987.145707:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694681856 00000100:00100000:1.0:1763334987.145753:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701913344:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334987.145759:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08cc expref: 197 pid: 30972 timeout: 1151 lvb_type: 0 00010000:00010000:1.0:1763334987.145787:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334987.145798:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2736 00000100:00100000:0.0:1763334987.145808:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2360:x1848989694681856:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334987.145827:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334987.145835:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08cc expref: 197 pid: 30972 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.145849:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08cc expref: 197 pid: 30972 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.145894:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d447 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08cc expref: 197 pid: 30972 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.145913:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.145919:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.145936:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.145945:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.145967:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334987.146042:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+196:2360:x1848989694681856:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 234us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.146050:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2736 00010000:00010000:0.0:1763334987.146076:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.146083:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334987.146142:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00000004:00200000:0.0:1763334987.146147:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334987.146171:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.146208:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d455 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08d3 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.146224:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08d3 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.146232:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.146235:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334987.146238:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:0.0:1763334987.146285:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694681728:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 5502us (6529us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.146293:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5098 00000100:00100000:2.0:1763334987.148542:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.148697:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694681984 00000100:00100000:1.0:1763334987.148710:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694681984 00000100:00100000:1.0:1763334987.148801:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5268 00000100:00100000:1.0:1763334987.148814:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694681984:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334987.148839:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334987.148885:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d463 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08da expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334987.148919:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 133906, mtime: 0x691a5b4a, atime: 0x691a5b49, ctime: 0x691a5b4b, blocks: 0x4f 00010000:00010000:1.0:1763334987.148952:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.148955:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.148971:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d463 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08da expref: 27 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334987.148993:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d463 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08da expref: 27 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334987.149015:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334987.149261:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694681984:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 448us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334987.149269:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5268 00000100:00100000:1.0:1763334987.158044:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334987.158141:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694682240 00000100:00100000:3.0:1763334987.158155:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694682240 00000100:00100000:3.0:1763334987.158231:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1849 00000100:00100000:3.0:1763334987.158242:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694682240:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:3.0:1763334987.158656:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53644:x1848989694682240:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 414us (626us total) trans 8589939307 rc 0/0 00000100:00100000:3.0:1763334987.158664:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1849 00000100:00100000:2.0:1763334987.173164:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.173306:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694682368 00000100:00100000:0.0:1763334987.173322:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694682368 00000100:00100000:0.0:1763334987.173397:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5099 00000100:00100000:0.0:1763334987.173409:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53673:x1848989694682368:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334987.173445:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334987.173474:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d46a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08e1 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.173559:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d471 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.173855:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d471 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.173882:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d471 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.173902:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d478 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.173910:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d478 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.173917:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d478 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174069:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d47f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174079:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d47f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174085:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d47f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:0.0:1763334987.174130:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00000004:00200000:0.0:1763334987.174136:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1763334987.174156:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d47f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174169:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d47f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174178:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d471 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174185:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d471 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174192:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d471 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174198:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334987.174202:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d471 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174211:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d471 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174223:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:0.0:1763334987.174226:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334987.174231:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d471 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174237:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d471 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174543:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d478 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174552:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d478 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174557:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d478 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174563:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334987.174566:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d478 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174893:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d478 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174903:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac7d60700) 00010000:00010000:0.0:1763334987.174906:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334987.174909:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d478 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174915:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d478 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.174970:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d46a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08e1 expref: 198 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.174987:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d47f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08e1 expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.174995:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.174997:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334987.175000:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334987.177041:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53673:x1848989694682368:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3614us (3876us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.177059:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5099 00000100:00100000:1.0:1763334987.184894:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334987.184896:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.185713:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694682496 00000100:00100000:0.0:1763334987.185730:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694682496 00000100:00100000:0.0:1763334987.185828:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 423 00000100:00100000:0.0:1763334987.185840:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694682496:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334987.185879:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334987.185923:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d47f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08e1 expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.185951:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.185959:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334987.186049:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694682752 00000100:00100000:2.0:1763334987.186054:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694682752 00000100:00100000:0.0:1763334987.186127:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d38c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694682496:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 288us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.186140:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 423 00000100:00100000:2.0:1763334987.186265:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5100 00000100:00100000:2.0:1763334987.186274:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53673:x1848989694682752:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334987.186299:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334987.186322:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d486 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08e8 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.186463:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.186485:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08d3 expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.186496:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.186542:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08d3 expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.186560:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08d3 expref: 197 pid: 30972 timeout: 1151 lvb_type: 0 00000100:00100000:2.0:1763334987.186624:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701913472:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334987.186695:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98840 going to sleep for 11 seconds 00000100:00100000:2.0:1763334987.191553:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e14e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701913472:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334987.191618:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334987.192077:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.192560:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694682880 00000100:00100000:0.0:1763334987.194625:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694682880 00010000:00010000:0.0:1763334987.194726:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08d3 expref: 198 pid: 30972 timeout: 1151 lvb_type: 0 00000100:00100000:0.0:1763334987.194795:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2737 00000100:00100000:0.0:1763334987.194806:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+198:2361:x1848989694682880:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334987.194828:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334987.194838:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08d3 expref: 198 pid: 30972 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.194853:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08d3 expref: 198 pid: 30972 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.194896:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478400/0xcedf0054f849d45c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08d3 expref: 198 pid: 30972 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.194980:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.194987:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.194999:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.195007:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.195053:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334987.195141:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2361:x1848989694682880:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 336us (3064us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.195149:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2737 00010000:00010000:2.0:1763334987.195501:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.195512:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334987.195541:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00010000:00010000:2.0:1763334987.195797:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d486 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08e8 expref: 198 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.195821:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08e8 expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.195829:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334987.195831:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334987.195834:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430800, rc 0) 00000100:00100000:2.0:1763334987.195912:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53673:x1848989694682752:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 9639us (11014us total) trans 8589939308 rc 0/0 00000100:00100000:2.0:1763334987.195921:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5100 00000100:00100000:2.0:1763334987.202009:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.202187:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694683008 00000100:00100000:0.0:1763334987.202203:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694683008 00000100:00100000:2.0:1763334987.202430:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5101 00000100:00100000:2.0:1763334987.202446:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53673:x1848989694683008:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334987.202483:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334987.202513:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d49b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08ef expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.202726:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.202745:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08e8 expref: 198 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.202755:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.202798:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08e8 expref: 198 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.202817:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08e8 expref: 198 pid: 30972 timeout: 1151 lvb_type: 0 00000100:00100000:2.0:1763334987.202832:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e17100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701913600:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334987.202959:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98840 going to sleep for 11 seconds 00000100:00100000:1.0:1763334987.206802:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334987.206966:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694683136 00000100:00100000:3.0:1763334987.206981:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694683136 00010000:00010000:3.0:1763334987.207039:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08e8 expref: 199 pid: 30972 timeout: 1151 lvb_type: 0 00000100:00100000:2.0:1763334987.207233:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e17100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701913600:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334987.207267:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:0.0:1763334987.207370:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2738 00000100:00100000:0.0:1763334987.207386:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+199:2359:x1848989694683136:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334987.207407:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334987.207420:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08e8 expref: 199 pid: 30972 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.207435:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08e8 expref: 199 pid: 30972 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.207468:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d48d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08e8 expref: 199 pid: 30972 timeout: 1151 lvb_type: 0 00010000:00010000:0.0:1763334987.207492:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.207497:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334987.207509:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334987.207517:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.208117:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.208127:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334987.208156:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:2.0:1763334987.208186:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00000004:00200000:2.0:1763334987.208192:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334987.208216:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.208255:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d49b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08ef expref: 199 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.208272:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08ef expref: 198 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.208281:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334987.208284:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334987.208288:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431600, rc 0) 00000100:00100000:0.0:1763334987.208359:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+198:2359:x1848989694683136:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 977us (1573us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334987.208366:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53673:x1848989694683008:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5927us (6374us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.208369:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2738 00000100:00100000:2.0:1763334987.208373:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5101 00000100:00100000:1.0:1763334987.211563:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334987.211879:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694683264 00000100:00100000:2.0:1763334987.211892:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694683264 00000100:00100000:2.0:1763334987.211967:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5102 00000100:00100000:2.0:1763334987.211979:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53673:x1848989694683264:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334987.212008:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334987.212037:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d4a9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08f6 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.212165:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d4b0 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212181:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d4b0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212194:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d4b0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212211:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d4b7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212218:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d4b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212225:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d4b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212369:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d4be lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212382:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d4be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212389:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d4be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334987.212431:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00000004:00200000:2.0:1763334987.212436:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334987.212456:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d4be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212468:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d4be lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212476:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d4b0 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212482:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d4b0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212488:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d4b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212494:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334987.212499:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d4b0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212506:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d4b0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212519:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:2.0:1763334987.212523:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334987.212529:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d4b0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212536:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d4b0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212550:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d4b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212556:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d4b7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212562:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d4b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212567:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334987.212663:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d4b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212671:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d4b7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212680:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac6cabe00) 00010000:00010000:2.0:1763334987.212682:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334987.212685:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d4b7 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212690:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d4b7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334987.212728:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d4a9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08f6 expref: 199 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.212742:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d4be lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08f6 expref: 198 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.212753:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334987.212755:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334987.212758:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:2.0:1763334987.213139:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53673:x1848989694683264:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1159us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334987.213149:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5102 00000100:00100000:1.0:1763334987.226842:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.226965:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.227055:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694683648 00000100:00100000:3.0:1763334987.227057:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694683520 00000100:00100000:3.0:1763334987.227069:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694683520 00000100:00100000:0.0:1763334987.227069:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694683648 00000100:00100000:3.0:1763334987.227142:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5103 00000100:00100000:0.0:1763334987.227142:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 424 00000100:00100000:3.0:1763334987.227155:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53673:x1848989694683520:12345-192.168.201.60@tcp:101:lfs.0 00000100:00100000:0.0:1763334987.227155:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+199:2362:x1848989694683648:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334987.227176:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334987.227180:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334987.227204:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d4c5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b08fd expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.227212:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d4be lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08f6 expref: 199 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.227232:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.227237:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334987.227309:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+199:2362:x1848989694683648:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 157us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.227317:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 424 00010000:00010000:3.0:1763334987.227334:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d4cc lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334987.227351:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d4cc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334987.227363:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d4cc lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:3.0:1763334987.227378:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00010000:00010000:0.0:1763334987.227646:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d4c5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08fd expref: 200 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.227663:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d4cc lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08fd expref: 199 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.227670:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.227673:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334987.227676:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8a00, rc 0) 00000100:00100000:0.0:1763334987.227711:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53673:x1848989694683520:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 559us (887us total) trans 8589939309 rc 0/0 00000100:00100000:0.0:1763334987.227718:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5103 00000100:00100000:0.0:1763334987.293758:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.293899:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694683776 00000100:00100000:1.0:1763334987.293912:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694683776 00000100:00100000:1.0:1763334987.294011:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2007 00000100:00100000:1.0:1763334987.294023:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2361:x1848989694683776:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:1.0:1763334987.294073:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4da lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.294092:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.294095:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.294103:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.294120:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.305077:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4da lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.305102:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.305112:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.309004:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334987.309013:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.309027:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.309056:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.309064:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334987.309216:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2361:x1848989694683776:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 15188us (15466us total) trans 0 rc 133906/133906 00000100:00100000:1.0:1763334987.309228:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2007 00000100:00100000:2.0:1763334987.322110:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.324075:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694683904 00000100:00100000:1.0:1763334987.324094:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694683904 00000100:00100000:1.0:1763334987.324214:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2008 00000100:00100000:1.0:1763334987.324226:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694683904:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:1.0:1763334987.324277:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 133906, mtime: 0x691a5b4b, atime: 0x691a5b40, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:1.0:1763334987.324286:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4e1 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.324299:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.324301:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.324306:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.324319:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.331929:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4e1 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.331955:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4e1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.331964:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.331971:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334987.331977:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4e1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.331987:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4e1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.332011:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4e1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.332024:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4e1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334987.332153:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694683904:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 7921us (10053us total) trans 0 rc 133906/133906 00000100:00100000:1.0:1763334987.332166:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2008 00000100:00100000:3.0:1763334987.335490:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.336418:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694684032 00000100:00100000:1.0:1763334987.336432:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694684032 00000100:00100000:0.0:1763334987.339970:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2009 00000100:00100000:0.0:1763334987.340012:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694684032:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:0.0:1763334987.340109:0:14385:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 133906, mtime: 0x691a5b4b, atime: 0x691a5b44, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:0.0:1763334987.340121:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d4e8 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.340138:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.340140:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.340148:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d4e8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.340166:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d4e8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.346526:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d4e8 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.346552:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d4e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.346562:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d4e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.346634:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334987.346641:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d4e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.346651:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d4e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.346675:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d4e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.346684:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d4e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334987.346800:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694684032:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 6806us (11317us total) trans 0 rc 133906/133906 00000100:00100000:0.0:1763334987.346811:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2009 00000100:00100000:3.0:1763334987.352396:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.352727:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694684160 00000100:00100000:0.0:1763334987.352741:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694684160 00000100:00100000:1.0:1763334987.353483:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2010 00000100:00100000:1.0:1763334987.353507:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694684160:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:1.0:1763334987.353604:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24c:0x0] initial LVB size: 133906, mtime: 0x691a5b4b, atime: 0x691a5b48, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:1.0:1763334987.353616:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4ef lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.353634:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.353636:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.353643:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.353658:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.357184:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4ef lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.357213:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4ef lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.357229:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.357238:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334987.357243:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4ef lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.357254:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4ef lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.357279:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4ef lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.357287:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d4ef lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334987.357404:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694684160:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 3900us (5023us total) trans 0 rc 133906/133906 00000100:00100000:1.0:1763334987.357417:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2010 00000100:00100000:3.0:1763334987.361471:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.361658:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694684288 00000100:00100000:1.0:1763334987.361672:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694684288 00000100:00100000:1.0:1763334987.361773:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2011 00000100:00100000:1.0:1763334987.361785:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694684288:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:1.0:1763334987.361850:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x251:0x0] initial LVB size: 133906, mtime: 0x691a5b4b, atime: 0x691a5b49, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:1.0:1763334987.361862:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d4f6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.361896:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.361899:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.361906:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d4f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.361923:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d4f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.367935:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d4f6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.367965:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d4f6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.367976:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d4f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.367984:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334987.367990:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d4f6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.368001:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d4f6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.368029:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d4f6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.368037:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d4f6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334987.368692:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694684288:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 6900us (7226us total) trans 0 rc 133906/133906 00000100:00100000:0.0:1763334987.368706:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2011 00000100:00100000:2.0:1763334987.379468:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.379701:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694684416 00000100:00100000:1.0:1763334987.379716:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694684416 00000100:00100000:0.0:1763334987.380524:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 425 00000100:00100000:0.0:1763334987.380543:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53673:x1848989694684416:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:0.0:1763334987.380567:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334987.380631:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d4cc lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08fd expref: 199 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.380655:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.380662:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334987.380743:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a20700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53673:x1848989694684416:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 207us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.380752:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 425 00000100:00100000:3.0:1763334987.382791:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.382932:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694684672 00000100:00100000:1.0:1763334987.382944:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694684672 00000100:00100000:1.0:1763334987.383004:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1850 00000100:00100000:1.0:1763334987.383013:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53673:x1848989694684672:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334987.383393:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53673:x1848989694684672:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 380us (611us total) trans 8589939310 rc 0/0 00000100:00100000:1.0:1763334987.383401:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1850 00000100:00100000:3.0:1763334987.385904:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.386413:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694684928 00000100:00100000:1.0:1763334987.386427:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694684928 00000100:00100000:1.0:1763334987.386509:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1851 00000100:00100000:1.0:1763334987.386521:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53673:x1848989694684928:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334987.387042:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53673:x1848989694684928:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 522us (1148us total) trans 8589939311 rc 0/0 00000100:00100000:1.0:1763334987.387051:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1851 00000100:00100000:2.0:1763334987.402228:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.402369:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694685184 00000100:00100000:0.0:1763334987.402382:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694685184 00000100:00100000:0.0:1763334987.402455:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5104 00000100:00100000:0.0:1763334987.402465:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53674:x1848989694685184:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334987.402494:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334987.402521:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d4fd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0904 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.402682:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d504 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334987.402703:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d504 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334987.402716:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d504 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:0.0:1763334987.402732:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00010000:00010000:0.0:1763334987.402894:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d4fd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0904 expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.402915:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d504 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0904 expref: 202 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.402926:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.402929:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1763334987.402935:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334987.403001:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53674:x1848989694685184:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 537us (789us total) trans 8589939312 rc 0/0 00000100:00100000:0.0:1763334987.403009:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5104 00000100:00100000:3.0:1763334987.469976:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.470123:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694685312 00000100:00100000:0.0:1763334987.470137:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694685312 00000100:00100000:0.0:1763334987.470248:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2012 00000100:00100000:0.0:1763334987.470261:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694685312:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334987.470312:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d512 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.470332:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.470335:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.470343:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d512 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.470362:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d512 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.474848:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d512 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.474887:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d512 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.474898:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.474907:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334987.474915:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d512 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.474925:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d512 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.474955:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d512 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.474964:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d512 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334987.475099:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694685312:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 4832us (5131us total) trans 0 rc 133906/133906 00000100:00100000:0.0:1763334987.475112:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2012 00000100:00100000:1.0:1763334987.487337:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.487464:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694685440 00000100:00100000:0.0:1763334987.487477:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694685440 00000100:00100000:0.0:1763334987.487614:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2013 00000100:00100000:0.0:1763334987.487626:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694685440:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:0.0:1763334987.487701:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 133906, mtime: 0x691a5b4b, atime: 0x691a5b40, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:0.0:1763334987.487713:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d519 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.487731:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.487734:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.487741:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d519 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.487761:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d519 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.495834:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d519 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.495875:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d519 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.495886:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d519 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.495895:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334987.495900:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d519 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.495910:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d519 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.495937:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d519 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.495946:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d519 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334987.496338:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694685440:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 8705us (9005us total) trans 0 rc 133906/133906 00000100:00100000:0.0:1763334987.496354:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2013 00000100:00100000:3.0:1763334987.499421:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.499547:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694685568 00000100:00100000:0.0:1763334987.499562:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694685568 00000100:00100000:0.0:1763334987.499827:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2014 00000100:00100000:0.0:1763334987.499840:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2361:x1848989694685568:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:0.0:1763334987.499923:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 133906, mtime: 0x691a5b4b, atime: 0x691a5b44, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:0.0:1763334987.499935:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849d520 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.499951:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.499954:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.499960:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849d520 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.499974:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849d520 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.508286:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849d520 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.508314:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849d520 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.508323:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849d520 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.508331:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334987.508336:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849d520 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.508345:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849d520 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.508376:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849d520 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.508384:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793200/0xcedf0054f849d520 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334987.508517:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2361:x1848989694685568:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 8673us (9110us total) trans 0 rc 133906/133906 00000100:00100000:0.0:1763334987.508530:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2014 00000100:00100000:2.0:1763334987.512028:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.512134:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694685696 00000100:00100000:0.0:1763334987.512150:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694685696 00000100:00100000:0.0:1763334987.512330:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2015 00000100:00100000:0.0:1763334987.512342:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694685696:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:0.0:1763334987.512409:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24c:0x0] initial LVB size: 133906, mtime: 0x691a5b4b, atime: 0x691a5b48, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:0.0:1763334987.512422:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d527 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.512440:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.512443:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.512450:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d527 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.512466:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d527 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.517504:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d527 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.517529:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d527 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.517539:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.517546:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334987.517551:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d527 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.517559:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d527 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.517626:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d527 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.517634:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d527 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334987.517744:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ad81fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694685696:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 5398us (5731us total) trans 0 rc 133906/133906 00000100:00100000:1.0:1763334987.517754:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2015 00000100:00100000:2.0:1763334987.521186:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.521799:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694685824 00000100:00100000:1.0:1763334987.521816:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694685824 00000100:00100000:1.0:1763334987.521947:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2016 00000100:00100000:1.0:1763334987.521961:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2362:x1848989694685824:12345-192.168.201.60@tcp:3:lfs.0 00002000:00010000:1.0:1763334987.522043:0:14183:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x251:0x0] initial LVB size: 133906, mtime: 0x691a5b4b, atime: 0x691a5b49, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:1.0:1763334987.522058:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d52e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.522076:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.522078:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.522085:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d52e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.522103:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d52e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.528047:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d52e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.528104:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d52e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.528114:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d52e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.528121:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478c00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334987.528125:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d52e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.528145:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d52e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.528173:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d52e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.528193:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d52e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->135167] (req 0->135167) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334987.528471:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2362:x1848989694685824:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 6506us (7294us total) trans 0 rc 133906/133906 00000100:00100000:1.0:1763334987.528484:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2016 00000100:00100000:3.0:1763334987.540020:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.541522:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694685952 00000100:00100000:1.0:1763334987.541541:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694685952 00000100:00100000:0.0:1763334987.541724:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 426 00000100:00100000:0.0:1763334987.541738:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53674:x1848989694685952:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:0.0:1763334987.541763:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334987.541795:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792a00/0xcedf0054f849d504 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0904 expref: 202 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.541819:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.541826:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334987.542304:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53674:x1848989694685952:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 566us (2298us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.542314:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 426 00000100:00100000:2.0:1763334987.546007:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.547405:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694686208 00000100:00100000:1.0:1763334987.547428:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694686208 00000100:00100000:1.0:1763334987.547520:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1852 00000100:00100000:1.0:1763334987.547531:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53674:x1848989694686208:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334987.547906:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53674:x1848989694686208:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 375us (1914us total) trans 8589939313 rc 0/0 00000100:00100000:1.0:1763334987.547915:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1852 00000100:00100000:2.0:1763334987.552391:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.552730:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694686464 00000100:00100000:1.0:1763334987.552746:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694686464 00000100:00100000:1.0:1763334987.552829:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5105 00000100:00100000:1.0:1763334987.552843:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53644:x1848989694686464:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334987.552887:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334987.552919:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d535 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b090b expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.553069:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334987.553093:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08ef expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.553105:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334987.553149:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08ef expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.553165:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08ef expref: 203 pid: 29628 timeout: 1152 lvb_type: 0 00000100:00100000:1.0:1763334987.553182:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701913728:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334987.553314:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334987.557168:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701913728:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334987.557218:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334987.560547:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.560641:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694686592 00000100:00100000:0.0:1763334987.560656:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694686592 00010000:00010000:0.0:1763334987.560714:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08ef expref: 204 pid: 29628 timeout: 1152 lvb_type: 0 00000100:00100000:0.0:1763334987.560757:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2739 00000100:00100000:0.0:1763334987.560769:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2359:x1848989694686592:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334987.560789:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334987.560797:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08ef expref: 204 pid: 29628 timeout: 1152 lvb_type: 0 00010000:00010000:0.0:1763334987.560812:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08ef expref: 204 pid: 29628 timeout: 1152 lvb_type: 0 00010000:00010000:0.0:1763334987.560843:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431600/0xcedf0054f849d4a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08ef expref: 204 pid: 29628 timeout: 1152 lvb_type: 0 00010000:00010000:0.0:1763334987.560873:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.560881:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.560896:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.560904:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.560947:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334987.561026:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+203:2359:x1848989694686592:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 258us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.561035:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2739 00010000:00010000:1.0:1763334987.561950:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334987.561966:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334987.561996:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00010000:00010000:1.0:1763334987.563490:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d535 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b090b expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.563527:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b090b expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.563538:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:1.0:1763334987.563542:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1763334987.563547:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334987.563674:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694686464:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 10832us (11297us total) trans 8589939314 rc 0/0 00000100:00100000:1.0:1763334987.563685:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5105 00000100:00100000:2.0:1763334987.567078:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.568634:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694686720 00000100:00100000:1.0:1763334987.568659:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694686720 00000100:00100000:1.0:1763334987.568758:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5106 00000100:00100000:1.0:1763334987.568771:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694686720:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334987.568806:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334987.568843:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d54a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0912 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.569003:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d551 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334987.569022:0:30972:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b090b expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.569032:0:30972:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d551 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334987.569080:0:30972:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b090b expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.569098:0:30972:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b090b expref: 204 pid: 30972 timeout: 1152 lvb_type: 0 00000100:00100000:1.0:1763334987.569126:0:30972:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701913856:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334987.569267:0:30972:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1780 going to sleep for 11 seconds 00000100:00100000:3.0:1763334987.577191:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.577323:0:30972:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:30972:1848989701913856:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334987.577365:0:30972:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d551 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334987.577491:0:5733:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694686848 00000100:00100000:0.0:1763334987.577501:0:5733:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694686848 00010000:00010000:0.0:1763334987.577552:0:5733:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b090b expref: 205 pid: 30972 timeout: 1152 lvb_type: 0 00000100:00100000:0.0:1763334987.577636:0:5733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2740 00000100:00100000:0.0:1763334987.577648:0:5733:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+205:2359:x1848989694686848:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334987.577670:0:5733:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334987.577678:0:5733:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b090b expref: 205 pid: 30972 timeout: 1152 lvb_type: 0 00010000:00010000:0.0:1763334987.577692:0:5733:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b090b expref: 205 pid: 30972 timeout: 1152 lvb_type: 0 00010000:00010000:0.0:1763334987.577722:0:5733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d53c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b090b expref: 205 pid: 30972 timeout: 1152 lvb_type: 0 00010000:00010000:0.0:1763334987.577746:0:5733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334987.577752:0:5733:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d551 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.577763:0:5733:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d551 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.577772:0:5733:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d551 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334987.577801:0:5733:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334987.577887:0:5733:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d38050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2359:x1848989694686848:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 241us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.577896:0:5733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2740 00010000:00010000:2.0:1763334987.581615:0:30972:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d551 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.581641:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d551 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:2.0:1763334987.581718:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 133906 00000004:00200000:2.0:1763334987.581724:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334987.581755:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d551 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.581813:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d54a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0912 expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.581844:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d551 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0912 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.581854:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334987.581858:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334987.581871:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:2.0:1763334987.581986:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694686720:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 13216us (14923us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334987.581997:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5106 00000100:00100000:3.0:1763334987.590134:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.590281:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694686976 00000100:00100000:1.0:1763334987.590298:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694686976 00002000:00100000:1.0:1763334987.590379:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (4096->20479) req@ffff9a5aeec58a80 x1848989694686976/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:33/0 lens 488/0 e 0 to 0 dl 1763334998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334987.590393:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec58a80 with x1848989694686976 ext(4096->20479) 00002000:00010000:1.0:1763334987.590401:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeec58a80 00000100:00100000:1.0:1763334987.590445:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2017 00000100:00100000:1.0:1763334987.590455:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694686976:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:1.0:1763334987.590973:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2359:x1848989694686976:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 516us (854us total) trans 0 rc 16384/16384 00000100:00100000:1.0:1763334987.590984:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2017 00002000:00100000:1.0:1763334987.590993:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (4096->20479) req@ffff9a5aeec58a80 x1848989694686976/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:33/0 lens 488/16824 e 0 to 0 dl 1763334998 ref 1 fl Complete:/600/0 rc 16384/16384 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334987.591003:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec58a80 with x1848989694686976 ext(4096->20479) 00002000:00010000:1.0:1763334987.591007:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeec58a80 00000100:00100000:3.0:1763334987.596392:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334987.597114:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694687104 00000100:00100000:2.0:1763334987.597131:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694687104 00002000:00100000:2.0:1763334987.597213:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (0->135167) req@ffff9a5ae0bbc700 x1848989694687104/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:33/0 lens 504/0 e 0 to 0 dl 1763334998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334987.597226:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ae0bbc700 with x1848989694687104 ext(0->135167) 00002000:00010000:2.0:1763334987.597235:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ae0bbc700 00000100:00100000:2.0:1763334987.597284:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2018 00000100:00100000:2.0:1763334987.597297:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2361:x1848989694687104:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:2.0:1763334987.605525:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2361:x1848989694687104:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 8212us (9133us total) trans 0 rc 118784/118784 00000100:00100000:2.0:1763334987.605545:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2018 00002000:00100000:2.0:1763334987.605564:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (0->135167) req@ffff9a5ae0bbc700 x1848989694687104/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:33/0 lens 504/440 e 0 to 0 dl 1763334998 ref 1 fl Complete:/600/0 rc 118784/118784 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334987.606427:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ae0bbc700 with x1848989694687104 ext(0->135167) 00002000:00010000:2.0:1763334987.606437:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ae0bbc700 00000100:00100000:3.0:1763334987.618195:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334987.618422:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694687360 00000100:00100000:2.0:1763334987.618438:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694687360 00000100:00100000:2.0:1763334987.618517:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5107 00000100:00100000:2.0:1763334987.618529:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694687360:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334987.618767:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334987.618811:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d551 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0912 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334987.618839:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334987.618846:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334987.619226:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d558 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.619245:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d558 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.620412:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d558 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:2.0:1763334987.621455:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939315 00000004:00010000:2.0:1763334987.621558:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000003dd25a98 reply state 00000000d1a4a4c3 transno 8589939316 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d558 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334987.621633:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334987.621896:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694687360:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 3359us (3705us total) trans 8589939316 rc 0/0 00000100:00100000:2.0:1763334987.621908:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5107 00000020:00080000:2.0:1763334987.621916:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763334987.622019:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1763334987.625836:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1763334987.625968:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d558 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.625983:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d558 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.625993:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d558 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.625999:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334987.626004:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d558 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.626014:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d558 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.626038:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:2.0:1763334987.626041:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1763334987.626048:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d558 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334987.626054:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d558 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:0.0:1763334987.627447:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694687616 00000100:00100000:0.0:1763334987.627468:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694687616 00000100:00100000:0.0:1763334987.627850:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1853 00000100:00100000:0.0:1763334987.627872:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac821b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+204:53644:x1848989694687616:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:0.0:1763334987.628411:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac821b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694687616:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 547us (2586us total) trans 8589939317 rc 0/0 00000100:00100000:0.0:1763334987.628422:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1853 00000100:00100000:1.0:1763334987.634137:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334987.635856:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694687872 00000100:00100000:3.0:1763334987.635890:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694687872 00000100:00100000:3.0:1763334987.635991:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5108 00000100:00100000:3.0:1763334987.636325:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694687872:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:3.0:1763334987.636365:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334987.636370:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:3.0:1763334987.636410:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d3fa lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08be expref: 205 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334987.636444:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d3d0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08b0 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334987.636459:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60300) 00010000:00010000:3.0:1763334987.636475:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334987.636499:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d55f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0919 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334987.636569:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d566 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334987.637839:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d566 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334987.637855:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d566 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000040:00080000:3.0:1763334987.638616:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1217, 88 off104264 00000004:00080000:3.0:1763334987.638634:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1052272060869ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334987.638855:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1207, 88 off103208 00000004:00080000:2.0:1763334987.638876:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1052272303854ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334987.638925:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1208, 88 off103296 00000004:00080000:2.0:1763334987.638931:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1052272359286ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334987.638962:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1218, 88 off104352 00000004:00080000:2.0:1763334987.638968:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1052272396367ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334987.639001:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1209, 88 off103384 00000004:00080000:2.0:1763334987.639007:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1052272434830ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334987.639039:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1219, 88 off104440 00000004:00080000:2.0:1763334987.639044:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1052272472005ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334987.639062:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1220, 88 off104528 00000004:00080000:2.0:1763334987.639066:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1052272494209ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334987.639083:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1210, 88 off103472 00000004:00080000:2.0:1763334987.639087:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1052272515305ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334987.639119:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1211, 88 off103560 00000004:00080000:2.0:1763334987.639126:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1052272553737ns, next at 1047075229764ns, rc = 0 00000040:00080000:2.0:1763334987.639150:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1221, 88 off104616 00000004:00080000:2.0:1763334987.639154:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1052272582810ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334987.639168:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1222, 88 off104704 00000004:00080000:2.0:1763334987.639171:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1052272599449ns, next at 1047075157699ns, rc = 0 00000040:00080000:2.0:1763334987.639186:0:30972:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1212, 88 off103648 00000004:00080000:2.0:1763334987.639191:0:30972:0:(osp_sync.c:1775:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1052272619492ns, next at 1047075229764ns, rc = 0 00000001:00080000:1.0:1763334987.691627:0:32483:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939317 is committed 00000001:00080000:1.0:1763334987.691696:0:32483:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939318 is committed 00000004:00080000:1.0:1763334987.691701:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 822 committed 00000004:00080000:1.0:1763334987.691715:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 834 committed 00000004:00080000:1.0:1763334987.691725:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 833 committed 00000004:00080000:1.0:1763334987.691727:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 821 committed 00000004:00080000:1.0:1763334987.691730:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 820 committed 00000004:00080000:1.0:1763334987.691732:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 832 committed 00000004:00080000:1.0:1763334987.691734:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 831 committed 00000004:00080000:1.0:1763334987.691736:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 819 committed 00000004:00080000:1.0:1763334987.691738:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 830 committed 00000004:00080000:1.0:1763334987.691740:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 818 committed 00000004:00080000:1.0:1763334987.691742:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 817 committed 00000004:00080000:1.0:1763334987.691744:0:32483:0:(osp_sync.c:1740:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 829 committed 00000100:00100000:1.0:1763334987.691993:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701913984:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334987.692081:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334987.692132:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701914496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334987.692151:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334987.692176:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1763334987.692182:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701914112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334987.692200:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334987.692213:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701914624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334987.692227:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334987.692250:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701914368:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334987.692269:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334987.692284:0:3290:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1763334987.692288:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701914240:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334987.692304:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334987.692330:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701913984 00000100:00100000:1.0:1763334987.692339:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701913984 00000100:00100000:1.0:1763334987.692400:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701914496 00000100:00100000:1.0:1763334987.692402:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701914496 00000100:00100000:1.0:1763334987.692415:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701914112 00000100:00100000:1.0:1763334987.692417:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701914112 00000100:00100000:1.0:1763334987.692429:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701914624 00000100:00100000:1.0:1763334987.692431:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701914624 00000100:00100000:1.0:1763334987.692444:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701914368 00000100:00100000:1.0:1763334987.692446:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701914368 00000100:00100000:1.0:1763334987.692454:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701914240 00000100:00100000:1.0:1763334987.692456:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701914240 00000100:00100000:1.0:1763334987.692469:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5269 00000100:00100000:1.0:1763334987.692477:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701913984:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334987.692721:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 133906 -> 133906 00002000:00010000:1.0:1763334987.692726:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334986 -> 1763334986 00002000:00010000:1.0:1763334987.692729:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:1.0:1763334987.692731:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:1.0:1763334987.692734:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 79 -> 79 00000100:00100000:1.0:1763334987.692777:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701913984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 299us (696us total) trans 17179871330 rc 0/0 00000100:00100000:1.0:1763334987.692784:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5269 00000100:00100000:1.0:1763334987.692802:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5270 00000100:00100000:1.0:1763334987.692808:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701914496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334987.692893:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334987.692896:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:1.0:1763334987.692899:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb atime from disk: 1763334984 -> 1763334984 00002000:00010000:1.0:1763334987.692901:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:1.0:1763334987.692904:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x250:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1763334987.692925:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701914496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 118us (773us total) trans 17179871331 rc 0/0 00000100:00100000:1.0:1763334987.692931:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5270 00000100:00100000:1.0:1763334987.692942:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5271 00000100:00100000:1.0:1763334987.692948:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701914112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1763334987.693015:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334987.693018:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334986 -> 1763334986 00002000:00010000:1.0:1763334987.693020:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:1.0:1763334987.693023:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:1.0:1763334987.693025:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334987.693045:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701914112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 97us (844us total) trans 17179871332 rc 0/0 00000100:00100000:1.0:1763334987.693050:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5271 00000100:00100000:1.0:1763334987.693060:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5272 00000100:00100000:1.0:1763334987.693066:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+16:3291:x1848989701914624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334987.693431:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5273 00000100:00100000:3.0:1763334987.693443:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701914368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1763334987.693595:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701914368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 156us (1325us total) trans 17179871333 rc 0/0 00000100:00100000:3.0:1763334987.693602:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5273 00000100:00100000:3.0:1763334987.693615:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5274 00000100:00100000:3.0:1763334987.693622:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3290:x1848989701914240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1763334987.693691:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334987.693694:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:3.0:1763334987.693697:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb atime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334987.693699:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:3.0:1763334987.693701:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24e:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334987.693723:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3290:x1848989701914240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (1418us total) trans 17179871334 rc 0/0 00000100:00100000:3.0:1763334987.693728:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5274 00010000:00010000:3.0:1763334987.693790:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d566 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0919 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334987.693804:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:3.0:1763334987.693807:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334987.693826:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d55f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0919 expref: 189 pid: 30972 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1763334987.693845:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d566 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0919 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334987.693889:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:3.0:1763334987.693892:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1763334987.693895:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9800, rc 0) 00000100:00100000:3.0:1763334987.693946:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694687872:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 57947us (59827us total) trans 8589939318 rc 0/0 00000100:00100000:3.0:1763334987.693954:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5108 00000004:00080000:2.0:1763334987.694451:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e4ea00/2, rc 0, transno 17179871334 00000100:00100000:2.0:1763334987.694461:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701914240:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1763334987.694470:0:3290:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e4d880/2, rc 0, transno 17179871333 00000100:00100000:2.0:1763334987.694474:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3290:1848989701914368:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1763334987.695230:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701915136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334987.695299:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334987.695347:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1763334987.695353:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701915008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1763334987.695377:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334987.695449:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701914752:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334987.695479:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334987.695491:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701915264:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334987.695511:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334987.695523:0:3289:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1763334987.695527:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701914880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334987.695548:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334987.695558:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701915392:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334987.695599:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334987.695622:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701915136 00000100:00100000:3.0:1763334987.695630:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701915136 00000100:00100000:3.0:1763334987.695674:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701915008 00000100:00100000:3.0:1763334987.695678:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701915008 00000100:00100000:3.0:1763334987.695687:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701914752 00000100:00100000:3.0:1763334987.695689:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701914752 00000100:00100000:3.0:1763334987.695697:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701915264 00000100:00100000:3.0:1763334987.695699:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701915264 00000100:00100000:3.0:1763334987.695707:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701914880 00000100:00100000:3.0:1763334987.695709:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701914880 00000100:00100000:3.0:1763334987.695718:0:32239:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701915392 00000100:00100000:3.0:1763334987.695720:0:32239:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701915392 00000100:00100000:3.0:1763334987.695734:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5275 00000100:00100000:3.0:1763334987.695743:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3292:x1848989701915136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334987.695973:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334987.695977:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:3.0:1763334987.695980:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb atime from disk: 1763334980 -> 1763334980 00002000:00010000:3.0:1763334987.695982:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:3.0:1763334987.695985:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24b:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334987.696035:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb343c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3292:x1848989701915136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 292us (735us total) trans 21474838561 rc 0/0 00000100:00100000:3.0:1763334987.696042:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5275 00000100:00100000:3.0:1763334987.696062:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5276 00000100:00100000:3.0:1763334987.696069:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3292:x1848989701915008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334987.696167:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3292:x1848989701915008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (789us total) trans 21474838562 rc 0/0 00000100:00100000:3.0:1763334987.696173:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5276 00000100:00100000:3.0:1763334987.696185:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5277 00000100:00100000:3.0:1763334987.696190:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ae0bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3289:x1848989701914752:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334987.696269:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334987.696272:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb mtime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334987.696274:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1763334987.696276:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb ctime from disk: 1763334976 -> 1763334976 00002000:00010000:3.0:1763334987.696278:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x246:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334987.696311:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ae0bbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701914752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (831us total) trans 21474838563 rc 0/0 00000100:00100000:3.0:1763334987.696318:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5277 00000100:00100000:3.0:1763334987.696330:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5278 00000100:00100000:3.0:1763334987.696336:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3289:x1848989701915264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1763334987.696431:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701915264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 94us (917us total) trans 21474838564 rc 0/0 00000100:00100000:3.0:1763334987.696440:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5278 00000100:00100000:3.0:1763334987.696452:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5279 00000100:00100000:3.0:1763334987.696457:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3289:x1848989701914880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334987.696528:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334987.696531:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334986 -> 1763334986 00002000:00010000:3.0:1763334987.696533:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:3.0:1763334987.696535:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:3.0:1763334987.696538:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334987.696562:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701914880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (1012us total) trans 21474838565 rc 0/0 00000100:00100000:3.0:1763334987.696568:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5279 00000100:00100000:3.0:1763334987.696607:0:32239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5280 00000100:00100000:3.0:1763334987.696614:0:32239:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3289:x1848989701915392:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1763334987.696689:0:32239:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334987.696692:0:32239:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb mtime from disk: 1763334987 -> 1763334987 00002000:00010000:3.0:1763334987.696694:0:32239:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:3.0:1763334987.696696:0:32239:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb ctime from disk: 1763334987 -> 1763334987 00002000:00010000:3.0:1763334987.696699:0:32239:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24d:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334987.696725:0:32239:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3289:x1848989701915392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 112us (1125us total) trans 21474838566 rc 0/0 00000100:00100000:3.0:1763334987.696731:0:32239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5280 00000004:00080000:3.0:1763334987.696782:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac6c1c380/2, rc 0, transno 21474838565 00000100:00100000:3.0:1763334987.696788:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701914880:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334987.696798:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac6c1df80/2, rc 0, transno 21474838566 00000100:00100000:3.0:1763334987.696803:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701915392:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334987.696810:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac6c1f100/2, rc 0, transno 21474838563 00000100:00100000:3.0:1763334987.696813:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701914752:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1763334987.696820:0:3289:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac6c1f800/2, rc 0, transno 21474838564 00000100:00100000:3.0:1763334987.696823:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3289:1848989701915264:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334987.697252:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac6c1ce00/2, rc 0, transno 21474838562 00000100:00100000:0.0:1763334987.697258:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701915008:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1763334987.697266:0:3292:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac6c1d500/2, rc 0, transno 21474838561 00000100:00100000:0.0:1763334987.697269:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701915136:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1763334987.697397:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1763334987.697403:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1763334987.697735:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+17:3291:x1848989701914624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 4667us (5504us total) trans 17179871335 rc 0/0 00000100:00100000:1.0:1763334987.697746:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5272 00000004:00080000:1.0:1763334987.697929:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e4fb80/2, rc 0, transno 17179871332 00000100:00100000:1.0:1763334987.697935:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701914112:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334987.697945:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e4f480/2, rc 0, transno 17179871335 00000100:00100000:1.0:1763334987.697948:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701914624:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334987.697961:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e4d500/2, rc 0, transno 17179871330 00000100:00100000:1.0:1763334987.697963:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701913984:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1763334987.697973:0:3291:0:(osp_sync.c:557:osp_sync_interpret()) reply req ffff9a5ac7e4c700/2, rc 0, transno 17179871331 00000100:00100000:1.0:1763334987.697976:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3291:1848989701914496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1763334987.701016:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.702260:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694688000 00000100:00100000:0.0:1763334987.702277:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694688000 00000100:00100000:0.0:1763334987.702352:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5281 00000100:00100000:0.0:1763334987.702362:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+27:53644:x1848989694688000:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334987.702384:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334987.702408:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d56d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0920 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.702443:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d463 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08da expref: 28 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334987.702452:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.702455:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334987.702460:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d56d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0920 expref: 28 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.702501:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d463 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08da expref: 28 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334987.702514:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d463 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08da expref: 28 pid: 26564 timeout: 1152 lvb_type: 1 00000100:00100000:0.0:1763334987.702534:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aeec5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701915520:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334987.702688:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c4155a80 going to sleep for 11 seconds 00000100:00100000:0.0:1763334987.709044:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aeec5b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:25383:1848989701915520:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334987.709097:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d56d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0920 expref: 28 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334987.709124:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334987.709205:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:53644:x1848989694688000:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 6841us (8204us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.709215:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5281 00000100:00100000:3.0:1763334987.713400:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334987.715881:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694688128 00000100:00100000:1.0:1763334987.715904:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694688128 00010000:00010000:1.0:1763334987.715989:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d463 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08da expref: 28 pid: 26564 timeout: 1152 lvb_type: 1 00000100:00100000:1.0:1763334987.716050:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2741 00000100:00100000:1.0:1763334987.716061:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694688128:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334987.716082:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334987.716112:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d463 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08da expref: 28 pid: 26564 timeout: 1152 lvb_type: 1 00010000:00010000:1.0:1763334987.716129:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d463 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08da expref: 28 pid: 26564 timeout: 1152 lvb_type: 1 00010000:00010000:1.0:1763334987.716166:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d463 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08da expref: 28 pid: 26564 timeout: 1152 lvb_type: 1 00010000:00010000:1.0:1763334987.716190:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.716193:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334987.716204:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0920 expref: 27 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.716217:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d56d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0920 expref: 27 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.716273:0:5735:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d56d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0920 expref: 27 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334987.716291:0:5735:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701915648:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334987.716410:0:5735:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1780 going to sleep for 11 seconds 00000100:00100000:1.0:1763334987.723521:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334987.723672:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694688256 00000100:00100000:2.0:1763334987.723688:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694688256 00002000:00010000:2.0:1763334987.723752:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (262144->18446744073709551615) 00002000:00100000:2.0:1763334987.723759:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e4c000 with x1848989694688256 ext(262144->18446744073709551615) 00002000:00010000:2.0:1763334987.723776:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac7e4c000. 00000100:00100000:2.0:1763334987.723812:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2019 00000100:00100000:2.0:1763334987.723822:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694688256:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334987.724137:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 133906 -> 262144 00002000:00010000:2.0:1763334987.724141:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334986 -> 1763334988 00002000:00010000:2.0:1763334987.724144:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:2.0:1763334987.724146:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334987 -> 1763334988 00002000:00010000:2.0:1763334987.724150:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 79 -> 79 00000100:00100000:2.0:1763334987.724244:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694688256:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 422us (738us total) trans 17179871336 rc 0/0 00000100:00100000:2.0:1763334987.724252:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2019 00002000:00010000:2.0:1763334987.724258:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (262144->18446744073709551615) 00002000:00100000:2.0:1763334987.724260:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e4c000 with x1848989694688256 ext(262144->18446744073709551615) 00002000:00010000:2.0:1763334987.724266:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac7e4c000. 00000100:00100000:2.0:1763334987.729441:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334987.729489:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.729562:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694688384 00000100:00100000:0.0:1763334987.729601:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694688384 00000100:00100000:1.0:1763334987.729646:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694688512 00000100:00100000:1.0:1763334987.729651:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694688512 00002000:00010000:0.0:1763334987.729665:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334987.729672:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac841ad80 with x1848989694688384 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334987.729675:0:14183:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763334987.729681:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac841b100 with x1848989694688512 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334987.729689:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac841ad80. 00002000:00010000:1.0:1763334987.729690:0:14183:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac841b100. 00000100:00100000:0.0:1763334987.729740:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2020 00000100:00100000:0.0:1763334987.729753:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694688384:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:3.0:1763334987.730060:0:5735:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5735:1848989701915648:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334987.730093:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:0.0:1763334987.730101:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334987.730106:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334986 -> 1763334988 00002000:00010000:0.0:1763334987.730109:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334987.730112:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334987 -> 1763334988 00002000:00010000:0.0:1763334987.730115:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334987.730219:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694688384:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 468us (791us total) trans 21474838567 rc 0/0 00000100:00100000:0.0:1763334987.730230:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2020 00002000:00010000:0.0:1763334987.730235:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334987.730238:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac841ad80 with x1848989694688384 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334987.730243:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac841ad80. 00000100:00100000:0.0:1763334987.730265:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2021 00000100:00100000:0.0:1763334987.730272:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694688512:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334987.730393:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334987.730397:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334986 -> 1763334988 00002000:00010000:0.0:1763334987.730399:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334987.730402:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334987 -> 1763334988 00002000:00010000:0.0:1763334987.730404:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334987.730426:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694688512:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 154us (935us total) trans 17179871337 rc 0/0 00000100:00100000:0.0:1763334987.730433:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2021 00002000:00010000:0.0:1763334987.730436:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334987.730439:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac841b100 with x1848989694688512 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334987.730443:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac841b100. 00000100:00100000:3.0:1763334987.731382:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694688128:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 15314us (17990us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334987.731396:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2741 00000100:00100000:2.0:1763334987.741463:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.742006:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694688640 00000100:00100000:0.0:1763334987.742024:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694688640 00002000:00100000:0.0:1763334987.742097:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (0->262143) req@ffff9a5ac841b480 x1848989694688640/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:33/0 lens 488/0 e 0 to 0 dl 1763334998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334987.742111:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac841b480 with x1848989694688640 ext(0->262143) 00002000:00010000:0.0:1763334987.742118:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac841b480 00000100:00100000:0.0:1763334987.742160:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2022 00000100:00100000:0.0:1763334987.742174:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac841b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2362:x1848989694688640:12345-192.168.201.60@tcp:3:fsx.0 00000100:00100000:0.0:1763334987.758586:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac841b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2362:x1848989694688640:12345-192.168.201.60@tcp:3:fsx.0 Request processed in 16380us (17104us total) trans 0 rc 262144/262144 00000100:00100000:0.0:1763334987.758607:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2022 00002000:00100000:0.0:1763334987.758627:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (0->262143) req@ffff9a5ac841b480 x1848989694688640/t0(0) o3->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:33/0 lens 488/440 e 0 to 0 dl 1763334998 ref 1 fl Complete:/600/0 rc 262144/262144 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334987.758639:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac841b480 with x1848989694688640 ext(0->262143) 00002000:00010000:0.0:1763334987.758647:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac841b480 00000100:00100000:1.0:1763334987.770621:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.770804:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694688768 00000100:00100000:0.0:1763334987.770819:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694688768 00002000:00100000:0.0:1763334987.771018:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (249856->262143) req@ffff9a5ac7e4e680 x1848989694688768/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:33/0 lens 12776/0 e 0 to 0 dl 1763334998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334987.771030:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e4e680 with x1848989694688768 ext(249856->262143) 00002000:00010000:0.0:1763334987.771039:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac7e4e680 00000100:00100000:0.0:1763334987.771086:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2023 00000100:00100000:0.0:1763334987.771098:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2362:x1848989694688768:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:0.0:1763334987.772203:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2362:x1848989694688768:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 1102us (1635us total) trans 17179871338 rc 0/0 00000100:00100000:0.0:1763334987.772216:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2023 00002000:00100000:0.0:1763334987.772225:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (249856->262143) req@ffff9a5ac7e4e680 x1848989694688768/t17179871338(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:33/0 lens 12776/448 e 0 to 0 dl 1763334998 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334987.772236:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac7e4e680 with x1848989694688768 ext(249856->262143) 00002000:00010000:0.0:1763334987.772241:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac7e4e680 00000100:00100000:2.0:1763334987.780828:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.781085:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694688896 00000100:00100000:0.0:1763334987.781100:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694688896 00000100:00100000:0.0:1763334987.781238:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5282 00000100:00100000:0.0:1763334987.781251:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+31:2361:x1848989694688896:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:3.0:1763334987.878966:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871338 is committed 00000001:00080000:3.0:1763334987.878998:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871329 is committed 00000001:00080000:3.0:1763334987.879020:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871335 is committed 00000100:00100000:0.0:1763334987.879999:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2361:x1848989694688896:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 98739us (99176us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334987.880015:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5282 00000100:00100000:3.0:1763334987.889320:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334987.889414:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694689024 00000100:00100000:2.0:1763334987.889427:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694689024 00000100:00100000:2.0:1763334987.889512:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5109 00000100:00100000:2.0:1763334987.889524:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+188:53644:x1848989694689024:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334987.889556:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334987.890039:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d574 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0927 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.890167:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d57b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334987.890186:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d57b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334987.890200:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d57b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334987.890238:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 262146 00000004:00200000:1.0:1763334987.890244:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334987.890268:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d57b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334987.890302:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d574 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0927 expref: 190 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.890333:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d57b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0927 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334987.890343:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:1.0:1763334987.890348:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334987.890354:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:1.0:1763334987.890448:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694689024:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 926us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334987.890456:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5109 00000100:00100000:2.0:1763334987.917839:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334987.917974:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694689152 00000100:00100000:0.0:1763334987.917989:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694689152 00002000:00100000:0.0:1763334987.918065:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (69632->131071) req@ffff9a5ac8418000 x1848989694689152/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:33/0 lens 488/0 e 0 to 0 dl 1763334998 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334987.918078:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac8418000 with x1848989694689152 ext(69632->131071) 00002000:00010000:0.0:1763334987.918086:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac8418000 00000100:00100000:0.0:1763334987.918129:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2024 00000100:00100000:0.0:1763334987.918141:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694689152:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:0.0:1763334987.955511:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8418000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694689152:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 37352us (37669us total) trans 17179871339 rc 0/0 00000100:00100000:0.0:1763334987.955531:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2024 00002000:00100000:0.0:1763334987.955550:0:14385:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x24a:0x0] (69632->131071) req@ffff9a5ac8418000 x1848989694689152/t17179871339(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:33/0 lens 488/448 e 0 to 0 dl 1763334998 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1763334987.955561:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac8418000 with x1848989694689152 ext(69632->131071) 00002000:00010000:0.0:1763334987.955589:0:14385:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac8418000 00000100:00100000:1.0:1763334987.973205:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334987.973300:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694689280 00000100:00100000:2.0:1763334987.973316:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694689280 00000100:00100000:2.0:1763334987.973412:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5283 00000100:00100000:2.0:1763334987.973428:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694689280:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:3.0:1763334988.074760:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871339 is committed 00000100:00100000:0.0:1763334988.074973:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694689280:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 101539us (101775us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.074986:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5283 00000100:00100000:2.0:1763334988.103687:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.104379:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694689536 00000100:00100000:1.0:1763334988.104396:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694689536 00000100:00100000:1.0:1763334988.104483:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5110 00000100:00100000:1.0:1763334988.104495:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694689536:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:1.0:1763334988.104612:0:30972:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1763334988.104650:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d57b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0927 expref: 189 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.104675:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d566 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xa/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0919 expref: 188 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.104688:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5af66dee00) 00010000:00010000:1.0:1763334988.104701:0:30972:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334988.105102:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d582 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334988.105121:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d582 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334988.105134:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d582 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000001:00080000:1.0:1763334988.105206:0:30972:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939319 00000004:00010000:1.0:1763334988.105236:0:30972:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000272c78f1 reply state 00000000aa3e4c1c transno 8589939320 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d582 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000100:00100000:1.0:1763334988.105247:0:30972:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334988.105385:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5576680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694689536:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 891us (1710us total) trans 8589939320 rc 0/0 00000100:00100000:1.0:1763334988.105393:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5110 00000020:00080000:1.0:1763334988.105399:0:30972:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1763334988.111625:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d582 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334988.111649:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d582 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334988.111659:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d582 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334988.111666:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334988.111672:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d582 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334988.111681:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d582 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334988.111703:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa200) 00010000:00010000:0.0:1763334988.111707:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334988.111713:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d582 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:0.0:1763334988.111720:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478800/0xcedf0054f849d582 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334988.112886:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.113197:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694689664 00000100:00100000:0.0:1763334988.113213:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694689664 00000100:00100000:0.0:1763334988.113293:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5111 00000100:00100000:0.0:1763334988.113306:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+189:53644:x1848989694689664:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334988.113337:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334988.113373:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d589 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b092e expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.113460:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d589 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b092e expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.113478:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d589 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b092e expref: 190 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.113500:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334988.113504:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334988.113508:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793200, rc 0) 00000100:00100000:0.0:1763334988.113621:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694689664:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 316us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.113629:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5111 00000100:00100000:2.0:1763334988.140777:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.140816:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.140846:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.140932:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694689792 00000100:00100000:0.0:1763334988.140945:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694689792 00002000:00010000:0.0:1763334988.141000:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (244162->18446744073709551615) 00002000:00100000:0.0:1763334988.141005:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5575500 with x1848989694689792 ext(244162->18446744073709551615) 00002000:00010000:0.0:1763334988.141021:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5575500. 00000100:00100000:0.0:1763334988.141058:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694690048 00000100:00100000:0.0:1763334988.141060:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694690048 00002000:00010000:0.0:1763334988.141072:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334988.141075:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5575c00 with x1848989694690048 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334988.141080:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5575c00. 00000100:00100000:0.0:1763334988.141094:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694689920 00000100:00100000:0.0:1763334988.141096:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694689920 00002000:00010000:0.0:1763334988.141107:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334988.141110:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5577100 with x1848989694689920 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334988.141116:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac5577100. 00000100:00100000:0.0:1763334988.141132:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2025 00000100:00100000:0.0:1763334988.141141:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694689792:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334988.141619:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 262144 -> 244162 00002000:00010000:0.0:1763334988.141624:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334988 -> 1763334988 00002000:00010000:0.0:1763334988.141628:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334988.141631:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334988 -> 1763334988 00002000:00010000:0.0:1763334988.141633:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 79 -> 153 00000100:00100000:0.0:1763334988.141705:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694689792:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 563us (942us total) trans 17179871340 rc 0/0 00000100:00100000:0.0:1763334988.141712:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2025 00002000:00010000:0.0:1763334988.141716:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (244162->18446744073709551615) 00002000:00100000:0.0:1763334988.141719:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5575500 with x1848989694689792 ext(244162->18446744073709551615) 00002000:00010000:0.0:1763334988.141723:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5575500. 00000100:00100000:0.0:1763334988.141748:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2026 00000100:00100000:0.0:1763334988.141755:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694690048:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334988.141876:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334988.141879:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334988 -> 1763334988 00002000:00010000:0.0:1763334988.141881:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334988.141883:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334988 -> 1763334988 00002000:00010000:0.0:1763334988.141885:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334988.141906:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694690048:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 152us (1089us total) trans 17179871341 rc 0/0 00000100:00100000:0.0:1763334988.141913:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2026 00002000:00010000:0.0:1763334988.141916:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:0.0:1763334988.141918:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5575c00 with x1848989694690048 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334988.141923:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5575c00. 00000100:00100000:0.0:1763334988.141937:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2027 00000100:00100000:0.0:1763334988.141943:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694689920:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:0.0:1763334988.142072:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1763334988.142076:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334988 -> 1763334988 00002000:00010000:0.0:1763334988.142078:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334988.142080:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334988 -> 1763334988 00002000:00010000:0.0:1763334988.142081:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:0.0:1763334988.142107:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694689920:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 164us (1259us total) trans 21474838568 rc 0/0 00000100:00100000:0.0:1763334988.142113:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2027 00002000:00010000:0.0:1763334988.142115:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:0.0:1763334988.142117:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5577100 with x1848989694689920 ext(0->18446744073709551615) 00002000:00010000:0.0:1763334988.142121:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac5577100. 00000100:00100000:2.0:1763334988.144898:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.145003:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694690176 00000100:00100000:1.0:1763334988.145019:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694690176 00000100:00100000:1.0:1763334988.145091:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5112 00000100:00100000:1.0:1763334988.145104:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+190:53644:x1848989694690176:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334988.145137:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334988.145172:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d590 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0935 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.145294:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d597 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334988.145313:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d597 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334988.145326:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d597 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334988.145359:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 244162 00000004:00200000:1.0:1763334988.145364:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334988.145385:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d597 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334988.145417:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d590 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0935 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.145437:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d597 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0935 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.145446:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:1.0:1763334988.145449:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334988.145454:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334988.145526:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694690176:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 425us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.145532:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5112 00000100:00100000:0.0:1763334988.150751:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.150884:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694690304 00000100:00100000:1.0:1763334988.150899:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694690304 00002000:00100000:1.0:1763334988.150973:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (217088->241663) req@ffff9a5aeec5b100 x1848989694690304/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:34/0 lens 488/0 e 0 to 0 dl 1763334999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334988.150985:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec5b100 with x1848989694690304 ext(217088->241663) 00002000:00010000:1.0:1763334988.150992:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeec5b100 00000100:00100000:1.0:1763334988.151033:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2028 00000100:00100000:1.0:1763334988.151045:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694690304:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:1.0:1763334988.153493:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694690304:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 2433us (2741us total) trans 17179871342 rc 0/0 00000100:00100000:1.0:1763334988.153510:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2028 00002000:00100000:1.0:1763334988.153526:0:14183:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x24a:0x0] (217088->241663) req@ffff9a5aeec5b100 x1848989694690304/t17179871342(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:34/0 lens 488/448 e 0 to 0 dl 1763334999 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1763334988.153537:0:14183:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec5b100 with x1848989694690304 ext(217088->241663) 00002000:00010000:1.0:1763334988.153544:0:14183:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeec5b100 00000100:00100000:2.0:1763334988.169538:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.169682:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694690432 00000100:00100000:0.0:1763334988.169695:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694690432 00000100:00100000:0.0:1763334988.169773:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5284 00000100:00100000:0.0:1763334988.169785:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694690432:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:3.0:1763334988.219219:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871341 is committed 00000001:00080000:3.0:1763334988.219593:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871342 is committed 00000100:00100000:1.0:1763334988.219966:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694690432:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 50173us (50434us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.219983:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5284 00000100:00100000:0.0:1763334988.227642:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.227818:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694690688 00000100:00100000:2.0:1763334988.227834:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694690688 00000100:00100000:2.0:1763334988.237899:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5113 00000100:00100000:2.0:1763334988.237940:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53644:x1848989694690688:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:2.0:1763334988.238025:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334988.238068:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d597 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0935 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.238097:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:2.0:1763334988.238104:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334988.238457:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d59e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334988.238475:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d59e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334988.238487:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d59e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000001:00080000:2.0:1763334988.238557:0:29628:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939321 00000004:00010000:2.0:1763334988.238647:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000cc3cb8ca reply state 00000000a1767d7e transno 8589939322 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d59e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:2.0:1763334988.238659:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1763334988.238813:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53644:x1848989694690688:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 893us (11183us total) trans 8589939322 rc 0/0 00000100:00100000:2.0:1763334988.238823:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5113 00000020:00080000:2.0:1763334988.238832:0:29628:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1763334988.251301:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d59e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334988.251330:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d59e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334988.251338:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d59e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334988.251347:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334988.251354:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d59e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334988.251363:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d59e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334988.251388:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:3.0:1763334988.251392:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334988.251398:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d59e lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334988.251405:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d59e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:0.0:1763334988.256071:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.256127:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.256169:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.256310:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694690944 00000100:00100000:2.0:1763334988.256329:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694690944 00002000:00010000:2.0:1763334988.256400:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:2.0:1763334988.256406:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec59180 with x1848989694690944 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334988.256424:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeec59180. 00000100:00100000:2.0:1763334988.256463:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694690816 00000100:00100000:2.0:1763334988.256467:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694690816 00002000:00010000:2.0:1763334988.256482:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (205664->18446744073709551615) 00002000:00100000:2.0:1763334988.256486:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec5b480 with x1848989694690816 ext(205664->18446744073709551615) 00002000:00010000:2.0:1763334988.256494:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeec5b480. 00000100:00100000:2.0:1763334988.256510:0:21629:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694691072 00000100:00100000:2.0:1763334988.256513:0:21629:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694691072 00002000:00010000:2.0:1763334988.256524:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:2.0:1763334988.256528:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec5a680 with x1848989694691072 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334988.256534:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeec5a680. 00000100:00100000:2.0:1763334988.256553:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2029 00000100:00100000:2.0:1763334988.256564:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2360:x1848989694690944:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334988.256908:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334988.256913:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334988 -> 1763334988 00002000:00010000:2.0:1763334988.256915:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:2.0:1763334988.256918:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334988 -> 1763334988 00002000:00010000:2.0:1763334988.256921:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334988.256995:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694690944:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 431us (942us total) trans 21474838569 rc 0/0 00000100:00100000:2.0:1763334988.257004:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2029 00002000:00010000:2.0:1763334988.257009:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:2.0:1763334988.257012:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec59180 with x1848989694690944 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334988.257017:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5aeec59180. 00000100:00100000:2.0:1763334988.257039:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2030 00000100:00100000:2.0:1763334988.257046:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694690816:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334988.257359:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 244162 -> 205664 00002000:00010000:2.0:1763334988.257363:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334988 -> 1763334988 00002000:00010000:2.0:1763334988.257365:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:2.0:1763334988.257368:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334988 -> 1763334988 00002000:00010000:2.0:1763334988.257370:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 153 -> 177 00000100:00100000:2.0:1763334988.257392:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694690816:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 347us (1265us total) trans 17179871343 rc 0/0 00000100:00100000:2.0:1763334988.257399:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2030 00002000:00010000:2.0:1763334988.257402:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (205664->18446744073709551615) 00002000:00100000:2.0:1763334988.257405:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec5b480 with x1848989694690816 ext(205664->18446744073709551615) 00002000:00010000:2.0:1763334988.257410:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeec5b480. 00000100:00100000:2.0:1763334988.257422:0:21629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2031 00000100:00100000:2.0:1763334988.257428:0:21629:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694691072:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:2.0:1763334988.257525:0:21629:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334988.257529:0:21629:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334988 -> 1763334988 00002000:00010000:2.0:1763334988.257531:0:21629:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:2.0:1763334988.257533:0:21629:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334988 -> 1763334988 00002000:00010000:2.0:1763334988.257536:0:21629:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334988.257557:0:21629:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694691072:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 129us (1387us total) trans 17179871344 rc 0/0 00000100:00100000:2.0:1763334988.257564:0:21629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2031 00002000:00010000:2.0:1763334988.257567:0:21629:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:2.0:1763334988.257599:0:21629:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5aeec5a680 with x1848989694691072 ext(0->18446744073709551615) 00002000:00010000:2.0:1763334988.257605:0:21629:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5aeec5a680. 00000100:00100000:2.0:1763334988.265824:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.266294:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694691200 00000100:00100000:0.0:1763334988.266309:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694691200 00000100:00100000:1.0:1763334988.267228:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5114 00000100:00100000:1.0:1763334988.267255:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53644:x1848989694691200:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334988.267289:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334988.267320:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d5a5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b093c expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.267456:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d5ac lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334988.267473:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d5ac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334988.267486:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d5ac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334988.267522:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 205664 00000004:00200000:1.0:1763334988.267527:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334988.267549:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d5ac lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334988.267617:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d5a5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b093c expref: 194 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.267645:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d5ac lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b093c expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.267655:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:1.0:1763334988.267658:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334988.267662:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478200, rc 0) 00000100:00100000:1.0:1763334988.267741:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53644:x1848989694691200:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 499us (1933us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.267749:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5114 00000100:00100000:3.0:1763334988.287406:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.288276:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694691328 00000100:00100000:2.0:1763334988.288292:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694691328 00002000:00100000:2.0:1763334988.288361:0:21630:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x24a:0x0] (110592->238471) req@ffff9a5afa7ed880 x1848989694691328/t0(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:34/0 lens 504/0 e 0 to 0 dl 1763334999 ref 1 fl New:/600/ffffffff rc 0/-1 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1763334988.288374:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa7ed880 with x1848989694691328 ext(110592->238471) 00002000:00010000:2.0:1763334988.288382:0:21630:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa7ed880 00000100:00100000:2.0:1763334988.288423:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2032 00000100:00100000:2.0:1763334988.288434:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694691328:12345-192.168.201.60@tcp:4:fsx.0 00000100:00100000:3.0:1763334988.296975:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694691328:12345-192.168.201.60@tcp:4:fsx.0 Request processed in 8518us (9560us total) trans 17179871345 rc 0/0 00000100:00100000:3.0:1763334988.296999:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2032 00002000:00100000:3.0:1763334988.297020:0:21630:0:(ofd_dev.c:2706:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x280000400:0x24a:0x0] (110592->238471) req@ffff9a5afa7ed880 x1848989694691328/t17179871345(0) o4->f4599faa-cf4a-4df6-8700-d383b4282dac@192.168.201.60@tcp:34/0 lens 504/448 e 0 to 0 dl 1763334999 ref 1 fl Complete:/600/0 rc 0/0 job:'fsx.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1763334988.297034:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5afa7ed880 with x1848989694691328 ext(110592->238471) 00002000:00010000:3.0:1763334988.297043:0:21630:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5afa7ed880 00000100:00100000:3.0:1763334988.302525:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.303639:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694691456 00000100:00100000:1.0:1763334988.303659:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694691456 00000100:00100000:1.0:1763334988.303770:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5285 00000100:00100000:1.0:1763334988.303785:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694691456:12345-192.168.201.60@tcp:16:fsx.0 00000001:00080000:1.0:1763334988.370525:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871344 is committed 00000001:00080000:1.0:1763334988.370566:0:23697:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179871345 is committed 00000100:00100000:0.0:1763334988.371009:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+21:2359:x1848989694691456:12345-192.168.201.60@tcp:16:fsx.0 Request processed in 67218us (68491us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.371029:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5285 00000100:00100000:1.0:1763334988.381668:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.387543:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694691712 00000100:00100000:0.0:1763334988.387565:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694691712 00000100:00100000:0.0:1763334988.387707:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5115 00000100:00100000:0.0:1763334988.387719:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53644:x1848989694691712:12345-192.168.201.60@tcp:36:fsx.0 00010000:00010000:0.0:1763334988.387790:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334988.387830:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478200/0xcedf0054f849d5ac lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b093c expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.387867:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334988.387874:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334988.388198:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d5b3 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.388216:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d5b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.388228:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d5b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000001:00080000:0.0:1763334988.388293:0:29628:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939323 00000004:00010000:0.0:1763334988.388322:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000007b10bb36 reply state 000000007340a190 transno 8589939324 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d5b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:0.0:1763334988.388333:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334988.388490:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694691712:12345-192.168.201.60@tcp:36:fsx.0 Request processed in 771us (6839us total) trans 8589939324 rc 0/0 00000100:00100000:0.0:1763334988.388498:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5115 00000020:00080000:0.0:1763334988.388506:0:29628:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1763334988.393761:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.393803:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.393834:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.393884:0:25999:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694691840 00000100:00100000:3.0:1763334988.393899:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694692096 00000100:00100000:2.0:1763334988.393899:0:25999:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694691840 00000100:00100000:3.0:1763334988.393903:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694692096 00002000:00010000:3.0:1763334988.393959:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:3.0:1763334988.393965:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5574e00 with x1848989694692096 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334988.393980:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5574e00. 00010000:00010000:0.0:1763334988.393986:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d5b3 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.393998:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d5b3 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.394006:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d5b3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00000100:00100000:3.0:1763334988.394007:0:21630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694691968 00000100:00100000:3.0:1763334988.394011:0:21630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694691968 00010000:00010000:0.0:1763334988.394013:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334988.394019:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d5b3 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.394028:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d5b3 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.394053:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334988.394057:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334988.394063:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d5b3 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.394069:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d5b3 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334988.394772:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2033 00000100:00100000:1.0:1763334988.394793:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694692096:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:1.0:1763334988.395201:0:14385:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334988.395206:0:14385:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334988 -> 1763334989 00002000:00010000:1.0:1763334988.395209:0:14385:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:1.0:1763334988.395212:0:14385:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334988 -> 1763334989 00002000:00010000:1.0:1763334988.395215:0:14385:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00002000:00010000:3.0:1763334988.395372:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00010000:2.0:1763334988.395372:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (2104->18446744073709551615) 00002000:00100000:3.0:1763334988.395379:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5575f80 with x1848989694691968 ext(0->18446744073709551615) 00002000:00100000:2.0:1763334988.395379:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5577480 with x1848989694691840 ext(2104->18446744073709551615) 00002000:00010000:3.0:1763334988.395388:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac5575f80. 00002000:00010000:2.0:1763334988.395388:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5577480. 00000100:00100000:2.0:1763334988.395424:0:25999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2034 00000100:00100000:3.0:1763334988.395428:0:21630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2035 00000100:00100000:2.0:1763334988.395434:0:25999:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694691840:12345-192.168.201.60@tcp:10:fsx.0 00000100:00100000:3.0:1763334988.395435:0:21630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694691968:12345-192.168.201.60@tcp:10:fsx.0 00002000:00010000:3.0:1763334988.395592:0:21630:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334988.395595:0:21630:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334988 -> 1763334989 00002000:00010000:3.0:1763334988.395598:0:21630:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:3.0:1763334988.395600:0:21630:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334988 -> 1763334989 00002000:00010000:3.0:1763334988.395602:0:21630:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:3.0:1763334988.395677:0:21630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5575f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694691968:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 242us (1841us total) trans 21474838570 rc 0/0 00000100:00100000:3.0:1763334988.395685:0:21630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2035 00002000:00010000:3.0:1763334988.395690:0:21630:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/584 (0->18446744073709551615) 00002000:00100000:3.0:1763334988.395693:0:21630:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5575f80 with x1848989694691968 ext(0->18446744073709551615) 00002000:00010000:3.0:1763334988.395697:0:21630:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9a5ac5575f80. 00002000:00010000:2.0:1763334988.395801:0:25999:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 205664 -> 2104 00002000:00010000:2.0:1763334988.395805:0:25999:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334988 -> 1763334989 00002000:00010000:2.0:1763334988.395807:0:25999:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:2.0:1763334988.395809:0:25999:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334988 -> 1763334989 00002000:00010000:2.0:1763334988.395812:0:25999:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 177 -> 187 00000100:00100000:2.0:1763334988.395836:0:25999:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_016:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694691840:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 405us (2094us total) trans 17179871347 rc 0/0 00000100:00100000:2.0:1763334988.395843:0:25999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2034 00002000:00010000:2.0:1763334988.395856:0:25999:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/586 (2104->18446744073709551615) 00002000:00100000:2.0:1763334988.395858:0:25999:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5577480 with x1848989694691840 ext(2104->18446744073709551615) 00002000:00010000:2.0:1763334988.395863:0:25999:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5577480. 00000100:00100000:1.0:1763334988.396036:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5574e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694692096:12345-192.168.201.60@tcp:10:fsx.0 Request processed in 1253us (2232us total) trans 17179871346 rc 0/0 00000100:00100000:1.0:1763334988.396045:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2033 00002000:00010000:1.0:1763334988.396049:0:14385:0:(ofd_dev.c:2821:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/588 (0->18446744073709551615) 00002000:00100000:1.0:1763334988.396051:0:14385:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff9a5ac5574e00 with x1848989694692096 ext(0->18446744073709551615) 00002000:00010000:1.0:1763334988.396057:0:14385:0:(ofd_dev.c:2826:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9a5ac5574e00. 00000100:00100000:3.0:1763334988.403904:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.404032:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694692224 00000100:00100000:1.0:1763334988.404048:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694692224 00000100:00100000:1.0:1763334988.404134:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5116 00000100:00100000:1.0:1763334988.405495:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53644:x1848989694692224:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:1.0:1763334988.405540:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334988.405590:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d5ba lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0943 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.405746:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849d5c1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334988.405762:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849d5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334988.405773:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849d5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:1.0:1763334988.405808:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 2104 00000004:00200000:1.0:1763334988.405814:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1763334988.405837:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849d5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:1.0:1763334988.405877:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d5ba lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0943 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.405899:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849d5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0943 expref: 195 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.405909:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:1.0:1763334988.405913:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1763334988.405917:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334988.406011:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694692224:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 1868us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.406020:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5116 00000100:00100000:2.0:1763334988.415526:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.425168:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694692480 00000100:00100000:0.0:1763334988.425196:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694692480 00000100:00100000:1.0:1763334988.425866:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1854 00000100:00100000:1.0:1763334988.425881:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53644:x1848989694692480:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:1.0:1763334988.426350:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac5577800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53644:x1848989694692480:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 471us (10846us total) trans 8589939325 rc 0/0 00000100:00100000:1.0:1763334988.426360:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1854 00000100:00100000:2.0:1763334988.442859:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.443086:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694692736 00000100:00100000:1.0:1763334988.443101:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694692736 00000100:00100000:0.0:1763334988.443810:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5117 00000100:00100000:0.0:1763334988.443829:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53676:x1848989694692736:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334988.443872:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334988.443899:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d5c8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b094a expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.443995:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d5cf lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444014:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d5cf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444027:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d5cf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444042:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d5d6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444049:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d5d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444056:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d5d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444223:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d5dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444233:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d5dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444239:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d5dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:0.0:1763334988.444250:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 2104 00010000:00010000:0.0:1763334988.444362:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d5cf lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444370:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d5cf lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444377:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d5cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444387:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334988.444391:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d5cf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444399:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d5cf lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444412:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:0.0:1763334988.444415:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334988.444420:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d5cf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444426:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d5cf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444440:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d5d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444446:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d5d6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444452:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d5d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444457:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334988.444459:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d5d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444465:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d5d6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444470:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5ac7d60300) 00010000:00010000:0.0:1763334988.444473:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334988.444476:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d5d6 lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444482:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d5d6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.444524:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d5c8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b094a expref: 199 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.444537:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d5dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b094a expref: 198 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.444544:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334988.444547:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1763334988.444550:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792000, rc 0) 00000100:00100000:0.0:1763334988.444676:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53676:x1848989694692736:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 853us (1843us total) trans 8589939326 rc 0/0 00000100:00100000:0.0:1763334988.444685:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5117 00000100:00100000:3.0:1763334988.452982:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.453199:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694692864 00000100:00100000:1.0:1763334988.453213:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694692864 00000100:00100000:1.0:1763334988.453311:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 427 00000100:00100000:1.0:1763334988.453324:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+198:2359:x1848989694692864:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334988.453345:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334988.453379:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6792000/0xcedf0054f849d5dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b094a expref: 198 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.453404:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:1.0:1763334988.453409:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334988.453493:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+197:2359:x1848989694692864:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 172us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.453505:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 427 00000100:00100000:2.0:1763334988.454716:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334988.455369:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694693120 00000100:00100000:3.0:1763334988.455383:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694693120 00000100:00100000:3.0:1763334988.456004:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5118 00000100:00100000:3.0:1763334988.456020:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+197:53676:x1848989694693120:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334988.456053:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334988.456084:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d5eb lrc: 2/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0951 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.456873:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d5f2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334988.456891:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334988.456903:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d5f2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334988.456915:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b5:0x0]: returning size 0 00010000:00010000:3.0:1763334988.456969:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d5eb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0951 expref: 200 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.456990:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0951 expref: 199 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.456999:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b5:0x0].0x0 (ffff9a5af66dec00) 00010000:00010000:3.0:1763334988.457003:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334988.457006:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8000, rc 0) 00000100:00100000:3.0:1763334988.457096:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53676:x1848989694693120:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1081us (2389us total) trans 8589939327 rc 0/0 00000100:00100000:3.0:1763334988.457105:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5118 00000100:00100000:2.0:1763334988.464544:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334988.464927:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694693376 00000100:00100000:3.0:1763334988.464941:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694693376 00000100:00100000:0.0:1763334988.465818:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5119 00000100:00100000:0.0:1763334988.465841:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53676:x1848989694693376:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334988.465885:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334988.465981:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d600 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0958 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.466187:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.466206:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d5f2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0951 expref: 200 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.466216:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.466254:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d5f2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0951 expref: 200 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.466271:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0951 expref: 200 pid: 30972 timeout: 1153 lvb_type: 0 00000100:00100000:0.0:1763334988.466286:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa744000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701915776:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334988.466402:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c4155c00 going to sleep for 11 seconds 00000100:00100000:3.0:1763334988.470656:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.471057:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694693504 00000100:00100000:1.0:1763334988.471074:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694693504 00010000:00010000:1.0:1763334988.471126:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d5f2 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0951 expref: 201 pid: 30972 timeout: 1153 lvb_type: 0 00000100:00100000:1.0:1763334988.471171:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2742 00000100:00100000:1.0:1763334988.471184:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+201:2359:x1848989694693504:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334988.471204:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334988.471213:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d5f2 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0951 expref: 201 pid: 30972 timeout: 1153 lvb_type: 0 00010000:00010000:1.0:1763334988.471228:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d5f2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0951 expref: 201 pid: 30972 timeout: 1153 lvb_type: 0 00010000:00010000:1.0:1763334988.471272:0:5735:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b5:0x0].0x0 (ffff9a5af66dec00) 00010000:00010000:1.0:1763334988.471280:0:5735:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334988.471292:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334988.471300:0:5735:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334988.471327:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334988.471408:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+201:2359:x1848989694693504:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 225us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.471417:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2742 00010000:00010000:0.0:1763334988.475553:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d5f2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0951 expref: 200 pid: 30972 timeout: 1153 lvb_type: 0 00000100:00100000:0.0:1763334988.475616:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa744000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701915776:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334988.475642:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.475653:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.475660:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:0.0:1763334988.475685:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b5:0x0]: returning size 0 00000004:00080000:0.0:1763334988.476087:0:29628:0:(osp_object.c:1649:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24e:0x0], index 0: 0 00000004:00080000:0.0:1763334988.476100:0:29628:0:(osp_object.c:1649:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x252:0x0], index 1: 0 00010000:00010000:0.0:1763334988.476276:0:29628:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.476286:0:29628:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.476293:0:29628:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.476297:0:29628:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334988.476301:0:29628:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.476307:0:29628:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.476322:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b5:0x0].0x0 (ffff9a5af66dec00) 00010000:00010000:0.0:1763334988.476325:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1763334988.476330:0:29628:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.476336:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d607 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.476392:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d600 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0958 expref: 200 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.476403:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:0.0:1763334988.476406:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1763334988.476410:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d600 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0958 expref: 200 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.476418:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6793a00, rc 0) 00000100:00100000:0.0:1763334988.476497:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53676:x1848989694693376:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 10665us (11966us total) trans 8589939328 rc 301/301 00000100:00100000:0.0:1763334988.476506:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5119 00000100:00100000:3.0:1763334988.479387:0:29653:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7eea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:29653:1848989701915904:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1763334988.479483:0:29653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334988.479528:0:29653:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b480 going to sleep for 11 seconds 00000100:00100000:0.0:1763334988.479608:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701915904 00000100:00100000:0.0:1763334988.479629:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701915904 00000100:00100000:0.0:1763334988.479698:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5286 00000100:00100000:0.0:1763334988.479709:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:29653:x1848989701915904:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1763334988.479762:0:25383:0:(ofd_dev.c:1745:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 610 00000100:00100000:3.0:1763334988.486039:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.486154:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694693760 00000100:00100000:1.0:1763334988.486174:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694693760 00000100:00100000:1.0:1763334988.486269:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1855 00000100:00100000:1.0:1763334988.486280:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53676:x1848989694693760:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334988.487111:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53676:x1848989694693760:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 827us (1075us total) trans 8589939329 rc 0/0 00000100:00100000:1.0:1763334988.487122:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1855 00000100:00100000:1.0:1763334988.496628:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.496731:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694693888 00000100:00100000:2.0:1763334988.496751:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694693888 00000100:00100000:2.0:1763334988.496856:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5120 00000100:00100000:2.0:1763334988.496870:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53676:x1848989694693888:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334988.496904:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334988.496940:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d615 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b095f expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.497037:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d61c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334988.497055:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d61c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334988.497068:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d61c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334988.497117:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1b5:0x0]: returning size 0 00000004:00200000:2.0:1763334988.497123:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334988.497145:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d61c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334988.497178:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d615 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b095f expref: 202 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.497200:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d61c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b095f expref: 201 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.497211:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b5:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:2.0:1763334988.497214:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1763334988.497219:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431000, rc 0) 00000100:00100000:2.0:1763334988.497310:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53676:x1848989694693888:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 444us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334988.497318:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5120 00000100:00100000:3.0:1763334988.499946:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334988.500001:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.500161:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694694016 00000100:00100000:1.0:1763334988.500175:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694694016 00000100:00100000:1.0:1763334988.500250:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694694144 00000100:00100000:1.0:1763334988.500254:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694694144 00000100:00100000:1.0:1763334988.500292:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5287 00000100:00100000:1.0:1763334988.500306:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694694016:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334988.500330:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334988.500370:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d623 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0966 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334988.500407:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1763334988.500432:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.500435:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.500450:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d623 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0966 expref: 24 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334988.500473:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d623 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0966 expref: 24 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334988.500489:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479c00, rc 0) 00000100:00100000:1.0:1763334988.500561:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694694016:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 258us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.500961:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5287 00000100:00100000:3.0:1763334988.501017:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5288 00000100:00100000:3.0:1763334988.501034:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694694144:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334988.501048:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334988.501068:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d62a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b096d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334988.501095:0:6519:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x252:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1763334988.501109:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334988.501111:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334988.501118:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d62a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b096d expref: 24 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334988.501133:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d62a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x252:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b096d expref: 24 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334988.501142:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9a00, rc 0) 00000100:00100000:3.0:1763334988.501172:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694694144:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 146us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334988.501179:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5288 00000100:00100000:0.0:1763334988.507305:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7edf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+6:29653:x1848989701915904:12345-0@lo:5:osp-pre-1-0.0 Request processed in 27591us (27815us total) trans 17179871348 rc 0/0 00000100:00100000:0.0:1763334988.507320:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5286 00000100:00100000:3.0:1763334988.512727:0:29653:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179871335 gen 2 00000004:00080000:3.0:1763334988.512746:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee4d0a80, transno 17179871324 00000004:00080000:3.0:1763334988.512774:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee4d1180, transno 17179871325 00000004:00080000:3.0:1763334988.512778:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee4d0700, transno 17179871326 00000004:00080000:3.0:1763334988.512781:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee4d0000, transno 17179871327 00000004:00080000:3.0:1763334988.512785:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee4d3480, transno 17179871328 00000004:00080000:3.0:1763334988.512787:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5aee4d1c00, transno 17179871329 00000004:00080000:3.0:1763334988.512791:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e4d500, transno 17179871330 00000004:00080000:3.0:1763334988.512793:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e4c700, transno 17179871331 00000004:00080000:3.0:1763334988.512796:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e4fb80, transno 17179871332 00000004:00080000:3.0:1763334988.512799:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e4d880, transno 17179871333 00000004:00080000:3.0:1763334988.512802:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e4ea00, transno 17179871334 00000004:00080000:3.0:1763334988.512805:0:29653:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac7e4f480, transno 17179871335 00000100:00100000:3.0:1763334988.512817:0:29653:0:(client.c:3125:ptlrpc_free_committed()) @@@ stopping search req@ffff9a5afa7eea00 x1848989701915904/t17179871348(17179871348) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1763335004 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1763334988.512842:0:29653:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7eea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:29653:1848989701915904:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1763334988.512872:0:29653:0:(osp_precreate.c:701:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x252:0x0]-[0x280000400:0x281:0x0] 00000004:00080000:1.0:1763334988.513465:0:29652:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 12 done 00000100:00100000:1.0:1763334988.514028:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334988.514115:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694694400 00000100:00100000:3.0:1763334988.514125:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694694400 00000100:00100000:3.0:1763334988.514198:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5121 00000100:00100000:3.0:1763334988.514210:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53676:x1848989694694400:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334988.514235:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334988.514263:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d631 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0974 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.514397:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d638 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334988.514415:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d638 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334988.514429:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d638 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334988.514445:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 2104 00010000:00010000:3.0:1763334988.514640:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d631 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0974 expref: 204 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.514666:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d638 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0974 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.514678:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:3.0:1763334988.514683:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763334988.514688:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8000, rc 0) 00000100:00100000:3.0:1763334988.514777:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53676:x1848989694694400:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 567us (752us total) trans 8589939330 rc 0/0 00000100:00100000:3.0:1763334988.514786:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5121 00000100:00100000:2.0:1763334988.520258:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.520310:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.520342:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.520397:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694694656 00000100:00100000:1.0:1763334988.520415:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694694656 00000100:00100000:0.0:1763334988.520464:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694694528 00000100:00100000:0.0:1763334988.520476:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694694528 00000100:00100000:1.0:1763334988.520504:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694694784 00000100:00100000:1.0:1763334988.520511:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694694784 00000100:00100000:0.0:1763334988.520535:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5289 00000100:00100000:0.0:1763334988.520557:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694694656:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:0.0:1763334988.520672:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334988.520696:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5290 00010000:00010000:0.0:1763334988.520702:0:25383:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d3bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a2 expref: 24 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.520715:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1763334988.520719:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694694528:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:0.0:1763334988.520721:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334988.520729:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.520777:0:26564:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.520784:0:25383:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d3bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a2 expref: 24 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.520816:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d56d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0920 expref: 25 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.520825:0:25383:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d3bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a2 expref: 24 pid: 26564 timeout: 1153 lvb_type: 0 00010000:00010000:1.0:1763334988.520832:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334988.520837:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334988.520841:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334988.520861:0:25383:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa744000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701916032:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334988.520899:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d56d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0920 expref: 25 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.520915:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d56d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0920 expref: 25 pid: 25383 timeout: 1153 lvb_type: 0 00000100:00100000:1.0:1763334988.520934:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701916160:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334988.520983:0:25383:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c4155000 going to sleep for 11 seconds 00000100:00100000:1.0:1763334988.521011:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1763334988.521047:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5291 00000100:00100000:1.0:1763334988.521060:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694694784:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1763334988.521086:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.521099:0:6518:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849d3c2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a9 expref: 25 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.521107:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334988.521109:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1763334988.521112:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.521133:0:6518:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849d3c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a9 expref: 25 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.521144:0:6518:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849d3c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a9 expref: 25 pid: 26564 timeout: 1153 lvb_type: 0 00000100:00100000:1.0:1763334988.521154:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701916288:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334988.521178:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334988.527558:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701916160:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334988.527648:0:26564:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334988.527669:0:25383:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa744000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:25383:1848989701916032:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334988.527700:0:25383:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334988.527826:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6518:1848989701916288:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334988.527857:0:6518:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334988.530472:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.530515:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.530549:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.530642:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694694912 00000100:00100000:2.0:1763334988.530654:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694694912 00010000:00010000:2.0:1763334988.530697:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d3bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a2 expref: 25 pid: 26564 timeout: 1153 lvb_type: 0 00000100:00100000:1.0:1763334988.530743:0:5735:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694695168 00000100:00100000:2.0:1763334988.530747:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694695040 00000100:00100000:2.0:1763334988.530761:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694695040 00000100:00100000:1.0:1763334988.530762:0:5735:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694695168 00010000:00010000:2.0:1763334988.530789:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d56d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0920 expref: 27 pid: 25383 timeout: 1153 lvb_type: 0 00010000:00010000:1.0:1763334988.530815:0:5735:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849d3c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a9 expref: 27 pid: 26564 timeout: 1153 lvb_type: 0 00000100:00100000:2.0:1763334988.530825:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2743 00000100:00100000:2.0:1763334988.530854:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2361:x1848989694694912:12345-192.168.201.60@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1763334988.530869:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2744 00010000:00010000:2.0:1763334988.530879:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1763334988.530886:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2361:x1848989694695040:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334988.530906:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334988.530914:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d3bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a2 expref: 25 pid: 26564 timeout: 1153 lvb_type: 0 00010000:00010000:2.0:1763334988.530937:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d3bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a2 expref: 25 pid: 26564 timeout: 1153 lvb_type: 0 00010000:00010000:1.0:1763334988.530960:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d56d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0920 expref: 27 pid: 25383 timeout: 1153 lvb_type: 0 00010000:00010000:2.0:1763334988.530970:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d3bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a2 expref: 25 pid: 26564 timeout: 1153 lvb_type: 0 00010000:00010000:1.0:1763334988.530989:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d56d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0920 expref: 27 pid: 25383 timeout: 1153 lvb_type: 0 00010000:00010000:2.0:1763334988.530998:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334988.531002:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334988.531009:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.531021:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d56d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0920 expref: 27 pid: 25383 timeout: 1153 lvb_type: 0 00010000:00010000:2.0:1763334988.531023:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.531065:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.531068:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.531074:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.531086:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1763334988.531087:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.531126:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334988.531180:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694694912:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 337us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.531187:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2361:x1848989694695040:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 305us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334988.531203:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2743 00000100:00100000:1.0:1763334988.531330:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2744 00000100:00100000:1.0:1763334988.531354:0:5735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2745 00000100:00100000:1.0:1763334988.531363:0:5735:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2361:x1848989694695168:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334988.531374:0:5735:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334988.531387:0:5735:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849d3c2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a9 expref: 25 pid: 26564 timeout: 1153 lvb_type: 0 00010000:00010000:1.0:1763334988.531399:0:5735:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849d3c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a9 expref: 25 pid: 26564 timeout: 1153 lvb_type: 0 00010000:00010000:1.0:1763334988.531413:0:5735:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430400/0xcedf0054f849d3c2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b08a9 expref: 25 pid: 26564 timeout: 1153 lvb_type: 0 00010000:00010000:1.0:1763334988.531423:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.531425:0:5735:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.531429:0:5735:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.531437:0:5735:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.531458:0:5735:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334988.531478:0:5735:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2361:x1848989694695168:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 117us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.531485:0:5735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2745 00010000:00010000:2.0:1763334988.531945:0:6518:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.531959:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.531997:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532008:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532017:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532027:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478a00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334988.532038:0:25383:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532039:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.532090:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532095:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.532141:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532145:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.532164:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532220:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d654 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.532227:0:25383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.532241:0:25383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334988.532246:0:25383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.532256:0:25383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.532272:0:25383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.532280:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d646 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334988.532328:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694694784:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 11268us (11979us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334988.532344:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5291 00000100:00100000:3.0:1763334988.532368:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2360:x1848989694694656:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 11818us (12122us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334988.532380:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5289 00010000:00010000:2.0:1763334988.532395:0:26564:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532408:0:26564:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532430:0:26564:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532438:0:26564:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532448:0:26564:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532456:0:26564:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334988.532461:0:26564:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532470:0:26564:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532489:0:26564:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.532499:0:26564:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d64d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334988.532611:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+22:2360:x1848989694694528:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 11898us (12297us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334988.532620:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5290 00000100:00100000:1.0:1763334988.542459:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.542507:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.542552:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.542613:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694695424 00000100:00100000:2.0:1763334988.542631:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694695424 00000100:00100000:3.0:1763334988.542685:0:25383:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694695296 00000100:00100000:3.0:1763334988.542696:0:25383:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694695296 00000100:00100000:2.0:1763334988.542791:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694695552 00000100:00100000:2.0:1763334988.542798:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694695552 00000100:00100000:3.0:1763334988.542808:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5292 00000100:00100000:3.0:1763334988.542827:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694695424:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334988.542866:0:25383:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1763334988.542866:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5293 00000100:00100000:2.0:1763334988.542886:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694695296:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334988.542908:0:25383:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d65b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0982 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.542910:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334988.542942:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d662 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b097b expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334988.542957:0:25383:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x248:0x0] initial LVB size: 0, mtime: 0x691a5b4d, atime: 0x691a5b49, ctime: 0x691a5b4d, blocks: 0x3 00002000:00010000:2.0:1763334988.542977:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 2104, mtime: 0x691a5b4d, atime: 0x691a5b49, ctime: 0x691a5b4d, blocks: 0xbb 00010000:00010000:3.0:1763334988.542991:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334988.542995:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334988.543004:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334988.543012:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d65b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0982 expref: 24 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334988.543022:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334988.543038:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d662 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b097b expref: 24 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334988.543041:0:25383:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d65b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0982 expref: 24 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334988.543084:0:25383:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9e00, rc 0) 00010000:00010000:2.0:1763334988.543088:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d662 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b097b expref: 24 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334988.543108:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430200, rc 0) 00000100:00100000:2.0:1763334988.543184:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694695296:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 304us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334988.543190:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5293 00000100:00100000:2.0:1763334988.543213:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5294 00000100:00100000:2.0:1763334988.543220:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+23:2359:x1848989694695552:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334988.543227:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334988.543237:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d669 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0989 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334988.543249:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24c:0x0] initial LVB size: 0, mtime: 0x691a5b4d, atime: 0x691a5b49, ctime: 0x691a5b4d, blocks: 0x3 00010000:00010000:2.0:1763334988.543258:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334988.543260:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334988.543264:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d669 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0989 expref: 24 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334988.543273:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d669 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0989 expref: 24 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334988.543281:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431a00, rc 0) 00000100:00100000:2.0:1763334988.543299:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694695552:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 80us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334988.543304:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5294 00000100:00100000:3.0:1763334988.543459:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694695424:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 637us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334988.543472:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5292 00000100:00100000:1.0:1763334988.628620:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.629110:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694695680 00000100:00100000:0.0:1763334988.629153:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694695680 00000100:00100000:0.0:1763334988.629268:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2036 00000100:00100000:0.0:1763334988.629282:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694695680:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334988.629344:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d670 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.629366:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334988.629369:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334988.629377:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d670 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.629393:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d670 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.629685:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d670 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.629697:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d670 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.629706:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d670 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.629715:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334988.629720:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d670 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.629731:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d670 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.629753:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d670 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.629761:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d670 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334988.629868:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694695680:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 587us (1294us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334988.629877:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2036 00000100:00100000:2.0:1763334988.636885:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.637013:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694695808 00000100:00100000:1.0:1763334988.637027:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694695808 00000100:00100000:1.0:1763334988.637115:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2037 00000100:00100000:1.0:1763334988.637128:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694695808:12345-192.168.201.60@tcp:4:lfs.0 00010000:00010000:1.0:1763334988.637268:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.637293:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d623 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0966 expref: 24 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334988.637303:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.637305:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.637310:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.637357:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d623 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0966 expref: 24 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334988.637373:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d623 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0966 expref: 24 pid: 26564 timeout: 1153 lvb_type: 1 00000100:00100000:1.0:1763334988.637390:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14183:1848989701916416:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334988.637551:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac37c16c0 going to sleep for 11 seconds 00000100:00100000:2.0:1763334988.640816:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334988.640914:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694695936 00000100:00100000:3.0:1763334988.640928:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694695936 00000100:00100000:1.0:1763334988.641119:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14183:1848989701916416:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334988.641238:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.641540:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d623 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0966 expref: 25 pid: 26564 timeout: 1153 lvb_type: 1 00000100:00100000:3.0:1763334988.641985:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2746 00000100:00100000:3.0:1763334988.642000:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694695936:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334988.642022:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334988.642052:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d623 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0966 expref: 25 pid: 26564 timeout: 1153 lvb_type: 1 00010000:00010000:3.0:1763334988.642067:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d623 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0966 expref: 25 pid: 26564 timeout: 1153 lvb_type: 1 00010000:00010000:3.0:1763334988.642098:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479c00/0xcedf0054f849d623 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0966 expref: 25 pid: 26564 timeout: 1153 lvb_type: 1 00010000:00010000:3.0:1763334988.642118:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334988.642121:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334988.642126:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.642136:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.642918:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334988.643007:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d38450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694695936:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1005us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334988.643020:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2746 00010000:00010000:1.0:1763334988.643814:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.643831:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.646684:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1763334988.704096:0:14183:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24e:0x0] updating lvb size from disk: 0 -> 4096 00002000:00010000:0.0:1763334988.704109:0:14183:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24e:0x0] updating lvb mtime from disk: 0 -> 1763334989 00002000:00010000:0.0:1763334988.704112:0:14183:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24e:0x0] updating lvb ctime from disk: 0 -> 1763334989 00002000:00010000:0.0:1763334988.704114:0:14183:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24e:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1763334988.704227:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.704243:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.704253:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.704260:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5478e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334988.704265:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.704274:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.704297:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.704304:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5478e00/0xcedf0054f849d677 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334988.704835:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694695808:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 67700us (67956us total) trans 21474838571 rc 0/0 00000100:00100000:0.0:1763334988.704857:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2037 00000001:00080000:0.0:1763334988.704914:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838568 is committed 00000001:00080000:0.0:1763334988.706315:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838559 is committed 00000001:00080000:0.0:1763334988.706352:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838571 is committed 00000001:00080000:0.0:1763334988.706362:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838560 is committed 00000001:00080000:0.0:1763334988.706394:0:22399:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474838566 is committed 00000100:00100000:2.0:1763334988.713800:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.714492:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694696064 00000100:00100000:0.0:1763334988.714512:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694696064 00000100:00100000:0.0:1763334988.714685:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5122 00000100:00100000:0.0:1763334988.714699:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53676:x1848989694696064:12345-192.168.201.60@tcp:44:lfs.0 00000001:00080000:3.0:1763334988.764537:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939328 is committed 00000001:00080000:3.0:1763334988.764602:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939329 is committed 00000001:00080000:3.0:1763334988.764646:0:29660:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589939330 is committed 00000100:00100000:0.0:1763334988.765026:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53676:x1848989694696064:12345-192.168.201.60@tcp:44:lfs.0 Request processed in 50319us (51233us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.765042:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5122 00000100:00100000:3.0:1763334988.770190:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334988.770276:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.770567:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694696320 00000100:00100000:0.0:1763334988.770639:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694696320 00000100:00100000:1.0:1763334988.770973:0:6517:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694696192 00000100:00100000:1.0:1763334988.770980:0:6517:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694696192 00000100:00100000:1.0:1763334988.771051:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5295 00000100:00100000:1.0:1763334988.771063:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694696192:12345-192.168.201.60@tcp:16:lfs.0 00000100:00100000:1.0:1763334988.771215:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2359:x1848989694696192:12345-192.168.201.60@tcp:16:lfs.0 Request processed in 153us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.771224:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5295 00000100:00100000:0.0:1763334988.771318:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5296 00000100:00100000:0.0:1763334988.771327:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694696320:12345-192.168.201.60@tcp:16:lfs.0 00000100:00100000:0.0:1763334988.771381:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2359:x1848989694696320:12345-192.168.201.60@tcp:16:lfs.0 Request processed in 56us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.771388:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5296 00000100:00100000:1.0:1763334988.796404:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.796445:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.796473:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.796669:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694696448 00000100:00100000:0.0:1763334988.796688:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694696448 00000100:00100000:0.0:1763334988.796783:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694696704 00000100:00100000:0.0:1763334988.796787:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694696704 00000100:00100000:0.0:1763334988.796811:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694696576 00000100:00100000:0.0:1763334988.796815:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694696576 00000100:00100000:3.0:1763334988.796862:0:25383:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5297 00000100:00100000:0.0:1763334988.796876:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5298 00000100:00100000:3.0:1763334988.796885:0:25383:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2362:x1848989694696448:12345-192.168.201.60@tcp:1:lfs.0 00000100:00100000:0.0:1763334988.796896:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2362:x1848989694696704:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:3.0:1763334988.796967:0:25383:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d685 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.796967:0:6518:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d67e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.797019:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334988.797020:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334988.797029:0:25383:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334988.797029:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334988.797041:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d67e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.797043:0:25383:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d685 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.797087:0:25383:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d685 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.797095:0:6518:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d67e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.797123:0:25383:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d685 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.797130:0:6518:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d67e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.797137:0:25383:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d685 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.797146:0:6518:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d67e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.797153:0:25383:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.797165:0:25383:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334988.797170:0:25383:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d685 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.797178:0:25383:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d685 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.797192:0:25383:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d685 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.797199:0:25383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d685 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25383 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334988.797281:0:25383:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2362:x1848989694696448:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 406us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334988.797290:0:25383:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5297 00000100:00100000:2.0:1763334988.797302:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5299 00000100:00100000:2.0:1763334988.797318:0:6517:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2362:x1848989694696576:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1763334988.797351:0:6517:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d68c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.797362:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334988.797364:0:6517:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334988.797369:0:6517:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d68c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.797380:0:6517:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d68c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.797400:0:6517:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d68c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.797408:0:6517:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d68c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.797416:0:6517:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d68c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.797424:0:6517:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334988.797429:0:6517:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d68c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.797437:0:6517:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d68c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.797452:0:6517:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d68c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.797458:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d68c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334988.797523:0:6517:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+14:2362:x1848989694696576:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 210us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334988.797531:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5299 00010000:00010000:0.0:1763334988.798320:0:6518:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d67e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.798334:0:6518:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6792400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334988.798337:0:6518:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d67e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.798346:0:6518:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d67e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.798359:0:6518:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d67e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.798368:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d67e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334988.798420:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2362:x1848989694696704:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 1532us (1972us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.798562:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5298 00000100:00100000:2.0:1763334988.805741:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.805816:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694696960 00000100:00100000:0.0:1763334988.805852:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694696960 00000100:00100000:0.0:1763334988.805947:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5123 00000100:00100000:0.0:1763334988.805960:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53676:x1848989694696960:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334988.806039:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334988.806076:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431000/0xcedf0054f849d61c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1b5:0x0].0x0 bits 0x1a/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b095f expref: 191 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.806102:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b5:0x0].0x0 (ffff9a5ac6cab000) 00010000:00010000:0.0:1763334988.806118:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334988.806179:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d693 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.806196:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d693 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.806209:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d693 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00010000:0.0:1763334988.806477:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 000000006f6d9bd4 reply state 00000000b703cd51 transno 8589939331 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d693 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:0.0:1763334988.806488:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1763334988.806703:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53676:x1848989694696960:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 743us (1132us total) trans 8589939331 rc 0/0 00000100:00100000:0.0:1763334988.806714:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5123 00010000:00010000:3.0:1763334988.813410:0:3275:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d693 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334988.813427:0:3275:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d693 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334988.813436:0:3275:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d693 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334988.813442:0:3275:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334988.813446:0:3275:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d693 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334988.813452:0:3275:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d693 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334988.813469:0:3275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b5:0x0].0x0 (ffff9a5ac7d60c00) 00010000:00010000:3.0:1763334988.813472:0:3275:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334988.813477:0:3275:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d693 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334988.813496:0:3275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d693 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:0.0:1763334988.813497:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.814206:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694697088 00000100:00100000:2.0:1763334988.814221:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694697088 00000100:00100000:2.0:1763334988.814285:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5124 00000100:00100000:2.0:1763334988.814295:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+191:53676:x1848989694697088:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334988.814320:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334988.814341:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d69a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0990 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.814399:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d69a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0990 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.814413:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d69a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0990 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334988.814431:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b5:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334988.814434:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1763334988.814438:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334988.814507:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa744000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53676:x1848989694697088:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 214us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334988.814515:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5124 00000100:00100000:1.0:1763334988.823662:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.823830:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694697216 00000100:00100000:0.0:1763334988.823861:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694697216 00000100:00100000:0.0:1763334988.823964:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5300 00000100:00100000:0.0:1763334988.823979:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+14:53676:x1848989694697216:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334988.824008:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334988.824054:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d6a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0997 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1763334988.824094:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24e:0x0] initial LVB size: 4096, mtime: 0x691a5b4d, atime: 0x0, ctime: 0x691a5b4d, blocks: 0xb 00010000:00010000:0.0:1763334988.824130:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334988.824133:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334988.824145:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d6a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0997 expref: 15 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.824167:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d6a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0997 expref: 15 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.824184:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334988.824288:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+15:53676:x1848989694697216:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 310us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.824298:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5300 00000100:00100000:1.0:1763334988.829688:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.829789:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694697344 00000100:00100000:0.0:1763334988.829799:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694697344 00000100:00100000:0.0:1763334988.829891:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5301 00000100:00100000:0.0:1763334988.829901:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+24:53676:x1848989694697344:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1763334988.829921:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334988.829943:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d6a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b099e expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.829980:0:26564:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d62a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b096d expref: 25 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334988.829988:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334988.829991:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334988.829995:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d6a8 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b099e expref: 25 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.830029:0:26564:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d62a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b096d expref: 25 pid: 6519 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334988.830042:0:26564:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d62a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b096d expref: 25 pid: 6519 timeout: 1153 lvb_type: 1 00000100:00100000:0.0:1763334988.830056:0:26564:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701916544:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334988.832094:0:26564:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac55313c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334988.838929:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.839298:0:26564:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e16680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:26564:1848989701916544:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334988.839345:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d6a8 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b099e expref: 25 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.839373:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792a00, rc 0) 00000100:00100000:0.0:1763334988.839460:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+25:53676:x1848989694697344:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 9558us (9781us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.839471:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5301 00000100:00100000:1.0:1763334988.839866:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694697472 00000100:00100000:1.0:1763334988.839878:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694697472 00010000:00010000:1.0:1763334988.839928:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d62a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b096d expref: 25 pid: 6519 timeout: 1153 lvb_type: 1 00000100:00100000:1.0:1763334988.839968:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2747 00000100:00100000:1.0:1763334988.839982:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694697472:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334988.840006:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334988.840037:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d62a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x252:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b096d expref: 25 pid: 6519 timeout: 1153 lvb_type: 1 00010000:00010000:1.0:1763334988.840056:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d62a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x252:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b096d expref: 25 pid: 6519 timeout: 1153 lvb_type: 1 00010000:00010000:1.0:1763334988.840094:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d62a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x252:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b096d expref: 25 pid: 6519 timeout: 1153 lvb_type: 1 00010000:00010000:1.0:1763334988.840113:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.840115:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.840124:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d6a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b099e expref: 24 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.840157:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d6a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b099e expref: 24 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.840209:0:5734:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792a00/0xcedf0054f849d6a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b099e expref: 24 pid: 26564 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334988.840226:0:5734:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa44d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701916672:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334988.840305:0:5734:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0adc00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334988.845785:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.845884:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334988.846011:0:5734:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa44d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701916672:192.168.201.60@tcp:105: 00000100:00100000:2.0:1763334988.846025:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694697600 00000100:00100000:2.0:1763334988.846042:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694697600 00010000:00010000:3.0:1763334988.846054:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334988.846120:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694697728 00000100:00100000:2.0:1763334988.846126:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694697728 00000100:00100000:3.0:1763334988.846150:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694697472:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 6154us (7220us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334988.846167:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5302 00000100:00100000:3.0:1763334988.846169:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2747 00000100:00100000:2.0:1763334988.846185:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+15:2360:x1848989694697600:12345-192.168.201.60@tcp:2:lfs.0 00000100:00100000:3.0:1763334988.846329:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5303 00000100:00100000:3.0:1763334988.846343:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+24:2360:x1848989694697728:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334988.846524:0:6518:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x24e:0x0] updating lvb size from disk: 4096 -> 4096 00002000:00010000:2.0:1763334988.846530:0:6518:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x24e:0x0] updating lvb mtime from disk: 1763334989 -> 1763334989 00002000:00010000:2.0:1763334988.846533:0:6518:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x24e:0x0] updating lvb atime from disk: 0 -> 1763334985 00002000:00010000:2.0:1763334988.846536:0:6518:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x24e:0x0] updating lvb ctime from disk: 1763334989 -> 1763334989 00002000:00010000:2.0:1763334988.846538:0:6518:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x24e:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1763334988.846665:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee545180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694697600:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 482us (892us total) trans 21474838572 rc 0/0 00000100:00100000:2.0:1763334988.846675:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5302 00002000:00010000:3.0:1763334988.846683:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x252:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1763334988.846688:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x252:0x0] updating lvb mtime from disk: 0 -> 1763334989 00002000:00010000:3.0:1763334988.846693:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x252:0x0] updating lvb atime from disk: 0 -> 1763334985 00002000:00010000:3.0:1763334988.846696:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x252:0x0] updating lvb ctime from disk: 0 -> 1763334989 00002000:00010000:3.0:1763334988.846700:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x252:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1763334988.846738:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee544380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694697728:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 398us (852us total) trans 17179871349 rc 0/0 00000100:00100000:3.0:1763334988.846749:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5303 00000100:00100000:1.0:1763334988.850640:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.857989:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694697984 00000100:00100000:2.0:1763334988.858005:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694697984 00000100:00100000:2.0:1763334988.858092:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5125 00000100:00100000:2.0:1763334988.858104:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53676:x1848989694697984:12345-192.168.201.60@tcp:55:lfs.0 00010000:00010000:2.0:1763334988.858174:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d6af lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334988.858190:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d6af lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334988.858205:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d6af lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334988.858230:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d6af lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334988.858236:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d6af lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334988.858242:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d6af lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334988.858248:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:2.0:1763334988.858252:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d6af lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334988.858259:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d6af lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334988.858270:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b5:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:2.0:1763334988.858274:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1763334988.858280:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d6af lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:2.0:1763334988.858285:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d6af lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00000100:00100000:2.0:1763334988.858381:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee544000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53676:x1848989694697984:12345-192.168.201.60@tcp:55:lfs.0 Request processed in 279us (7756us total) trans 0 rc -22/-22 00000100:00100000:2.0:1763334988.858389:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5125 00000100:00100000:2.0:1763334988.865691:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.865792:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694698240 00000100:00100000:0.0:1763334988.865814:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694698240 00000100:00100000:0.0:1763334988.866219:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5126 00000100:00100000:0.0:1763334988.866230:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53676:x1848989694698240:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1763334988.866285:0:29628:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334988.866312:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479600/0xcedf0054f849d5c1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0943 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334988.866330:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334988.866335:0:29628:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1763334988.866545:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d6b6 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.866560:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d6b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.867186:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d6b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00010000:1.0:1763334988.870551:0:29628:0:(mdt_handler.c:4460:mdt_save_lock()) ### save lock request 00000000bdc4e7bc reply state 0000000077eb922c transno 8589939332 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d6b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334988.870586:0:29628:0:(service.c:177:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1763334988.870729:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53676:x1848989694698240:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 4496us (5043us total) trans 8589939332 rc 0/0 00000100:00100000:1.0:1763334988.870739:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5126 00010000:00010000:0.0:1763334988.875299:0:3276:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d6b6 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.875317:0:3276:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d6b6 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.875325:0:3276:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d6b6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.875331:0:3276:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793a00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:0.0:1763334988.875336:0:3276:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d6b6 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.875344:0:3276:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d6b6 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.875362:0:3276:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:0.0:1763334988.875365:0:3276:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1763334988.875370:0:3276:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d6b6 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00010000:00010000:0.0:1763334988.875375:0:3276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793a00/0xcedf0054f849d6b6 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 29628 initiator: MDT0 00000100:00100000:3.0:1763334988.875632:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.875915:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694698368 00000100:00100000:1.0:1763334988.875925:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694698368 00000100:00100000:1.0:1763334988.876075:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5304 00000100:00100000:1.0:1763334988.876087:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:53676:x1848989694698368:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334988.876105:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334988.876122:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d6bd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b09a5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.876148:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d662 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b097b expref: 26 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334988.876157:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.876159:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.876164:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d6bd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09a5 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.876199:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d662 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b097b expref: 26 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334988.876213:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d662 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b097b expref: 26 pid: 26564 timeout: 1153 lvb_type: 1 00000100:00100000:1.0:1763334988.876232:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701916800:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334988.879160:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0adf00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334988.884411:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701916800:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334988.884455:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d6bd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09a5 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.884476:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478400, rc 0) 00000100:00100000:1.0:1763334988.884538:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+26:53676:x1848989694698368:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 8453us (8911us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.884548:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5304 00000100:00100000:3.0:1763334988.885124:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.886946:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694698496 00000100:00100000:1.0:1763334988.886963:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694698496 00010000:00010000:1.0:1763334988.887012:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d662 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b097b expref: 26 pid: 26564 timeout: 1153 lvb_type: 1 00000100:00100000:1.0:1763334988.887061:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2748 00000100:00100000:1.0:1763334988.887073:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694698496:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334988.887089:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334988.887118:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d662 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b097b expref: 26 pid: 26564 timeout: 1153 lvb_type: 1 00010000:00010000:1.0:1763334988.887248:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d662 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b097b expref: 26 pid: 26564 timeout: 1153 lvb_type: 1 00010000:00010000:1.0:1763334988.887280:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5430200/0xcedf0054f849d662 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b097b expref: 26 pid: 26564 timeout: 1153 lvb_type: 1 00010000:00010000:1.0:1763334988.887295:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.887297:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.887304:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d6bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09a5 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.887315:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d6bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09a5 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.887355:0:5734:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d6bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09a5 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334988.887381:0:5734:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701916928:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334988.887464:0:5734:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0adf00 going to sleep for 11 seconds 00000100:00100000:2.0:1763334988.894537:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334988.894640:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694698624 00000100:00100000:3.0:1763334988.894651:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694698624 00000100:00100000:3.0:1763334988.894717:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5305 00000100:00100000:3.0:1763334988.894727:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+16:53676:x1848989694698624:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334988.894747:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334988.894766:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d6c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b09ac expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.894805:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d65b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0982 expref: 17 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334988.894821:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334988.894823:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334988.894829:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d6c4 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [1048576->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09ac expref: 17 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.894872:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d65b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0982 expref: 17 pid: 25383 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334988.894885:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d65b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0982 expref: 17 pid: 25383 timeout: 1153 lvb_type: 1 00000100:00100000:3.0:1763334988.894899:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701917056:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334988.894980:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b000 going to sleep for 11 seconds 00000100:00100000:1.0:1763334988.895377:0:5734:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701916928:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334988.895397:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334988.895427:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694698496:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 8357us (10304us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.895436:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2748 00000100:00100000:2.0:1763334988.904849:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.904961:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694698752 00000100:00100000:1.0:1763334988.904973:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694698752 00010000:00010000:1.0:1763334988.905022:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d65b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0982 expref: 18 pid: 25383 timeout: 1153 lvb_type: 1 00000100:00100000:1.0:1763334988.905073:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2749 00000100:00100000:1.0:1763334988.905084:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694698752:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334988.905101:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334988.905124:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d65b lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0982 expref: 18 pid: 25383 timeout: 1153 lvb_type: 1 00010000:00010000:1.0:1763334988.905138:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d65b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0982 expref: 18 pid: 25383 timeout: 1153 lvb_type: 1 00010000:00010000:1.0:1763334988.905165:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.905167:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.905175:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d6c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09ac expref: 18 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.905186:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d6c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09ac expref: 18 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.905225:0:5734:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d6c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09ac expref: 18 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334988.905239:0:5734:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5734:1848989701917184:192.168.201.60@tcp:105: 00010000:00010000:3.0:1763334988.905611:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d65b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x248:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0982 expref: 18 pid: 25383 timeout: 1153 lvb_type: 1 00000100:00100000:3.0:1763334988.905629:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6519:1848989701917056:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334988.905658:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf9800/0xcedf0054f849d6c4 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x248:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09ac expref: 17 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.905668:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9800, rc 0) 00000100:00100000:1.0:1763334988.905785:0:5734:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0adf00 going to sleep for 11 seconds 00000100:00100000:3.0:1763334988.906027:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+17:53676:x1848989694698624:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 11300us (11496us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334988.906037:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5305 00000100:00100000:2.0:1763334988.909040:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334988.909122:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694698880 00000100:00100000:3.0:1763334988.909132:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694698880 00000100:00100000:3.0:1763334988.909188:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5306 00000100:00100000:3.0:1763334988.909198:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:53676:x1848989694698880:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334988.909221:0:6519:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334988.909244:0:6519:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d6cb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b09b3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.909282:0:6519:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d669 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0989 expref: 26 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334988.909290:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334988.909293:0:6519:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334988.909299:0:6519:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d6cb lrc: 4/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09b3 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.909335:0:6519:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d669 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0989 expref: 26 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334988.909351:0:6519:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d669 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0989 expref: 26 pid: 26564 timeout: 1153 lvb_type: 1 00000100:00100000:3.0:1763334988.909382:0:6519:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5afa7ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701917312:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334988.909472:0:6519:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b000 going to sleep for 11 seconds 00000100:00100000:1.0:1763334988.909712:0:5734:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5734:1848989701917184:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334988.909733:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334988.909773:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694698752:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4690us (4944us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.909783:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2749 00000100:00100000:3.0:1763334988.917684:0:6519:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5afa7ef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6519:1848989701917312:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334988.917726:0:6519:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d6cb lrc: 3/0,0 mode: --/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09b3 expref: 26 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.917750:0:6519:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8200, rc 0) 00000100:00100000:3.0:1763334988.917808:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+26:53676:x1848989694698880:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 8610us (8780us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334988.917816:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5306 00000100:00100000:3.0:1763334988.924076:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.924196:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694699008 00000100:00100000:1.0:1763334988.924207:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694699008 00010000:00010000:1.0:1763334988.924255:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d669 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0989 expref: 26 pid: 26564 timeout: 1153 lvb_type: 1 00000100:00100000:1.0:1763334988.924303:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2750 00000100:00100000:1.0:1763334988.924313:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2359:x1848989694699008:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334988.924331:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334988.924355:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d669 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0989 expref: 26 pid: 26564 timeout: 1153 lvb_type: 1 00010000:00010000:1.0:1763334988.924382:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d669 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0989 expref: 26 pid: 26564 timeout: 1153 lvb_type: 1 00010000:00010000:1.0:1763334988.924412:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431a00/0xcedf0054f849d669 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0989 expref: 26 pid: 26564 timeout: 1153 lvb_type: 1 00010000:00010000:1.0:1763334988.924431:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.924433:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334988.924439:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d6cb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09b3 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.924450:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d6cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09b3 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.924496:0:5734:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff9a59cbbf8200/0xcedf0054f849d6cb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09b3 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334988.924511:0:5734:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701917440:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334988.925409:0:5734:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0adf00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334988.930954:0:5734:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5734:1848989701917440:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334988.930985:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334988.931052:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2359:x1848989694699008:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 6738us (6989us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334988.931068:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2750 00000100:00100000:3.0:1763334988.935168:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334988.935223:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.935390:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694699136 00000100:00100000:2.0:1763334988.935401:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694699136 00000100:00100000:3.0:1763334988.935758:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334988.936438:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694699392 00000100:00100000:2.0:1763334988.936449:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694699392 00000100:00100000:0.0:1763334988.936460:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694699264 00000100:00100000:0.0:1763334988.936465:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694699264 00000100:00100000:1.0:1763334988.936477:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5307 00000100:00100000:1.0:1763334988.936497:0:6519:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+25:2360:x1848989694699136:12345-192.168.201.60@tcp:2:lfs.0 00000100:00100000:0.0:1763334988.936506:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5308 00000100:00100000:0.0:1763334988.936517:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+16:2360:x1848989694699264:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:1.0:1763334988.936791:0:6519:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb size from disk: 2104 -> 2104 00002000:00010000:0.0:1763334988.936792:0:26216:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1763334988.936799:0:6519:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb mtime from disk: 1763334989 -> 1763334989 00002000:00010000:0.0:1763334988.936799:0:26216:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb mtime from disk: 1763334989 -> 1763334989 00002000:00010000:1.0:1763334988.936806:0:6519:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:0.0:1763334988.936806:0:26216:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:1.0:1763334988.936812:0:6519:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb ctime from disk: 1763334989 -> 1763334989 00002000:00010000:0.0:1763334988.936813:0:26216:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb ctime from disk: 1763334989 -> 1763334989 00002000:00010000:1.0:1763334988.936820:0:6519:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24a:0x0] updating lvb blocks from disk: 187 -> 187 00002000:00010000:0.0:1763334988.936820:0:26216:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x240000400:0x248:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:1.0:1763334988.936902:0:6519:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694699136:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 413us (1742us total) trans 17179871350 rc 0/0 00000100:00100000:0.0:1763334988.936902:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa44d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2360:x1848989694699264:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 385us (1142us total) trans 21474838573 rc 0/0 00000100:00100000:0.0:1763334988.936918:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5308 00000100:00100000:1.0:1763334988.936925:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5307 00000100:00100000:2.0:1763334988.938445:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5309 00000100:00100000:2.0:1763334988.938454:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afa7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+26:2360:x1848989694699392:12345-192.168.201.60@tcp:2:lfs.0 00002000:00010000:2.0:1763334988.938660:0:26564:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1763334988.938664:0:26564:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb mtime from disk: 1763334989 -> 1763334989 00002000:00010000:2.0:1763334988.938667:0:26564:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb atime from disk: 1763334985 -> 1763334985 00002000:00010000:2.0:1763334988.938670:0:26564:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb ctime from disk: 1763334989 -> 1763334989 00002000:00010000:2.0:1763334988.938672:0:26564:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000400:0x24c:0x0] updating lvb blocks from disk: 3 -> 3 00000100:00100000:2.0:1763334988.938742:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afa7edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2360:x1848989694699392:12345-192.168.201.60@tcp:2:lfs.0 Request processed in 287us (3516us total) trans 17179871351 rc 0/0 00000100:00100000:2.0:1763334988.938750:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5309 00000100:00100000:3.0:1763334988.941677:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.943624:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694699648 00000100:00100000:1.0:1763334988.943641:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694699648 00000100:00100000:1.0:1763334988.943727:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1856 00000100:00100000:1.0:1763334988.943737:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5b01f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53676:x1848989694699648:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:1.0:1763334988.943817:0:29630:0:(mdt_open.c:2302:mdt_close_handle_layouts()) ### [0x200000404:0x1ab:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d638 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0974 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.943870:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.943885:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d589 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b092e expref: 192 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.943896:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.943933:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d589 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b092e expref: 192 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334988.943947:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d589 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b092e expref: 192 pid: 29628 timeout: 1153 lvb_type: 0 00000100:00100000:1.0:1763334988.943962:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701917568:192.168.201.60@tcp:104: 00000100:00100000:1.0:1763334988.944061:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0adf00 going to sleep for 11 seconds 00000100:00100000:1.0:1763334988.952547:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701917568:192.168.201.60@tcp:104: 00010000:00010000:1.0:1763334988.952622:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:3.0:1763334988.952892:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334988.953200:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694699776 00000100:00100000:1.0:1763334988.953211:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694699776 00010000:00010000:1.0:1763334988.953252:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d589 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b092e expref: 193 pid: 29628 timeout: 1153 lvb_type: 0 00000100:00100000:1.0:1763334988.953302:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2751 00000100:00100000:1.0:1763334988.953312:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59cd075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:2360:x1848989694699776:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334988.953328:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334988.953335:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d589 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b092e expref: 193 pid: 29628 timeout: 1153 lvb_type: 0 00010000:00010000:1.0:1763334988.953346:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d589 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b092e expref: 193 pid: 29628 timeout: 1153 lvb_type: 0 00010000:00010000:1.0:1763334988.953380:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5af6793200/0xcedf0054f849d589 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b092e expref: 193 pid: 29628 timeout: 1153 lvb_type: 0 00010000:00010000:1.0:1763334988.953397:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:1.0:1763334988.953402:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.953412:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.953419:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.953449:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1763334988.953480:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334988.953490:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:1.0:1763334988.953510:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59cd075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694699776:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 198us (619us total) trans 0 rc 0/0 00010000:00010000:3.0:1763334988.953512:0:29630:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 29630 initiator: MDT0 00000100:00100000:1.0:1763334988.953524:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2751 00010000:00010000:3.0:1763334988.953530:0:29630:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d69a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0990 expref: 192 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.953539:0:29630:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334988.953597:0:29630:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d69a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0990 expref: 191 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334988.953610:0:29630:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d69a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0990 expref: 191 pid: 30972 timeout: 1153 lvb_type: 0 00000100:00100000:3.0:1763334988.953624:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59cd074700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701917696:192.168.201.60@tcp:104: 00000100:00100000:3.0:1763334988.953671:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aee44b000 going to sleep for 11 seconds 00000100:00100000:3.0:1763334988.958261:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59cd074700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:29630:1848989701917696:192.168.201.60@tcp:104: 00010000:00010000:3.0:1763334988.959690:0:29630:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:3.0:1763334988.971434:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334988.971505:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694699904 00000100:00100000:0.0:1763334988.971516:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694699904 00010000:00010000:0.0:1763334988.971555:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d69a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0990 expref: 192 pid: 30972 timeout: 1153 lvb_type: 0 00000100:00100000:0.0:1763334988.971621:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2752 00000100:00100000:0.0:1763334988.971630:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59cd074700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+192:2360:x1848989694699904:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334988.971650:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334988.971657:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d69a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0990 expref: 192 pid: 30972 timeout: 1153 lvb_type: 0 00010000:00010000:0.0:1763334988.971670:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d69a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0990 expref: 192 pid: 30972 timeout: 1153 lvb_type: 0 00010000:00010000:0.0:1763334988.971691:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431400/0xcedf0054f849d69a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1b5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0990 expref: 192 pid: 30972 timeout: 1153 lvb_type: 0 00010000:00010000:0.0:1763334988.971708:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b5:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:0.0:1763334988.971714:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334988.971724:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334988.971731:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 29630 initiator: MDT0 00010000:00010000:0.0:1763334988.971753:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334988.971949:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59cd074700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+191:2360:x1848989694699904:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 318us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.971957:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2752 00010000:00010000:3.0:1763334988.975279:0:29630:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00010000:00010000:3.0:1763334988.975296:0:29630:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 29630 initiator: MDT0 00000100:00100000:2.0:1763334988.975898:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701917824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334988.975965:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1763334988.976006:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98b40 going to sleep for 11 seconds 00000100:00100000:0.0:1763334988.976065:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701917824 00000100:00100000:0.0:1763334988.976073:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701917824 00000100:00100000:0.0:1763334988.976124:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1763334988.976133:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701917824:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1763334988.976897:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701917824:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 762us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.976908:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1763334988.977014:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701917824:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.977074:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701917952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.977113:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.977689:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334988.978507:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701917952 00000100:00100000:0.0:1763334988.978518:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701917952 00000100:00100000:0.0:1763334988.978584:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1763334988.978595:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701917952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1763334988.978720:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701917952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 128us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.978728:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1763334988.978814:0:29630:0:(client.c:3081:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474838566 gen 2 00000004:00080000:1.0:1763334988.978821:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac3796a00, transno 21474838555 00000004:00080000:1.0:1763334988.978848:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac3794380, transno 21474838556 00000004:00080000:1.0:1763334988.978852:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac3795880, transno 21474838557 00000004:00080000:1.0:1763334988.978855:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac3795500, transno 21474838558 00000004:00080000:1.0:1763334988.978857:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac3797b80, transno 21474838559 00000004:00080000:1.0:1763334988.978860:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac3795f80, transno 21474838560 00000004:00080000:1.0:1763334988.978864:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac6c1d500, transno 21474838561 00000004:00080000:1.0:1763334988.978867:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac6c1ce00, transno 21474838562 00000004:00080000:1.0:1763334988.978870:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac6c1f100, transno 21474838563 00000004:00080000:1.0:1763334988.978873:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac6c1f800, transno 21474838564 00000004:00080000:1.0:1763334988.978875:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac6c1c380, transno 21474838565 00000004:00080000:1.0:1763334988.978878:0:29630:0:(osp_sync.c:505:osp_sync_request_commit_cb()) commit req ffff9a5ac6c1df80, transno 21474838566 00000100:00100000:1.0:1763334988.978884:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701917952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.978957:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.978987:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.979012:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aec7b1cc0 going to sleep for 11 seconds 00000004:00080000:0.0:1763334988.979495:0:29650:0:(osp_sync.c:1179:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 12 done 00000100:00100000:2.0:1763334988.979554:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701918080 00000100:00100000:2.0:1763334988.979560:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701918080 00000100:00100000:2.0:1763334988.979632:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1763334988.979640:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701918080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334988.979709:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701918080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 70us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334988.979715:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1763334988.979899:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.979936:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.979958:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.979978:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb460c0 going to sleep for 11 seconds 00000100:00100000:3.0:1763334988.981938:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701918208 00000100:00100000:3.0:1763334988.981953:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701918208 00000100:00100000:3.0:1763334988.982021:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1763334988.982031:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701918208:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1763334988.982139:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701918208:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 109us (2179us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334988.982146:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1763334988.982319:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918208:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.982416:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.982459:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.982489:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46540 going to sleep for 11 seconds 00000100:00100000:0.0:1763334988.982745:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701918336 00000100:00100000:0.0:1763334988.982751:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701918336 00000100:00100000:0.0:1763334988.982796:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1763334988.982804:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701918336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1763334988.982874:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701918336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 70us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.982882:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1763334988.982993:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.983029:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.983056:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.983080:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46480 going to sleep for 11 seconds 00000100:00100000:3.0:1763334988.983129:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701918464 00000100:00100000:3.0:1763334988.983133:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701918464 00000100:00100000:3.0:1763334988.983161:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1763334988.983168:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afc849c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701918464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1763334988.983241:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afc849c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701918464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 73us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334988.983252:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1763334988.983564:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.983631:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.983655:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.983671:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46540 going to sleep for 11 seconds 00000100:00100000:0.0:1763334988.983740:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701918592 00000100:00100000:0.0:1763334988.983745:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701918592 00000100:00100000:0.0:1763334988.983769:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1763334988.983776:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701918592:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1763334988.983817:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701918592:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 42us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.983823:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1763334988.983891:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918592:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.983919:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.983939:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.983960:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46480 going to sleep for 11 seconds 00000100:00100000:0.0:1763334988.984002:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701918720 00000100:00100000:0.0:1763334988.984006:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701918720 00000100:00100000:0.0:1763334988.984032:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1763334988.984039:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701918720:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1763334988.984087:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701918720:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 47us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.984093:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1763334988.984191:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918720:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.984223:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.984243:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.984263:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46540 going to sleep for 11 seconds 00000100:00100000:2.0:1763334988.984307:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701918848 00000100:00100000:2.0:1763334988.984312:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701918848 00000100:00100000:2.0:1763334988.984339:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1763334988.984346:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701918848:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334988.984411:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701918848:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 65us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334988.984417:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1763334988.984518:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918848:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.984546:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.984567:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.984608:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46480 going to sleep for 11 seconds 00000100:00100000:0.0:1763334988.984655:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701918976 00000100:00100000:0.0:1763334988.984659:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701918976 00000100:00100000:0.0:1763334988.984677:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1763334988.984683:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701918976:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1763334988.984735:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701918976:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 51us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.984741:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1763334988.984801:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701918976:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.984833:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701919104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.984865:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.984888:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46540 going to sleep for 11 seconds 00000100:00100000:0.0:1763334988.985946:0:30164:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701919104 00000100:00100000:0.0:1763334988.985956:0:30164:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701919104 00000100:00100000:0.0:1763334988.985984:0:30164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1763334988.985990:0:30164:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701919104:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1763334988.986070:0:30164:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701919104:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 79us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334988.986076:0:30164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1763334988.987916:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701919104:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.987999:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701919232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.988053:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.988087:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46480 going to sleep for 11 seconds 00000100:00100000:2.0:1763334988.988340:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701919232 00000100:00100000:2.0:1763334988.988348:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701919232 00000100:00100000:2.0:1763334988.988396:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1763334988.988405:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701919232:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334988.988489:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701919232:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 85us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334988.988496:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1763334988.988898:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701919232:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.988957:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701919360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.988986:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.989012:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46540 going to sleep for 11 seconds 00000100:00100000:3.0:1763334988.989061:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701919360 00000100:00100000:3.0:1763334988.989066:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701919360 00000100:00100000:3.0:1763334988.989099:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1763334988.989106:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701919360:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1763334988.989163:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701919360:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 57us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334988.989169:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1763334988.989730:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701919360:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.989778:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701919488:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.989804:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.989827:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46480 going to sleep for 11 seconds 00000100:00100000:3.0:1763334988.989890:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701919488 00000100:00100000:3.0:1763334988.989895:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701919488 00000100:00100000:3.0:1763334988.989939:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1763334988.989947:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701919488:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1763334988.990005:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701919488:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 58us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334988.990011:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1763334988.990107:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701919488:0@lo:1000:mdt_rdpg00_000.0 00000040:00080000:1.0:1763334988.990382:0:29630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x200000bd0:0x1:0x0].15, 816 off39832 00000001:00080000:1.0:1763334988.990394:0:29630:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939333 00000100:00100000:1.0:1763334988.990453:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701919616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.990479:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.990501:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46540 going to sleep for 11 seconds 00000100:00100000:2.0:1763334988.993946:0:6527:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701919616 00000100:00100000:2.0:1763334988.993962:0:6527:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701919616 00000100:00100000:2.0:1763334988.994035:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1763334988.994045:0:6527:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701919616:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1763334988.994383:0:6527:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+7:29630:x1848989701919616:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 339us (3902us total) trans 17179871352 rc 0/0 00000100:00100000:2.0:1763334988.994392:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1763334988.994723:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701919616:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.994771:0:29630:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701919744:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1763334988.994810:0:29630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1763334988.994849:0:29630:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59ca0ad180 going to sleep for 11 seconds 00000100:00100000:3.0:1763334988.994900:0:6528:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701919744 00000100:00100000:3.0:1763334988.994906:0:6528:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701919744 00000100:00100000:3.0:1763334988.994942:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1763334988.994949:0:6528:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+5:29630:x1848989701919744:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1763334988.995188:0:6528:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:lustre-MDT0000-mdtlov_UUID+6:29630:x1848989701919744:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 238us (376us total) trans 21474838574 rc 0/0 00000100:00100000:3.0:1763334988.995195:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1763334988.995297:0:29630:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:29630:1848989701919744:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1763334988.995397:0:29630:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939334 00010000:00010000:1.0:1763334988.995433:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995443:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995451:0:29630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995458:0:29630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf9e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334988.995462:0:29630:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995470:0:29630:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995486:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b5:0x0].0x0 (ffff9a5ac6cab100) 00010000:00010000:1.0:1763334988.995489:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1763334988.995493:0:29630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995500:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d6d9 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1b5:0x0].0x0 bits 0x28/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995519:0:29630:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995529:0:29630:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 2/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995534:0:29630:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995539:0:29630:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479e00 already unused, calling callback (ffffffffc2111550) 00010000:00010000:1.0:1763334988.995542:0:29630:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 3/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995547:0:29630:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 4/0,0 mode: EX/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995553:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:1.0:1763334988.995556:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1763334988.995559:0:29630:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995564:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d6d2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x1ab:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 29630 initiator: MDT0 00010000:00010000:1.0:1763334988.995628:0:29630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ac7d60400) 00010000:00010000:1.0:1763334988.995631:0:29630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334988.995638:0:29630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d638 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0974 expref: 193 pid: 30972 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334988.995715:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5b01f2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53676:x1848989694699648:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 51980us (54048us total) trans 8589939335 rc 0/0 00000100:00100000:1.0:1763334988.995723:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1856 00000020:00080000:1.0:1763334988.995727:0:29630:0:(tgt_main.c:782:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1763334989.000974:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334989.001037:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694700032 00000100:00100000:1.0:1763334989.001047:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694700032 00000100:00100000:1.0:1763334989.001104:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5127 00000100:00100000:1.0:1763334989.001116:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59cd077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+192:53676:x1848989694700032:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334989.001137:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334989.001161:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d6e0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b09ba expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.001214:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d6e0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09ba expref: 193 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.001228:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5478a00/0xcedf0054f849d6e0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09ba expref: 193 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.001244:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa800) 00010000:00010000:1.0:1763334989.001247:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1763334989.001250:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478a00, rc 0) 00000100:00100000:1.0:1763334989.001307:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59cd077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53676:x1848989694700032:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 195us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334989.001314:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5127 00000100:00080000:0.0:1763334989.001557:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1763334989.012320:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334989.012421:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694700288 00000100:00100000:1.0:1763334989.012431:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694700288 00000100:00100000:1.0:1763334989.012484:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1857 00000100:00100000:1.0:1763334989.012493:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+193:53676:x1848989694700288:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1763334989.012761:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53676:x1848989694700288:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 268us (450us total) trans 8589939336 rc 0/0 00000100:00100000:1.0:1763334989.012770:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1857 00000100:00100000:3.0:1763334989.019001:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.019102:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694700544 00000100:00100000:2.0:1763334989.019113:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694700544 00000100:00100000:2.0:1763334989.019186:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1858 00000100:00100000:2.0:1763334989.019197:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac821bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+194:53676:x1848989694700544:12345-192.168.201.60@tcp:35:lfs.0 00000004:00080000:2.0:1763334989.019500:0:29631:0:(mdd_object.c:3993:mdd_close()) Object [0x200000404:0x1b5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00010000:00010000:2.0:1763334989.019662:0:29631:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d6e7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334989.019679:0:29631:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d6e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334989.019690:0:29631:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d6e7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334989.019699:0:29631:0:(ldlm_lock.c:947:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d6e7 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334989.019705:0:29631:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d6e7 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334989.019711:0:29631:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d6e7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 29631 initiator: MDT0 00010000:00010000:2.0:1763334989.019734:0:29631:0:(ldlm_lockd.c:2188:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1763334989.019760:0:5737:0:(ldlm_lockd.c:2793:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1763334989.019768:0:5737:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d6e7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334989.019777:0:5737:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334989.019782:0:5737:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d6e7 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334989.019791:0:5737:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d6e7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334989.019805:0:5737:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1b5:0x0].0x0 (ffff9a5ac6caba00) 00010000:00010000:3.0:1763334989.019809:0:5737:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1763334989.019815:0:5737:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d6e7 lrc: 1/0,0 mode: --/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00010000:00010000:3.0:1763334989.019822:0:5737:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d6e7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1b5:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 29631 initiator: MDT0 00000100:00100000:2.0:1763334989.019857:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac821bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53676:x1848989694700544:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 661us (865us total) trans 8589939337 rc 0/0 00000100:00100000:2.0:1763334989.019866:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1858 00010000:00010000:3.0:1763334989.020858:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334989.020861:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1763334989.020863:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1763334989.086510:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334989.086627:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694700672 00000100:00100000:3.0:1763334989.086637:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694700672 00000100:00100000:3.0:1763334989.086701:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5128 00000100:00100000:3.0:1763334989.086711:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+195:53677:x1848989694700672:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334989.086735:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334989.086757:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d6ee lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b09c1 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.086828:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d6f5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.086857:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d6f5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.086869:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d6f5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.086884:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d6fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.086891:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d6fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.086897:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d6fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087009:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d703 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087018:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d703 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087024:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d703 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334989.087058:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 2104 00000004:00200000:3.0:1763334989.087063:0:30972:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1763334989.087080:0:30972:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d703 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087092:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d703 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087100:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d6f5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087106:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d6f5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087117:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087122:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8800 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334989.087126:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d6f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087134:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d6f5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087145:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0x0 (ffff9a5af66de500) 00010000:00010000:3.0:1763334989.087148:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334989.087153:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d6f5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087159:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8800/0xcedf0054f849d6f5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087171:0:30972:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d6fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087177:0:30972:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d6fc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087182:0:30972:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d6fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087187:0:30972:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a59cbbf8000 already unused, calling callback (ffffffffc2111550) 00010000:00010000:3.0:1763334989.087190:0:30972:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d6fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087195:0:30972:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d6fc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087202:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1aa:0x0].0xdd396665 (ffff9a5af66dee00) 00010000:00010000:3.0:1763334989.087205:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1763334989.087208:0:30972:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d6fc lrc: 2/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087214:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d6fc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1aa:0x0].0xdd396665 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.087242:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d6ee lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09c1 expref: 197 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.087256:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d703 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09c1 expref: 196 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.087263:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa800) 00010000:00010000:3.0:1763334989.087265:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1763334989.087268:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf9e00, rc 0) 00000100:00100000:3.0:1763334989.087333:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53677:x1848989694700672:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 623us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334989.087341:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5128 00000100:00100000:0.0:1763334989.094688:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334989.094777:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694700928 00000100:00100000:3.0:1763334989.094786:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694700928 00000100:00100000:3.0:1763334989.094861:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5129 00000100:00100000:3.0:1763334989.094872:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+196:53677:x1848989694700928:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334989.094893:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334989.094914:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d70a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b09c8 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.095019:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d711 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.095035:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d711 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.095046:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d711 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334989.095057:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 2104 00010000:00010000:3.0:1763334989.095180:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d70a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09c8 expref: 199 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.095197:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf8000/0xcedf0054f849d711 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09c8 expref: 198 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.095206:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa800) 00010000:00010000:3.0:1763334989.095209:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1763334989.095213:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8000, rc 0) 00000100:00100000:3.0:1763334989.097533:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53677:x1848989694700928:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2652us (2842us total) trans 8589939338 rc 0/0 00000100:00100000:3.0:1763334989.098920:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5129 00000100:00100000:2.0:1763334989.102522:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334989.102672:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694701184 00000100:00100000:3.0:1763334989.102682:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694701184 00000100:00100000:1.0:1763334989.103505:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5130 00000100:00100000:1.0:1763334989.103522:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+198:53677:x1848989694701184:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334989.103546:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334989.103567:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d71f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b09cf expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.103711:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d726 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334989.103726:0:29628:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d726 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:1.0:1763334989.103737:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d726 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:1.0:1763334989.103750:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 2104 00010000:00010000:1.0:1763334989.103888:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d71f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09cf expref: 201 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.103906:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d726 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09cf expref: 200 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.103915:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa800) 00010000:00010000:1.0:1763334989.103918:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1763334989.103921:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479a00, rc 0) 00000100:00100000:1.0:1763334989.103977:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53677:x1848989694701184:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 461us (1465us total) trans 8589939339 rc 0/0 00000100:00100000:1.0:1763334989.103985:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5130 00000100:00100000:2.0:1763334989.124415:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334989.124559:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694701312 00000100:00100000:3.0:1763334989.124587:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694701312 00000100:00080000:0.0:1763334989.125203:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1763334989.126306:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5310 00000100:00100000:2.0:1763334989.126325:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+17:2361:x1848989694701312:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334989.126345:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334989.126368:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d734 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b09d6 expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334989.126392:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24a:0x0] initial LVB size: 133906, mtime: 0x691a5b4b, atime: 0x691a5b40, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:2.0:1763334989.126412:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334989.126414:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334989.126422:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09d6 expref: 18 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334989.126439:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430800/0xcedf0054f849d734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09d6 expref: 18 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334989.126452:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430800, rc 0) 00000100:00100000:2.0:1763334989.129393:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2361:x1848989694701312:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3061us (4974us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334989.129408:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5310 00000100:00100000:1.0:1763334989.139567:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.139685:0:26564:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694701440 00000100:00100000:2.0:1763334989.139696:0:26564:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694701440 00000100:00100000:2.0:1763334989.139767:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5311 00000100:00100000:2.0:1763334989.139777:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+27:2362:x1848989694701440:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334989.139795:0:26564:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334989.139816:0:26564:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849d73b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b09dd expref: -99 pid: 26564 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334989.139847:0:26564:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24f:0x0] initial LVB size: 133906, mtime: 0x691a5b4b, atime: 0x691a5b44, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:2.0:1763334989.139871:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334989.139873:0:26564:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334989.139882:0:26564:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849d73b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09dd expref: 28 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334989.139900:0:26564:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431000/0xcedf0054f849d73b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09dd expref: 28 pid: 26564 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334989.139915:0:26564:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431000, rc 0) 00000100:00100000:2.0:1763334989.139970:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2362:x1848989694701440:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 195us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334989.139977:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5311 00000100:00080000:1.0:1763334989.140274:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763334989.150926:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334989.151397:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694701568 00000100:00100000:3.0:1763334989.151406:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694701568 00000100:00100000:3.0:1763334989.152719:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5312 00000100:00100000:3.0:1763334989.152736:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2361:x1848989694701568:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334989.152754:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334989.152775:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d742 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b09e4 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1763334989.152799:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24c:0x0] initial LVB size: 133906, mtime: 0x691a5b4b, atime: 0x691a5b48, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:3.0:1763334989.152819:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334989.152821:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334989.152830:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d742 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09e4 expref: 19 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334989.152856:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a59cbbf8a00/0xcedf0054f849d742 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09e4 expref: 19 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1763334989.152870:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a59cbbf8a00, rc 0) 00000100:00100000:3.0:1763334989.156047:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2361:x1848989694701568:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3301us (5116us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334989.156060:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5312 00000100:00100000:3.0:1763334989.189739:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.190050:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694701696 00000100:00100000:2.0:1763334989.190060:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694701696 00000100:00100000:2.0:1763334989.190117:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5313 00000100:00100000:2.0:1763334989.190516:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59cd074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2362:x1848989694701696:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334989.190534:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334989.190556:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431400/0xcedf0054f849d749 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b09eb expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334989.190655:0:6518:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x251:0x0] initial LVB size: 133906, mtime: 0x691a5b4b, atime: 0x691a5b49, ctime: 0x691a5b4b, blocks: 0x203 00010000:00010000:2.0:1763334989.190675:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334989.190677:0:6518:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334989.190686:0:6518:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431400/0xcedf0054f849d749 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09eb expref: 29 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334989.190702:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431400/0xcedf0054f849d749 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09eb expref: 29 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334989.190715:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431400, rc 0) 00000100:00100000:2.0:1763334989.194521:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59cd074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2362:x1848989694701696:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3995us (4778us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334989.194534:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5313 00000100:00100000:1.0:1763334989.303276:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334989.303376:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694701824 00000100:00100000:0.0:1763334989.303387:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694701824 00000100:00100000:0.0:1763334989.303465:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2038 00000100:00100000:0.0:1763334989.303475:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2362:x1848989694701824:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334989.303519:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.303539:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d6bd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09a5 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.303547:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334989.303549:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1763334989.303553:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.303617:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d6bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09a5 expref: 29 pid: 6519 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.303630:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d6bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09a5 expref: 29 pid: 6519 timeout: 1153 lvb_type: 0 00000100:00100000:0.0:1763334989.303645:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e16680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701919872:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334989.303738:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac55313c0 going to sleep for 11 seconds 00000100:00100000:0.0:1763334989.308065:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e16680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0001_UUID:14183:1848989701919872:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334989.308098:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334989.310895:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334989.314551:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694701952 00000100:00100000:0.0:1763334989.314568:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694701952 00010000:00010000:0.0:1763334989.314631:0:11727:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d6bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09a5 expref: 30 pid: 6519 timeout: 1153 lvb_type: 0 00000100:00100000:0.0:1763334989.314682:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2753 00000100:00100000:0.0:1763334989.314692:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac8d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2360:x1848989694701952:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1763334989.314710:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334989.314732:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d6bd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09a5 expref: 30 pid: 6519 timeout: 1153 lvb_type: 0 00010000:00010000:0.0:1763334989.314746:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d6bd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09a5 expref: 30 pid: 6519 timeout: 1153 lvb_type: 0 00010000:00010000:0.0:1763334989.314769:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478400/0xcedf0054f849d6bd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09a5 expref: 30 pid: 6519 timeout: 1153 lvb_type: 0 00010000:00010000:0.0:1763334989.314784:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334989.314786:0:11727:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334989.314791:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.314800:0:11727:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.314844:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334989.314899:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac8d3b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2360:x1848989694701952:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 209us (4017us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334989.314906:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2753 00010000:00010000:2.0:1763334989.315062:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.315072:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.315233:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.315242:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.315250:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.315267:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793400 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334989.315272:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.315280:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.315291:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.315298:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6793400/0xcedf0054f849d750 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334989.315351:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2362:x1848989694701824:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 11877us (12084us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763334989.315362:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2038 00000100:00100000:1.0:1763334989.322151:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334989.322909:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.322934:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694702080 00000100:00100000:2.0:1763334989.322945:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694702080 00000100:00100000:2.0:1763334989.325219:0:6518:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694702208 00000100:00100000:2.0:1763334989.325233:0:6518:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694702208 00000100:00100000:2.0:1763334989.325302:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5314 00000100:00100000:2.0:1763334989.325314:0:6518:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694702080:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1763334989.325333:0:6518:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334989.325356:0:6518:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d757 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b09f2 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334989.325430:0:6518:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6518:1848989701920000:192.168.201.60@tcp:106: 00000100:00100000:2.0:1763334989.325533:0:6518:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98b40 going to sleep for 11 seconds 00000100:00100000:1.0:1763334989.326076:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5315 00000100:00100000:1.0:1763334989.326093:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5afb343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694702208:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334989.326107:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334989.326119:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d75e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b09f9 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334989.326156:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701920128:192.168.201.60@tcp:106: 00000100:00100000:1.0:1763334989.326195:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46480 going to sleep for 11 seconds 00000100:00100000:2.0:1763334989.335755:0:6518:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6518:1848989701920000:192.168.201.60@tcp:106: 00010000:00010000:2.0:1763334989.335794:0:6518:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d757 lrc: 1/0,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09f2 expref: 20 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334989.335818:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d757 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09f2 expref: 20 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1763334989.335842:0:6518:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:2.0:1763334989.335913:0:6518:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694702080:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 10601us (13775us total) trans 0 rc 301/301 00000100:00100000:2.0:1763334989.335922:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5314 00000100:00100000:1.0:1763334989.340786:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701920128:192.168.201.60@tcp:106: 00010000:00010000:1.0:1763334989.340829:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d75e lrc: 1/0,0 mode: --/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09f9 expref: 29 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334989.340865:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5478c00/0xcedf0054f849d75e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09f9 expref: 29 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334989.340878:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5478c00, rc 0) 00000100:00100000:1.0:1763334989.340953:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5afb343050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2360:x1848989694702208:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 14867us (18045us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334989.340963:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5315 00000100:00100000:1.0:1763334989.349125:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.350034:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694702336 00000100:00100000:2.0:1763334989.350046:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694702336 00000100:00100000:2.0:1763334989.350119:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2039 00000100:00100000:2.0:1763334989.350128:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694702336:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334989.350167:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.350186:0:14183:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d6a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0997 expref: 19 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.350195:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334989.350197:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1763334989.350201:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.350236:0:14183:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d6a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0997 expref: 19 pid: 26564 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.350249:0:14183:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d6a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0997 expref: 19 pid: 26564 timeout: 1153 lvb_type: 0 00000100:00100000:2.0:1763334989.350275:0:14183:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14183:1848989701920256:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334989.350362:0:14183:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98b40 going to sleep for 11 seconds 00000100:00100000:2.0:1763334989.356684:0:14183:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_003:lustre-OST0000_UUID:14183:1848989701920256:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334989.356713:0:14183:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334989.360755:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334989.361623:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694702464 00000100:00100000:3.0:1763334989.361637:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694702464 00010000:00010000:3.0:1763334989.361686:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d6a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0997 expref: 20 pid: 26564 timeout: 1153 lvb_type: 0 00000100:00100000:3.0:1763334989.361721:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2754 00000100:00100000:3.0:1763334989.361730:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2359:x1848989694702464:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334989.361744:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334989.361767:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d6a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0997 expref: 20 pid: 26564 timeout: 1153 lvb_type: 0 00010000:00010000:3.0:1763334989.361780:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d6a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0997 expref: 20 pid: 26564 timeout: 1153 lvb_type: 0 00010000:00010000:3.0:1763334989.361805:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d6a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0997 expref: 20 pid: 26564 timeout: 1153 lvb_type: 0 00010000:00010000:3.0:1763334989.361821:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334989.361823:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334989.361828:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.361848:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.361882:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334989.361948:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2359:x1848989694702464:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 217us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334989.361956:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2754 00010000:00010000:2.0:1763334989.362116:0:14183:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.362127:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.362257:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.362266:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.362274:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.362281:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5431e00 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334989.362285:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.362292:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.362303:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.362310:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d765 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334989.362364:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2362:x1848989694702336:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 12236us (13249us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763334989.362372:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2039 00000100:00100000:1.0:1763334989.385711:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334989.385777:0:11727:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694702592 00000100:00100000:0.0:1763334989.385787:0:11727:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694702592 00000100:00100000:0.0:1763334989.385858:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 428 00000100:00100000:0.0:1763334989.385869:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53677:x1848989694702592:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:0.0:1763334989.385885:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1763334989.385913:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5479a00/0xcedf0054f849d726 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09cf expref: 200 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.385931:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa800) 00010000:00010000:0.0:1763334989.385936:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1763334989.385996:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53677:x1848989694702592:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 128us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334989.386002:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 428 00000100:00100000:3.0:1763334989.391494:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.392475:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694702848 00000100:00100000:2.0:1763334989.392489:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694702848 00000100:00100000:2.0:1763334989.392556:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1859 00000100:00100000:2.0:1763334989.392567:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59cd075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+199:53677:x1848989694702848:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334989.394488:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59cd075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53677:x1848989694702848:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1913us (2995us total) trans 8589939340 rc 0/0 00000100:00100000:2.0:1763334989.394502:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1859 00000100:00100000:1.0:1763334989.435981:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334989.436074:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694703104 00000100:00100000:3.0:1763334989.436084:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694703104 00000100:00100000:3.0:1763334989.436155:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5131 00000100:00100000:3.0:1763334989.436167:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+200:53678:x1848989694703104:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1763334989.436197:0:30972:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1763334989.436220:0:30972:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d76c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0a00 expref: -99 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.436321:0:30972:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d773 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.436337:0:30972:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d773 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 30972 initiator: MDT0 00010000:00010000:3.0:1763334989.436348:0:30972:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d773 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 30972 initiator: MDT0 00000004:00200000:3.0:1763334989.436362:0:30972:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 2104 00010000:00010000:3.0:1763334989.436504:0:30972:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9a00/0xcedf0054f849d76c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a00 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.436523:0:30972:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d773 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a00 expref: 202 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.436532:0:30972:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa800) 00010000:00010000:3.0:1763334989.436535:0:30972:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1763334989.436539:0:30972:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac6066000, rc 0) 00000100:00100000:3.0:1763334989.436653:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53678:x1848989694703104:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 487us (682us total) trans 8589939341 rc 0/0 00000100:00100000:3.0:1763334989.436660:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5131 00000100:00100000:3.0:1763334989.441087:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.441163:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694703232 00000100:00100000:2.0:1763334989.441174:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694703232 00000100:00100000:2.0:1763334989.441484:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2040 00000100:00100000:2.0:1763334989.441498:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59cd074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694703232:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334989.441659:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d781 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.441677:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334989.441679:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334989.441686:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d781 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.441703:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d781 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.441863:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d781 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.441873:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d781 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.441882:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d781 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.441890:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334989.441895:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d781 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.441903:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d781 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.441919:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d781 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.441927:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d781 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334989.442001:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59cd074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2360:x1848989694703232:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 505us (923us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763334989.443310:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2040 00000100:00100000:0.0:1763334989.448874:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.448962:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694703360 00000100:00100000:2.0:1763334989.448972:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694703360 00000100:00100000:1.0:1763334989.449690:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2041 00000100:00100000:1.0:1763334989.449709:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2361:x1848989694703360:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:1.0:1763334989.449751:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d788 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.449766:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334989.449769:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334989.449774:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d788 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.449790:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d788 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.449943:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d788 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.449952:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d788 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.449961:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d788 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.449968:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5479800 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:1.0:1763334989.449972:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d788 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.449980:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d788 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.449995:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d788 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.450003:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d788 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24f:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334989.450064:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2361:x1848989694703360:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 363us (1200us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1763334989.450072:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2041 00000100:00100000:3.0:1763334989.457038:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.457117:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694703488 00000100:00100000:2.0:1763334989.457131:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694703488 00000100:00100000:2.0:1763334989.458285:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2042 00000100:00100000:2.0:1763334989.458307:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59cd075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694703488:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:2.0:1763334989.458357:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d78f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.458375:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334989.458377:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334989.458385:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d78f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.458400:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d78f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.458550:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d78f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.458559:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d78f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.458568:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d78f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.459660:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac5430200 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:2.0:1763334989.459666:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d78f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.459676:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d78f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.459696:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d78f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.459704:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d78f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24c:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1763334989.460351:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59cd075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2359:x1848989694703488:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 2047us (3320us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1763334989.460367:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2042 00000100:00100000:0.0:1763334989.466325:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.471596:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694703616 00000100:00100000:2.0:1763334989.471614:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694703616 00000100:00100000:3.0:1763334989.472020:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2043 00000100:00100000:3.0:1763334989.472033:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694703616:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:3.0:1763334989.472080:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d796 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.472099:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334989.472101:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334989.472107:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d796 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.472121:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d796 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.472264:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d796 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.472273:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d796 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.472281:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d796 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.472288:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334989.472292:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d796 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.472301:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d796 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.472317:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d796 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.472325:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d796 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x251:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334989.494874:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2359:x1848989694703616:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 22830us (28546us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763334989.494890:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2043 00000100:00100000:0.0:1763334989.611903:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334989.612003:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694703744 00000100:00100000:1.0:1763334989.612013:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694703744 00000100:00100000:1.0:1763334989.612072:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5316 00000100:00100000:1.0:1763334989.612081:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+28:2362:x1848989694703744:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334989.612099:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334989.612119:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d79d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0a07 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334989.612143:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24a:0x0] initial LVB size: 2104, mtime: 0x691a5b4d, atime: 0x691a5b49, ctime: 0x691a5b4d, blocks: 0xbb 00010000:00010000:1.0:1763334989.612163:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334989.612166:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334989.612175:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d79d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a07 expref: 29 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334989.612191:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479800/0xcedf0054f849d79d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a07 expref: 29 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334989.612205:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479800, rc 0) 00000100:00100000:1.0:1763334989.612262:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2362:x1848989694703744:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 181us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334989.612274:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5316 00000100:00100000:0.0:1763334989.619192:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334989.619298:0:14183:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694703872 00000100:00100000:3.0:1763334989.619313:0:14183:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694703872 00000100:00100000:3.0:1763334989.619413:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2044 00000100:00100000:3.0:1763334989.619425:0:14183:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2361:x1848989694703872:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:3.0:1763334989.619478:0:14183:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d7a4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.619498:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334989.619501:0:14183:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1763334989.619509:0:14183:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d7a4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.619524:0:14183:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d7a4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.619805:0:14183:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d7a4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.619815:0:14183:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d7a4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.619823:0:14183:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d7a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.619841:0:14183:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5ac6066600 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:3.0:1763334989.619847:0:14183:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d7a4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.619857:0:14183:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d7a4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.619876:0:14183:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d7a4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.619884:0:14183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac6066600/0xcedf0054f849d7a4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24a:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14183 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1763334989.619968:0:14183:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2361:x1848989694703872:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 544us (791us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1763334989.619977:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2044 00000100:00100000:0.0:1763334989.627547:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334989.627660:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334989.627758:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694704000 00000100:00100000:1.0:1763334989.627774:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694704000 00000100:00100000:1.0:1763334989.627858:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694704128 00000100:00100000:1.0:1763334989.627862:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694704128 00000100:00100000:1.0:1763334989.627894:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5317 00000100:00100000:1.0:1763334989.627906:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+18:2361:x1848989694704000:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334989.627931:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334989.627962:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d7ab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0a0e expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1763334989.627993:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x240000400:0x24e:0x0] initial LVB size: 4096, mtime: 0x691a5b4d, atime: 0x691a5b49, ctime: 0x691a5b4d, blocks: 0xb 00010000:00010000:1.0:1763334989.628021:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334989.628023:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334989.628034:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d7ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a0e expref: 19 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334989.628055:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5479e00/0xcedf0054f849d7ab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a0e expref: 19 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334989.628071:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479e00, rc 0) 00000100:00100000:1.0:1763334989.628149:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2361:x1848989694704000:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 246us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334989.628158:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5317 00000100:00100000:1.0:1763334989.628181:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5318 00000100:00100000:1.0:1763334989.628188:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2361:x1848989694704128:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1763334989.628198:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1763334989.628210:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849d7b2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0a15 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334989.628271:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5aee4d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701920384:192.168.201.60@tcp:106: 00000100:00100000:1.0:1763334989.628349:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46480 going to sleep for 11 seconds 00000100:00100000:1.0:1763334989.631088:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5aee4d3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701920384:192.168.201.60@tcp:106: 00010000:00010000:1.0:1763334989.631144:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849d7b2 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a15 expref: 30 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334989.631173:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5479600/0xcedf0054f849d7b2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a15 expref: 30 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334989.631189:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5479600, rc 0) 00000100:00100000:1.0:1763334989.631274:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2361:x1848989694704128:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3085us (3612us total) trans 0 rc 301/301 00000100:00100000:1.0:1763334989.631284:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5318 00000100:00100000:1.0:1763334989.634569:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334989.634718:0:14385:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694704256 00000100:00100000:0.0:1763334989.634731:0:14385:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694704256 00000100:00100000:0.0:1763334989.634822:0:14385:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2045 00000100:00100000:0.0:1763334989.634842:0:14385:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aee4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694704256:12345-192.168.201.60@tcp:3:lfs.0 00010000:00010000:0.0:1763334989.634894:0:14385:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d7b9 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.634914:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334989.634917:0:14385:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334989.634924:0:14385:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d7b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.634944:0:14385:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d7b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.635113:0:14385:0:(ldlm_lock.c:822:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d7b9 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.635123:0:14385:0:(ldlm_lock.c:880:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d7b9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.635131:0:14385:0:(ldlm_lockd.c:1906:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d7b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.635138:0:14385:0:(ldlm_lockd.c:1920:ldlm_handle_bl_callback()) Lock ffff9a5af6793000 already unused, calling callback (ffffffffc16f8b40) 00010000:00010000:0.0:1763334989.635143:0:14385:0:(ldlm_request.c:355:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d7b9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.635153:0:14385:0:(ldlm_request.c:1310:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d7b9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.635171:0:14385:0:(ldlm_lockd.c:1932:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d7b9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.635179:0:14385:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6793000/0xcedf0054f849d7b9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x24e:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14385 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334989.635272:0:14385:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aee4d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2362:x1848989694704256:12345-192.168.201.60@tcp:3:lfs.0 Request processed in 431us (717us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1763334989.635281:0:14385:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2045 00000100:00100000:0.0:1763334989.655647:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334989.655753:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694704384 00000100:00100000:3.0:1763334989.655769:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694704384 00000100:00100000:3.0:1763334989.656292:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 429 00000100:00100000:3.0:1763334989.656308:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53678:x1848989694704384:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:3.0:1763334989.656329:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334989.656367:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac6066000/0xcedf0054f849d773 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x1ab:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a00 expref: 202 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1763334989.656395:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa800) 00010000:00010000:3.0:1763334989.656402:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1763334989.657768:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53678:x1848989694704384:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 1454us (2125us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334989.657785:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 429 00000100:00100000:1.0:1763334989.662074:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.663651:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694704640 00000100:00100000:2.0:1763334989.663671:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694704640 00000100:00100000:2.0:1763334989.663762:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1860 00000100:00100000:2.0:1763334989.663775:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+201:53678:x1848989694704640:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1763334989.664155:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5aeec5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53678:x1848989694704640:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 382us (2096us total) trans 8589939342 rc 0/0 00000100:00100000:2.0:1763334989.664166:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1860 00010000:00010000:2.0:1763334989.669800:0:5736:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1763334989.670943:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.671060:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694704896 00000100:00100000:2.0:1763334989.671074:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694704896 00000100:00100000:2.0:1763334989.671152:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5132 00000100:00100000:2.0:1763334989.671165:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+202:53644:x1848989694704896:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334989.671200:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334989.671231:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d7c0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0a1c expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.671376:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334989.671396:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d703 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09c1 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.671407:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334989.671458:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d703 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09c1 expref: 203 pid: 30972 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.671474:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d703 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09c1 expref: 203 pid: 30972 timeout: 1154 lvb_type: 0 00000100:00100000:2.0:1763334989.671491:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701920512:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334989.671653:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98300 going to sleep for 11 seconds 00000100:00100000:2.0:1763334989.682788:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701920512:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334989.682834:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334989.683224:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334989.683670:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694705024 00000100:00100000:3.0:1763334989.683682:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694705024 00010000:00010000:3.0:1763334989.683738:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d703 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09c1 expref: 204 pid: 30972 timeout: 1154 lvb_type: 0 00000100:00100000:3.0:1763334989.683794:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2755 00000100:00100000:3.0:1763334989.683805:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2360:x1848989694705024:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1763334989.683836:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1763334989.683845:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d703 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09c1 expref: 204 pid: 30972 timeout: 1154 lvb_type: 0 00010000:00010000:3.0:1763334989.684090:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d703 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09c1 expref: 204 pid: 30972 timeout: 1154 lvb_type: 0 00010000:00010000:3.0:1763334989.684120:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a59cbbf9e00/0xcedf0054f849d703 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b09c1 expref: 204 pid: 30972 timeout: 1154 lvb_type: 0 00010000:00010000:3.0:1763334989.684142:0:5734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa800) 00010000:00010000:3.0:1763334989.684148:0:5734:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334989.684160:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334989.684168:0:5734:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:3.0:1763334989.684255:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1763334989.684366:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334989.684374:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334989.684399:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 2104 00010000:00010000:2.0:1763334989.684660:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d7c0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1aa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a1c expref: 205 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.684679:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a1c expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.684687:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa800) 00010000:00010000:2.0:1763334989.684690:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1763334989.684693:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431e00, rc 0) 00000100:00100000:3.0:1763334989.684806:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2360:x1848989694705024:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1000us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334989.684819:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2755 00000100:00100000:2.0:1763334989.685657:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694704896:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 14488us (14721us total) trans 8589939343 rc 0/0 00000100:00100000:2.0:1763334989.685668:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5132 00000100:00100000:1.0:1763334989.691338:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.693446:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694705152 00000100:00100000:2.0:1763334989.693467:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694705152 00000100:00100000:2.0:1763334989.693558:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5133 00000100:00100000:2.0:1763334989.693612:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694705152:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334989.693666:0:29628:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334989.693694:0:29628:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d7d5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0a23 expref: -99 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.693873:0:29628:0:(ldlm_lock.c:768:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d7dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334989.693892:0:29628:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a1c expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.693902:0:29628:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d7dc lrc: 4/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334989.693942:0:29628:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a1c expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.693956:0:29628:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a1c expref: 204 pid: 29628 timeout: 1154 lvb_type: 0 00000100:00100000:2.0:1763334989.693972:0:29628:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59c39e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701920640:192.168.201.60@tcp:104: 00000100:00100000:2.0:1763334989.694087:0:29628:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a59c2b98840 going to sleep for 11 seconds 00000100:00100000:2.0:1763334989.708178:0:29628:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59c39e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:29628:1848989701920640:192.168.201.60@tcp:104: 00010000:00010000:2.0:1763334989.708226:0:29628:0:(ldlm_request.c:274:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d7dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000100:00100000:1.0:1763334989.710462:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334989.711278:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694705280 00000100:00100000:3.0:1763334989.711295:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694705280 00010000:00010000:3.0:1763334989.711360:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a1c expref: 205 pid: 29628 timeout: 1154 lvb_type: 0 00000100:00100000:2.0:1763334989.714016:0:11727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2756 00000100:00100000:2.0:1763334989.714054:0:11727:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+205:2359:x1848989694705280:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1763334989.714087:0:11727:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1763334989.714105:0:11727:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a1c expref: 205 pid: 29628 timeout: 1154 lvb_type: 0 00010000:00010000:2.0:1763334989.714129:0:11727:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a1c expref: 205 pid: 29628 timeout: 1154 lvb_type: 0 00010000:00010000:2.0:1763334989.714164:0:11727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5431e00/0xcedf0054f849d7c7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x1ab:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a1c expref: 205 pid: 29628 timeout: 1154 lvb_type: 0 00010000:00010000:2.0:1763334989.714191:0:11727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa800) 00010000:00010000:2.0:1763334989.714197:0:11727:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d7dc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334989.714210:0:11727:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d7dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334989.714218:0:11727:0:(ldlm_lock.c:1065:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d7dc lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334989.714275:0:11727:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1763334989.714377:0:11727:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4599faa-cf4a-4df6-8700-d383b4282dac+204:2359:x1848989694705280:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 342us (3929us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334989.714386:0:11727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2756 00010000:00010000:2.0:1763334989.714449:0:29628:0:(ldlm_request.c:186:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d7dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334989.714459:0:29628:0:(ldlm_request.c:514:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d7dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00000004:00200000:2.0:1763334989.714528:0:29628:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000404:0x1ab:0x0]: returning size 2104 00000004:00200000:2.0:1763334989.714534:0:29628:0:(mdt_handler.c:1577:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1763334989.714560:0:29628:0:(mdt_handler.c:2497:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d7dc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 29628 initiator: MDT0 00010000:00010000:2.0:1763334989.714646:0:29628:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430200/0xcedf0054f849d7d5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x1ab:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a23 expref: 204 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.714663:0:29628:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9a5ac5430e00/0xcedf0054f849d7dc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x1ab:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a23 expref: 203 pid: 29628 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.714672:0:29628:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x1ab:0x0].0x0 (ffff9a5ad28fa800) 00010000:00010000:2.0:1763334989.714676:0:29628:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1763334989.714679:0:29628:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5430e00, rc 0) 00000100:00100000:2.0:1763334989.715590:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694705152:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 21995us (24240us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334989.715603:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5133 00000100:00100000:1.0:1763334989.720838:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334989.721485:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694705408 00000100:00100000:0.0:1763334989.721502:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694705408 00000100:00100000:0.0:1763334989.721618:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5319 00000100:00100000:0.0:1763334989.721631:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac7e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694705408:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334989.721656:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334989.721682:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d7e3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0a2a expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1763334989.721761:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701920768:192.168.201.60@tcp:106: 00000100:00100000:0.0:1763334989.721895:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5531b40 going to sleep for 11 seconds 00000100:00100000:1.0:1763334989.727415:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:26216:1848989701920768:192.168.201.60@tcp:106: 00010000:00010000:1.0:1763334989.727476:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d7e3 lrc: 1/0,0 mode: --/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a2a expref: 30 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334989.727509:0:26216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff9a5af6792400/0xcedf0054f849d7e3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x252:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a2a expref: 30 pid: 26216 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1763334989.727528:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334989.727901:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac7e4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+29:2359:x1848989694705408:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 6269us (7087us total) trans 0 rc 301/301 00000100:00100000:0.0:1763334989.727912:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5319 00000100:00100000:2.0:1763334989.734327:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334989.735243:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694705536 00000100:00100000:0.0:1763334989.735551:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694705536 00000100:00100000:0.0:1763334989.736312:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5320 00000100:00100000:0.0:1763334989.736335:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+19:53644:x1848989694705536:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:0.0:1763334989.736365:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1763334989.736398:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d7ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0a31 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.736445:0:26216:0:(ldlm_lock.c:681:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf94 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00c9 expref: 20 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334989.736456:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334989.736458:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1763334989.736464:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d7ea lrc: 4/0,0 mode: --/PW res: [0x240000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a31 expref: 20 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.736512:0:26216:0:(ldlm_lockd.c:962:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00c9 expref: 20 pid: 6518 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1763334989.736530:0:26216:0:(ldlm_lockd.c:494:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00c9 expref: 20 pid: 6518 timeout: 1154 lvb_type: 1 00000100:00100000:0.0:1763334989.736547:0:26216:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac6c1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701920896:192.168.201.60@tcp:104: 00000100:00100000:0.0:1763334989.737079:0:26216:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5ac5531540 going to sleep for 11 seconds 00000100:00100000:0.0:1763334989.742038:0:26216:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac6c1f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:26216:1848989701920896:192.168.201.60@tcp:104: 00010000:00010000:0.0:1763334989.742087:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d7ea lrc: 3/0,0 mode: --/PW res: [0x240000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->8191] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a31 expref: 20 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1763334989.742110:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5af6792400, rc 0) 00000100:00100000:0.0:1763334989.742837:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+20:53644:x1848989694705536:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 6497us (8575us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334989.742849:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5320 00000100:00100000:2.0:1763334989.743554:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334989.743897:0:5734:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694705664 00000100:00100000:1.0:1763334989.743910:0:5734:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694705664 00010000:00010000:1.0:1763334989.743960:0:5734:0:(ldlm_lockd.c:2675:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00c9 expref: 20 pid: 6518 timeout: 1154 lvb_type: 1 00000100:00100000:1.0:1763334989.744006:0:5734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2757 00000100:00100000:1.0:1763334989.744016:0:5734:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+20:2360:x1848989694705664:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1763334989.744034:0:5734:0:(ldlm_lockd.c:1746:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1763334989.744064:0:5734:0:(ldlm_lockd.c:1795:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf94 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00c9 expref: 20 pid: 6518 timeout: 1154 lvb_type: 1 00010000:00010000:1.0:1763334989.744079:0:5734:0:(ldlm_lockd.c:567:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf94 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00c9 expref: 20 pid: 6518 timeout: 1154 lvb_type: 1 00010000:00010000:1.0:1763334989.744112:0:5734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff9a5ac5430c00/0xcedf0054f849bf94 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x247:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b00c9 expref: 20 pid: 6518 timeout: 1154 lvb_type: 1 00010000:00010000:1.0:1763334989.744131:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334989.744133:0:5734:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1763334989.744142:0:5734:0:(ldlm_lock.c:709:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d7ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a31 expref: 19 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.744153:0:5734:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d7ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a31 expref: 19 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1763334989.744196:0:5734:0:(ldlm_lockd.c:1081:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff9a5af6792400/0xcedf0054f849d7ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x247:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->8191) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a31 expref: 19 pid: 26216 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1763334989.744213:0:5734:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5734:1848989701921024:192.168.201.60@tcp:105: 00000100:00100000:1.0:1763334989.744312:0:5734:0:(client.c:2690:ptlrpc_set_wait()) set ffff9a5aeeb46480 going to sleep for 11 seconds 00000100:00100000:1.0:1763334989.748504:0:5734:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4fb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5734:1848989701921024:192.168.201.60@tcp:105: 00010000:00010000:1.0:1763334989.748545:0:5734:0:(ldlm_lockd.c:1807:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1763334989.748660:0:5734:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2360:x1848989694705664:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4643us (5107us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334989.748675:0:5734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2757 00000100:00100000:0.0:1763334989.752568:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.752789:0:26216:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694705792 00000100:00100000:2.0:1763334989.752803:0:26216:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694705792 00000100:00100000:2.0:1763334989.752896:0:26216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5321 00000100:00100000:2.0:1763334989.752910:0:26216:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+29:53644:x1848989694705792:12345-192.168.201.60@tcp:101:fsx.0 00010000:00010000:2.0:1763334989.752939:0:26216:0:(ldlm_lockd.c:1264:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1763334989.752979:0:26216:0:(ldlm_lockd.c:1342:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849d7f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x5d7d776e833b0a38 expref: -99 pid: 26216 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1763334989.753017:0:26216:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000400:0x24b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1763334989.753046:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334989.753049:0:26216:0:(ldlm_extent.c:416:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1763334989.753060:0:26216:0:(ldlm_resource.c:1525:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849d7f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a38 expref: 30 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.753081:0:26216:0:(ldlm_lockd.c:1512:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff9a5ac5431600/0xcedf0054f849d7f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x5d7d776e833b0a38 expref: 30 pid: 26216 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1763334989.753097:0:26216:0:(ldlm_lockd.c:1591:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9a5ac5431600, rc 0) 00000100:00100000:2.0:1763334989.753189:0:26216:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:f4599faa-cf4a-4df6-8700-d383b4282dac+30:53644:x1848989694705792:12345-192.168.201.60@tcp:101:fsx.0 Request processed in 281us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334989.753198:0:26216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5321 00000100:00100000:2.0:1763334989.756437:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1763334989.756685:0:29630:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694706048 00000100:00100000:3.0:1763334989.756700:0:29630:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694706048 00000100:00100000:3.0:1763334989.756784:0:29630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1861 00000100:00100000:3.0:1763334989.756797:0:29630:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59c39e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+203:53644:x1848989694706048:12345-192.168.201.60@tcp:35:fsx.0 00000001:00080000:3.0:1763334989.757237:0:29630:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939344 00000100:00100000:3.0:1763334989.757394:0:29630:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59c39e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694706048:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 597us (975us total) trans 8589939345 rc 0/0 00000100:00100000:3.0:1763334989.757404:0:29630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1861 00000020:00080000:3.0:1763334989.757412:0:29630:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763334989.762938:0:3282:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.763749:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694706304 00000100:00100000:2.0:1763334989.763766:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694706304 00000100:00100000:2.0:1763334989.763855:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1862 00000100:00100000:2.0:1763334989.763867:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+205:53644:x1848989694706304:12345-192.168.201.60@tcp:35:fsx.0 00000001:00080000:2.0:1763334989.764703:0:29631:0:(tgt_lastrcvd.c:2075:tgt_txn_stop_cb()) More than one transaction 8589939346 00000100:00100000:2.0:1763334989.764931:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+207:53644:x1848989694706304:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 1060us (2005us total) trans 8589939347 rc 0/0 00000100:00100000:2.0:1763334989.764942:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1862 00000020:00080000:2.0:1763334989.764950:0:29631:0:(tgt_main.c:782:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1763334989.769197:0:3284:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1763334989.769305:0:29631:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694706560 00000100:00100000:2.0:1763334989.769319:0:29631:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694706560 00000100:00100000:2.0:1763334989.769393:0:29631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1863 00000100:00100000:2.0:1763334989.769406:0:29631:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+207:53644:x1848989694706560:12345-192.168.201.60@tcp:35:fsx.0 00000100:00100000:2.0:1763334989.769753:0:29631:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+208:53644:x1848989694706560:12345-192.168.201.60@tcp:35:fsx.0 Request processed in 348us (570us total) trans 8589939348 rc 0/0 00000100:00100000:2.0:1763334989.769762:0:29631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1863 00000100:00100000:0.0:1763334990.419780:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334990.419839:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334990.419873:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1763334990.419915:0:3283:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1763334990.419971:0:29628:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694706816 00000100:00100000:1.0:1763334990.419987:0:29628:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694706816 00000100:00100000:1.0:1763334990.420081:0:29628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 155 00000100:00100000:1.0:1763334990.420097:0:29628:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+208:2361:x1848989694706816:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1763334990.420100:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694706944 00000100:00100000:3.0:1763334990.420107:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694706944 00000100:00100000:3.0:1763334990.420143:0:6519:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694707072 00000100:00100000:3.0:1763334990.420146:0:6519:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694707072 00000100:00100000:3.0:1763334990.420180:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 483 00000100:00100000:3.0:1763334990.420189:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2361:x1848989694706944:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1763334990.420225:0:29628:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4599faa-cf4a-4df6-8700-d383b4282dac+208:2361:x1848989694706816:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 131us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334990.420235:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6c1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+19:2361:x1848989694706944:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 47us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1763334990.420238:0:29628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 155 00000100:00100000:3.0:1763334990.420248:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 483 00000100:00100000:3.0:1763334990.420269:0:26564:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 484 00000100:00100000:3.0:1763334990.420276:0:26564:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2361:x1848989694707072:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1763334990.420316:0:26564:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:f4599faa-cf4a-4df6-8700-d383b4282dac+30:2361:x1848989694707072:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 40us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334990.420322:0:26564:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 484 00000100:00100000:2.0:1763334990.420413:0:29624:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989694706688 00000100:00100000:2.0:1763334990.420418:0:29624:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989694706688 00000100:00100000:2.0:1763334990.420455:0:29624:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 146 00000100:00100000:2.0:1763334990.420461:0:29624:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1264d40-158f-4e44-9f7a-49909c525321+9:2361:x1848989694706688:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1763334990.420489:0:29624:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6073c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b1264d40-158f-4e44-9f7a-49909c525321+9:2361:x1848989694706688:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 29us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1763334990.420496:0:29624:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 146 00000100:00100000:3.0:1763334990.565794:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1763334990.566495:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701921152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1763334990.566616:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334990.566708:0:6521:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701921152 00000100:00100000:3.0:1763334990.566717:0:6521:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701921152 00000100:00100000:3.0:1763334990.566794:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1763334990.566805:0:6521:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59cd076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1848989701921152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1763334990.566862:0:6521:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 59310080 pending 0 free 3855613952 avail 3853516800 00000100:00100000:3.0:1763334990.566908:0:6521:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59cd076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1848989701921152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334990.566916:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00080000:3.0:1763334990.566939:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1763334990.566981:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701921152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1763334990.569123:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a59cd076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701921280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1763334990.569222:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334990.569459:0:6520:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701921280 00000100:00100000:3.0:1763334990.569471:0:6520:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701921280 00000100:00100000:3.0:1763334990.569550:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1763334990.569562:0:6520:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1848989701921280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1763334990.569624:0:6520:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 106758144 pending 0 free 3855613952 avail 3853516800 00000100:00100000:3.0:1763334990.569735:0:6520:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3292:x1848989701921280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334990.569743:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00080000:3.0:1763334990.569770:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1763334990.569890:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a59cd076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3292:1848989701921280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1763334990.570494:0:3289:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5ac7e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:53c3ae04-da5d-4a5f-b9b8-469954a64a68:3289:1848989701921408:0@lo:400:kworker.0 00000100:00100000:3.0:1763334990.570544:0:3289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1763334990.570642:0:29623:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701921408 00000100:00100000:0.0:1763334990.570648:0:29623:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701921408 00000100:00100000:0.0:1763334990.570687:0:29623:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1763334990.570695:0:29623:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5ac6073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:53c3ae04-da5d-4a5f-b9b8-469954a64a68+18:3289:x1848989701921408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1763334990.574521:0:29623:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5ac6073850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:53c3ae04-da5d-4a5f-b9b8-469954a64a68+18:3289:x1848989701921408:12345-0@lo:400:kworker.0 Request processed in 3810us (3960us total) trans 0 rc 0/0 00000100:00100000:0.0:1763334990.574542:0:29623:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1763334990.574758:0:3289:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5ac7e4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:53c3ae04-da5d-4a5f-b9b8-469954a64a68:3289:1848989701921408:0@lo:400:kworker.0 00000100:00100000:0.0:1763334990.577133:0:3291:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1848989701921664:0@lo:400:kworker.0 00000100:00100000:0.0:1763334990.577211:0:3291:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334990.577376:0:3290:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1848989701921536:0@lo:400:kworker.0 00000100:00100000:3.0:1763334990.577406:0:3290:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334990.577443:0:3292:0:(client.c:1903:ptlrpc_send_new_req()) Sending RPC req@ffff9a5af6a20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1848989701921792:0@lo:400:kworker.0 00000100:00100000:3.0:1763334990.577464:0:3292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1763334990.577499:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701921664 00000100:00100000:3.0:1763334990.577507:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701921664 00000100:00100000:3.0:1763334990.577565:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701921536 00000100:00100000:3.0:1763334990.577567:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701921536 00000100:00100000:3.0:1763334990.577611:0:30972:0:(service.c:2279:ptlrpc_server_handle_req_in()) unwrap req x1848989701921792 00000100:00100000:3.0:1763334990.577614:0:30972:0:(service.c:2344:ptlrpc_server_handle_req_in()) got req x1848989701921792 00000100:00100000:3.0:1763334990.577628:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1763334990.577636:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1848989701921664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763334990.577683:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a5af6a21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1848989701921664:12345-0@lo:400:kworker.0 Request processed in 48us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334990.577690:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1763334990.577707:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1763334990.577712:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59cd076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1848989701921536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763334990.577742:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59cd076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1848989701921536:12345-0@lo:400:kworker.0 Request processed in 30us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334990.577747:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1763334990.577761:0:30972:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1763334990.577766:0:30972:0:(service.c:2530:ptlrpc_server_handle_request()) Handling RPC req@ffff9a59cd077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1848989701921792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1763334990.577791:0:30972:0:(service.c:2588:ptlrpc_server_handle_request()) Handled RPC req@ffff9a59cd077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1848989701921792:12345-0@lo:400:kworker.0 Request processed in 25us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1763334990.577796:0:30972:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1763334990.577832:0:5744:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1763334990.577869:0:3290:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3290:1848989701921536:0@lo:400:kworker.0 00000100:00100000:3.0:1763334990.577896:0:3292:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3292:1848989701921792:0@lo:400:kworker.0 00000100:00100000:0.0:1763334990.578056:0:3291:0:(client.c:2389:ptlrpc_check_set()) Completed RPC req@ffff9a5af6a22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3291:1848989701921664:0@lo:400:kworker.0 00010000:00010000:3.0:1763334990.694406:0:8205:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1763334991.719937:0:8206:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1763334991.758895:0:32544:0:(debug.c:665:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_70a: @@@@@@ FAIL: fsx FLR file /mnt/lustre/d70a.sanity-flr/f70a.sanity-flr failed 00010000:00010000:0.0:1763334992.743610:0:5737:0:(ldlm_lockd.c:2796:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 69390 lines, 69390 kept, 0 dropped, 0 bad.